-- Logs begin at Tue 2022-10-04 15:49:08 UTC, end at Tue 2022-10-04 16:45:57 UTC. -- Oct 04 16:17:09.660056 dv-cinder-749155-14-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 04 16:17:09.668983 dv-cinder-749155-14-smb devstack@keystone.service[81549]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 04 16:17:09.671452 dv-cinder-749155-14-smb devstack@keystone.service[81549]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 16:17:09 2022] *** Oct 04 16:17:09.671452 dv-cinder-749155-14-smb devstack@keystone.service[81549]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 16:17:09.671452 dv-cinder-749155-14-smb devstack@keystone.service[81549]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 16:17:09.671452 dv-cinder-749155-14-smb devstack@keystone.service[81549]: nodename: dv-cinder-749155-14-smb Oct 04 16:17:09.671452 dv-cinder-749155-14-smb devstack@keystone.service[81549]: machine: x86_64 Oct 04 16:17:09.671452 dv-cinder-749155-14-smb devstack@keystone.service[81549]: clock source: unix Oct 04 16:17:09.671452 dv-cinder-749155-14-smb devstack@keystone.service[81549]: pcre jit disabled Oct 04 16:17:09.671452 dv-cinder-749155-14-smb devstack@keystone.service[81549]: detected number of CPU cores: 4 Oct 04 16:17:09.671452 dv-cinder-749155-14-smb devstack@keystone.service[81549]: current working directory: / Oct 04 16:17:09.671452 dv-cinder-749155-14-smb devstack@keystone.service[81549]: detected binary path: /usr/bin/uwsgi-core Oct 04 16:17:09.671452 dv-cinder-749155-14-smb devstack@keystone.service[81549]: your processes number limit is 47680 Oct 04 16:17:09.672062 dv-cinder-749155-14-smb devstack@keystone.service[81549]: your memory page size is 4096 bytes Oct 04 16:17:09.672062 dv-cinder-749155-14-smb devstack@keystone.service[81549]: detected max file descriptor number: 2048 Oct 04 16:17:09.672062 dv-cinder-749155-14-smb devstack@keystone.service[81549]: lock engine: pthread robust mutexes Oct 04 16:17:09.672062 dv-cinder-749155-14-smb devstack@keystone.service[81549]: thunder lock: enabled Oct 04 16:17:09.672062 dv-cinder-749155-14-smb devstack@keystone.service[81549]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 04 16:17:09.672062 dv-cinder-749155-14-smb devstack@keystone.service[81549]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 16:17:09.710565 dv-cinder-749155-14-smb devstack@keystone.service[81549]: Python main interpreter initialized at 0x55efe7d7d9c0 Oct 04 16:17:09.710565 dv-cinder-749155-14-smb devstack@keystone.service[81549]: python threads support enabled Oct 04 16:17:09.710565 dv-cinder-749155-14-smb devstack@keystone.service[81549]: your server socket listen backlog is limited to 100 connections Oct 04 16:17:09.710565 dv-cinder-749155-14-smb devstack@keystone.service[81549]: your mercy for graceful operations on workers is 90 seconds Oct 04 16:17:09.710961 dv-cinder-749155-14-smb devstack@keystone.service[81549]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 16:17:09.710961 dv-cinder-749155-14-smb devstack@keystone.service[81549]: *** Operational MODE: preforking *** Oct 04 16:17:09.711283 dv-cinder-749155-14-smb devstack@keystone.service[81549]: *** uWSGI is running in multiple interpreter mode *** Oct 04 16:17:09.711283 dv-cinder-749155-14-smb devstack@keystone.service[81549]: spawned uWSGI master process (pid: 81549) Oct 04 16:17:09.711518 dv-cinder-749155-14-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 04 16:17:09.714406 dv-cinder-749155-14-smb devstack@keystone.service[81549]: spawned uWSGI worker 1 (pid: 81561, cores: 1) Oct 04 16:17:09.714406 dv-cinder-749155-14-smb devstack@keystone.service[81549]: spawned uWSGI worker 2 (pid: 81562, cores: 1) Oct 04 16:17:09.714406 dv-cinder-749155-14-smb devstack@keystone.service[81549]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 16:17:13.946488 dv-cinder-749155-14-smb devstack@keystone.service[81562]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 16:17:13.946488 dv-cinder-749155-14-smb devstack@keystone.service[81562]: from cryptography.utils import int_from_bytes Oct 04 16:17:13.947321 dv-cinder-749155-14-smb devstack@keystone.service[81561]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 16:17:13.947321 dv-cinder-749155-14-smb devstack@keystone.service[81561]: from cryptography.utils import int_from_bytes Oct 04 16:17:13.947738 dv-cinder-749155-14-smb devstack@keystone.service[81562]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 16:17:13.947738 dv-cinder-749155-14-smb devstack@keystone.service[81562]: from cryptography.utils import int_from_bytes Oct 04 16:17:13.947843 dv-cinder-749155-14-smb devstack@keystone.service[81561]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 16:17:13.947843 dv-cinder-749155-14-smb devstack@keystone.service[81561]: from cryptography.utils import int_from_bytes Oct 04 16:17:13.996884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 16:17:13.997087 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 16:17:13.997169 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 16:17:13.997242 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 16:17:13.997306 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] command line args: [] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 16:17:13.997367 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] command line args: [] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 16:17:13.997521 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 16:17:13.997652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 16:17:13.997729 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ================================================================================ {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 16:17:13.997822 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ================================================================================ {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 16:17:13.997901 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] admin_token = **** {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:13.997987 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] admin_token = **** {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:13.998155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] config_dir = [] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:13.998243 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] config_dir = [] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:13.998312 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:13.998385 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:13.998505 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] config_source = [] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:13.998596 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] config_source = [] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:13.998662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] debug = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:13.998725 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] debug = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:13.998852 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:13.999419 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:13.999419 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:13.999573 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:13.999638 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:13.999702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:13.999765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:13.999833 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:13.999898 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:13.999956 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.000132 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] list_limit = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.000208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] list_limit = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.000266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] log_config_append = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.000330 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] log_config_append = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.000442 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.000516 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.000580 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] log_dir = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.000637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] log_dir = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.000751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] log_file = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.000832 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] log_file = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.001009 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.001123 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.001258 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.001346 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.001459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.001545 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.001753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.001936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.001936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.002074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.002157 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.002223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.002283 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.002346 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.002491 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.002581 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.002738 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.002834 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.002951 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.003063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.003224 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.003357 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.003443 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.003514 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.003713 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.003836 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.003914 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.004048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.004207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.004349 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.004691 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.004819 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.004819 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] publish_errors = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.004975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] publish_errors = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.005110 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.005192 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.005275 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.005354 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.005477 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.005553 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.005669 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.005759 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.005916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.006049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.006136 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] standard_threads = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.006210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] standard_threads = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.006334 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.006429 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.006557 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.006637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.006715 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.006786 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.006930 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] use_journal = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.007059 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] use_journal = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.007059 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] use_json = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.007192 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] use_json = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.007267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] use_stderr = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.007343 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] use_stderr = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.007467 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] use_syslog = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.007547 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] use_syslog = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.007617 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.007691 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 16:17:14.007884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.008017 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.008107 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.008181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.008367 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.008541 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.008619 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.008689 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.008814 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.008902 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.009081 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.009201 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.009280 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.009350 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.009546 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.009750 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.009840 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.009913 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.009990 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.010061 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.010251 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.010383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.010464 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.010534 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.010723 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.010856 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.010946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.011047 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.011221 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.011360 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.011440 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.011522 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.011718 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.011846 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.011924 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.011995 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.012204 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.012326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.012489 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.012566 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.012637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.012707 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.012893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.012992 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.013150 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.013231 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.013396 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.013477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.013642 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.013732 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.013868 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.013954 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.014093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.014180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.014322 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.014415 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.014553 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.014634 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.014798 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.014884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.015063 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.015164 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.015293 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.015375 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.015520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.015607 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.015762 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.015852 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.016015 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.016101 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.016249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.016339 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.016491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.016583 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.016717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.016805 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.016934 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.017010 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.017165 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.017250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.017395 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.017477 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.017621 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.017697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.017848 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.018004 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.018078 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.018148 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.018300 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.018378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.018544 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.018629 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.018772 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.018848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.019031 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.019113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.019255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.019343 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.019487 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.019570 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.019719 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.019795 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.019964 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.020048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.020192 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.020268 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.020423 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.020499 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.020687 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.020811 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.020912 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.021114 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.021251 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.021468 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.021584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.021684 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.021762 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.021862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.021939 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.022057 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.022182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.022295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.022406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.022523 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.022636 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.022756 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.022869 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.023024 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.023161 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.023275 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.023378 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.023488 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.023599 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.023710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.023829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.023942 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.024053 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.024172 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.024290 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.024408 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.024519 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.024631 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.024743 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.024845 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.024955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.025074 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.025197 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.025311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.025422 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.025539 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.025651 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.025762 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.025881 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.025993 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.026105 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.026224 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.026336 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.026448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.026567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.026680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.026791 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.026902 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.027042 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.027156 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.027433 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.027576 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.027695 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.027808 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.027926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.028039 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.028159 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.028270 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.028380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.028489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.028606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.028716 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.028832 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.028943 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.029053 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.029163 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.029279 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.029401 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.029590 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.029703 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.029817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.029928 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.030037 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.030155 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.030275 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.030433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.030547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.030657 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.030766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.030875 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.031031 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.031156 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.031269 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.031378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.031489 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.031608 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.031718 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.031838 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.031955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.032066 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.032176 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.032285 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.032394 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.032512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.032623 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.032764 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.032876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.032985 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.033102 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.033245 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.033365 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] auth.external = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.033485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] auth.external = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.033619 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.033783 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.033783 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.034011 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.034011 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.034230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.034342 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] auth.password = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.034497 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] auth.password = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.034497 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] auth.token = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.034709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] auth.token = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.034820 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.034939 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.035074 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.035187 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.035297 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.035408 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.035519 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.035637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.035749 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.035860 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.035977 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.036089 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.036199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.036317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.036429 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] credential.caching = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.036539 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] credential.caching = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.036650 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.036773 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.036877 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.036996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.037108 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.037218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.037329 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.037443 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.037554 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.037672 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.037785 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.037895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.038005 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.038115 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.038225 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.038343 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.038455 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.038565 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.038676 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.038793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.038904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.039050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.039165 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.039276 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.039392 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.039504 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.039614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.039736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.039850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.039960 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.040071 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] federation.caching = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.040181 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] federation.caching = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.040291 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.040410 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.040523 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.040634 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.040744 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.040857 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.040967 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.041086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.041197 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.041308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.041426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.041537 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.041655 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.041767 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.041877 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.041989 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.042099 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.042210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.042328 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.042450 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.042562 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.042672 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.042782 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.caching = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.042892 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.caching = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.043139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.043256 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.043368 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.043480 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.043591 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.043703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.043822 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.043935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.044048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.044158 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.044269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.044380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.044502 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.044614 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.044725 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.045188 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.045310 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.045422 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.045541 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.045653 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.045764 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.045875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.045985 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.046096 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.046215 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.046327 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.046438 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.046548 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.046659 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.046769 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.046888 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.047023 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.047136 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.047250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.047362 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.047477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.047599 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.047712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.047823 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.047932 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.048043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.048153 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.048272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.048384 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.048494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.048604 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.048715 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.048862 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.049028 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.049148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.049262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.049373 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.049484 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.049594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.049712 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.049824 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.049935 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.050045 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.050156 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.050266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.050386 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.050497 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.050608 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.050719 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.050830 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.050948 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.051119 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.051232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.051342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.051465 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.051578 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.051696 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.051807 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.051918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.052029 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.052139 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.052251 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.052369 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.052481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.052591 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.052701 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.052812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.052921 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.053039 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.053150 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.053261 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.053371 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.053484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.053595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.053712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.053824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.053933 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.054046 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.054156 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.054267 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.054385 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.054496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.054606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.054716 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.054826 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.054939 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.055078 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.055191 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.055301 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.055412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.055523 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.055635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.055753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.055871 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.055982 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.056093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.056202 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.056312 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.056431 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.056543 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.056654 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.056764 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.056873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.056983 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.057100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.057212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.057322 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.057435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.057435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.057642 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.057642 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.057858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.057975 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.058086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.058195 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.058305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.058422 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.058607 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.058723 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.058834 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.058945 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.059087 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.059211 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.059324 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.059324 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.059531 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.059641 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.059751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.059869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.059980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.060090 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.060199 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.060199 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.060405 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.060523 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.060634 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.060634 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.060842 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.060842 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.061087 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.061087 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.061304 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.061413 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.061523 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.061633 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.061742 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.061860 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.061972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.062081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.062191 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.062300 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.062409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.062537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.062650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.062760 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.062869 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.062999 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.063111 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.063234 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] resource.caching = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.063349 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.063459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.063568 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] resource.caching = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.063678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.063788 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.063906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.064018 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.064128 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.064237 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.064346 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.064488 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.064654 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.064775 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.064886 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.064997 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.065107 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.065289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.065403 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.065514 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.065624 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] role.caching = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.065735 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.065845 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] role.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.065963 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] role.caching = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.066076 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.066186 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] role.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.066296 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.066406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.066516 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.066634 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.066746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.066856 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.066966 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.067126 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.067238 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.067361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.067478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.067589 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.067699 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.067810 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.067919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.068037 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.068151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.068261 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.068372 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.068483 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.068592 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.068711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.068822 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.068932 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.069043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.069153 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.069153 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.069369 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.069369 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.069585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.069585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.069793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.069903 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.070022 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.070134 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.070245 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.070355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.070467 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.070585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.070697 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.070806 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.070917 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.071040 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.071139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.071261 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.071375 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.071491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.071602 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.071712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.071822 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.071940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.072053 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.072163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.072273 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.072384 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.072495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.072598 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.072710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.072820 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.072930 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.073040 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.073150 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.073267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.073380 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.073490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.073600 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] token.caching = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.073710 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] token.caching = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.073805 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.073923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.074035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.074145 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.074256 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.074351 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.074551 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.074676 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.074788 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.074899 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.075067 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.075184 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.075294 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.075416 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.075530 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.075641 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.075751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.075861 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.075971 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.076075 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.076198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.076363 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.076498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.076612 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.076723 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.076843 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.076955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.077072 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.077184 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.077303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.077428 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.077553 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.077667 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.077778 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.077897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.connection = **** {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.078010 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.connection = **** {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.078121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.078233 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.078345 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.078462 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.078582 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.078695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.078806 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.078917 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.079074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.079189 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.079313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.079427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.079538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.079649 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.079761 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.079872 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.079991 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.080104 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.080217 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.080327 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.080438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.080549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.080668 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.080782 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.080893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.081003 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.081115 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.081225 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.081344 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.081456 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.081567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.081677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.081789 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.081900 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.082019 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.082019 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 16:17:14.082229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 16:17:14.082229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 16:17:14.111197 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.111430 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.111537 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.111664 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.111742 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.111934 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.120106 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.120343 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.148457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.148651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.149854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.150092 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.202187 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.202343 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.250686 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.250896 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.251069 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.251313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.409423 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.409633 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.409758 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.409841 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.409933 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.410010 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.410071 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.413077 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.413180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.413262 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.413338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.413399 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.434202 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.434359 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.434492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.434605 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.434730 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.434808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.434870 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.435016 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.435147 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.435226 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.435288 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.435403 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.435516 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.435637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.446750 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.446960 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.459652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.459828 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.460040 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.460153 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.460279 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.460361 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.460424 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.460542 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.460667 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.460745 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.460870 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.460955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.461100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.461317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 16:17:14.478081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.478291 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 16:17:14.478509 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.478654 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.478734 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 16:17:14.478822 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 16:17:14.479072 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.479193 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.479328 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 16:17:14.479408 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.479586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.479724 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.479868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.479951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.480070 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.480318 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.489555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.489836 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.490039 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.490136 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.490301 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.490443 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.490580 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.490842 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.497442 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.497934 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.500379 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.500671 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.500871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.500994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.501128 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.501208 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.501427 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.501550 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.501684 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.501764 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.501979 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.502115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.502250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.502330 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.502485 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.502570 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.502757 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.502842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.503042 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.503126 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.503319 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.503588 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.525753 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.526264 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.527271 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.527558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.527778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.528073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.532265 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.532553 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.532752 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.532944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.533046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.533301 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.539205 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.539523 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.539711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.539996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.545691 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.545992 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.546115 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.546251 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.546331 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.546551 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.546679 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.546814 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.546894 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.547116 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.547258 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.547394 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.547475 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.547644 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.547767 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.547999 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.563156 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.563415 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.563759 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.564035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.567292 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.567925 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.570537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.570835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.571138 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.571451 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.576332 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.576510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.578642 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.578875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.581579 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.581879 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.582137 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.582226 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.582423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.582506 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.582711 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.582789 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.583011 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.583104 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.583296 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.583588 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.598895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.599209 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.599479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.599600 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.599752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.599876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.600011 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.600279 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.606621 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.607177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.608298 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.608733 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.609853 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.610150 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.610273 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.610504 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.613082 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.613207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.613335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.613513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.613606 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.613807 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.613932 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.614090 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.614296 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.614432 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.625557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.625825 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.625968 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.626104 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.626184 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.626345 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.626435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.626651 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.626775 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.627004 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.627134 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.627289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.627368 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.627591 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.642759 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.643028 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.645702 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.645943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.648605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.648845 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.650134 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.650293 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.651637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.651817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.651912 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.652131 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.652333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.652601 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.658752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.658943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.660204 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.660501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.663246 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.663416 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.663679 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.663781 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.664016 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.664170 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.664299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.664438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.672679 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.672800 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.672939 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.673021 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.673233 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.673339 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.680170 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.680295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 16:17:14.680467 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.680550 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.680719 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.680845 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.680985 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.681065 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.681261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.681385 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.681537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.681620 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.681805 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.681942 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.682073 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.682152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.682332 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.682459 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.682581 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.682688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.682890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.683039 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.683143 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.683223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.683482 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.683670 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.683767 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.683846 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 16:17:14.718031 dv-cinder-749155-14-smb devstack@keystone.service[81562]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55efe7d7d9c0 pid: 81562 (default app) Oct 04 16:17:14.718216 dv-cinder-749155-14-smb devstack@keystone.service[81561]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55efe7d7d9c0 pid: 81561 (default app) Oct 04 16:17:14.721577 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88476b-71d8-46dc-b935-aeef6916f051 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:14.721864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88476b-71d8-46dc-b935-aeef6916f051 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:14.722138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88476b-71d8-46dc-b935-aeef6916f051 None None] PATH_INFO: `/v3` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:14.726445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 791 bytes} [Tue Oct 4 16:17:14 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:21.566460 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189829a-af91-41f7-8bb9-3284b546adc0 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:21.567056 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189829a-af91-41f7-8bb9-3284b546adc0 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:21.567056 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189829a-af91-41f7-8bb9-3284b546adc0 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:21.571294 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1/2] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:17:21.577773 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ba501-fa68-4f29-9902-ca6a87e659da None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:21.578406 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ba501-fa68-4f29-9902-ca6a87e659da None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:21.578406 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ba501-fa68-4f29-9902-ca6a87e659da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:21.650771 dv-cinder-749155-14-smb devstack@keystone.service[81561]: INFO dbcounter [None req-a52ba501-fa68-4f29-9902-ca6a87e659da None None] Registered counter for database keystone Oct 04 16:17:21.672698 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG oslo_db.sqlalchemy.engines [None req-a52ba501-fa68-4f29-9902-ca6a87e659da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 16:17:21.684872 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writer thread running {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 16:17:21.868507 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG passlib.handlers.bcrypt [None req-a52ba501-fa68-4f29-9902-ca6a87e659da None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81561) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 04 16:17:21.868792 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG passlib.handlers.bcrypt [None req-a52ba501-fa68-4f29-9902-ca6a87e659da None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81561) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 04 16:17:21.928001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-a52ba501-fa68-4f29-9902-ca6a87e659da None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:21.929632 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a52ba501-fa68-4f29-9902-ca6a87e659da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:22.083712 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 2/3] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 507 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 04 16:17:22.544213 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189829a-af91-41f7-8bb9-3284b546adc0 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:22.626329 dv-cinder-749155-14-smb devstack@keystone.service[81562]: INFO dbcounter [None req-7189829a-af91-41f7-8bb9-3284b546adc0 None None] Registered counter for database keystone Oct 04 16:17:22.651597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG oslo_db.sqlalchemy.engines [None req-7189829a-af91-41f7-8bb9-3284b546adc0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 16:17:22.661801 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writer thread running {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 16:17:22.782829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189829a-af91-41f7-8bb9-3284b546adc0 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:22.788370 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7730b7e-1522-4661-8a54-a5e13cb6bc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:22.789003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7730b7e-1522-4661-8a54-a5e13cb6bc94 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:22.789283 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7730b7e-1522-4661-8a54-a5e13cb6bc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:22.789554 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7730b7e-1522-4661-8a54-a5e13cb6bc94 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:22.800095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7730b7e-1522-4661-8a54-a5e13cb6bc94 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:22.860665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a7730b7e-1522-4661-8a54-a5e13cb6bc94 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 04 16:17:22.861014 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7730b7e-1522-4661-8a54-a5e13cb6bc94 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:22.871461 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 2/4] 10.222.0.55 () {58 vars in 1324 bytes} [Tue Oct 4 16:17:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 16:17:22.880780 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ba501-fa68-4f29-9902-ca6a87e659da None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:22.900121 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ba501-fa68-4f29-9902-ca6a87e659da None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:22.905787 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c544b6-6e59-41db-a898-ae95063dd2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:22.906904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c544b6-6e59-41db-a898-ae95063dd2fc admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:22.907218 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c544b6-6e59-41db-a898-ae95063dd2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:22.907484 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c544b6-6e59-41db-a898-ae95063dd2fc admin admin] PATH_INFO: `/v3/projects/d8da776c843c485a9ba105a4675b7ac9` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:22.909193 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c544b6-6e59-41db-a898-ae95063dd2fc admin admin] RBAC: Authorizing `identity:get_project(project_id=d8da776c843c485a9ba105a4675b7ac9)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:22.961968 dv-cinder-749155-14-smb devstack@keystone.service[81561]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f5c544b6-6e59-41db-a898-ae95063dd2fc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 04 16:17:22.962320 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c544b6-6e59-41db-a898-ae95063dd2fc admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:22.967004 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 3/5] 10.222.0.55 () {56 vars in 1207 bytes} [Tue Oct 4 16:17:22 2022] GET /identity/v3/projects/d8da776c843c485a9ba105a4675b7ac9 => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:17:25.133830 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767a3d2-ee6c-4e0a-aabd-7ed6ddd74a2d None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:25.134963 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767a3d2-ee6c-4e0a-aabd-7ed6ddd74a2d None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:25.134963 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767a3d2-ee6c-4e0a-aabd-7ed6ddd74a2d None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:25.140941 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 3/6] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:17:25.150791 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9251eac-1e5d-4791-b3a2-466d08740384 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:25.151278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9251eac-1e5d-4791-b3a2-466d08740384 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:25.151492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9251eac-1e5d-4791-b3a2-466d08740384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:25.184889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-d9251eac-1e5d-4791-b3a2-466d08740384 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:25.187151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-d9251eac-1e5d-4791-b3a2-466d08740384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:25.197328 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 4/7] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 04 16:17:25.463466 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767a3d2-ee6c-4e0a-aabd-7ed6ddd74a2d None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:25.485286 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767a3d2-ee6c-4e0a-aabd-7ed6ddd74a2d None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:25.491402 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639b95f-28ae-46e9-8b5e-b83d9a3bae33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:25.492348 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639b95f-28ae-46e9-8b5e-b83d9a3bae33 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:25.492725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639b95f-28ae-46e9-8b5e-b83d9a3bae33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:25.493083 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639b95f-28ae-46e9-8b5e-b83d9a3bae33 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:25.506156 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639b95f-28ae-46e9-8b5e-b83d9a3bae33 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:25.509508 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639b95f-28ae-46e9-8b5e-b83d9a3bae33 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:25.524400 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 4/8] 10.222.0.55 () {58 vars in 1324 bytes} [Tue Oct 4 16:17:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 16:17:25.532461 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9251eac-1e5d-4791-b3a2-466d08740384 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:25.554688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9251eac-1e5d-4791-b3a2-466d08740384 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:25.560698 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f153af0-5727-41f8-87a1-9af5f447828a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:25.561620 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f153af0-5727-41f8-87a1-9af5f447828a admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:25.561940 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f153af0-5727-41f8-87a1-9af5f447828a admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:25.562310 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f153af0-5727-41f8-87a1-9af5f447828a admin admin] PATH_INFO: `/v3/users/f4a141c4b1594c35992b7b147f7c2904` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:25.564133 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f153af0-5727-41f8-87a1-9af5f447828a admin admin] RBAC: Authorizing `identity:get_user(user_id=f4a141c4b1594c35992b7b147f7c2904)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:25.566890 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f153af0-5727-41f8-87a1-9af5f447828a admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:25.569661 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 5/9] 10.222.0.55 () {56 vars in 1198 bytes} [Tue Oct 4 16:17:25 2022] GET /identity/v3/users/f4a141c4b1594c35992b7b147f7c2904 => generated 247 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:27.834427 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee91111-7e60-45ad-988e-eb184eaa7785 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:27.834963 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee91111-7e60-45ad-988e-eb184eaa7785 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:27.834963 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee91111-7e60-45ad-988e-eb184eaa7785 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:27.836264 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 5/10] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:17:27.842072 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a427f-411d-4cbc-9c57-224f4e855583 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:27.842547 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a427f-411d-4cbc-9c57-224f4e855583 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:27.842749 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a427f-411d-4cbc-9c57-224f4e855583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:27.861017 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2eac4c-8a95-4c06-a545-e21493750390 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:27.861330 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2eac4c-8a95-4c06-a545-e21493750390 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:27.861582 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2eac4c-8a95-4c06-a545-e21493750390 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:27.862373 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-971a427f-411d-4cbc-9c57-224f4e855583 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:27.862935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 6/11] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:17:27.863601 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-971a427f-411d-4cbc-9c57-224f4e855583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:27.868208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389a099-4cdf-4b1e-9013-36e40029472f None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:27.868490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389a099-4cdf-4b1e-9013-36e40029472f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:27.868758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389a099-4cdf-4b1e-9013-36e40029472f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:27.911101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG passlib.handlers.bcrypt [None req-e389a099-4cdf-4b1e-9013-36e40029472f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81562) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 04 16:17:27.911640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG passlib.handlers.bcrypt [None req-e389a099-4cdf-4b1e-9013-36e40029472f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81562) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 04 16:17:27.951560 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 6/12] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:17:27.968995 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-e389a099-4cdf-4b1e-9013-36e40029472f None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:27.970642 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-e389a099-4cdf-4b1e-9013-36e40029472f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:28.078437 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 7/13] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:17:28.215777 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a427f-411d-4cbc-9c57-224f4e855583 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:28.241850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:28.328028 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a427f-411d-4cbc-9c57-224f4e855583 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:28.342108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389a099-4cdf-4b1e-9013-36e40029472f None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:28.366525 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e287fe7-e528-492c-ac5e-9a0c7dbd99b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:28.367235 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e287fe7-e528-492c-ac5e-9a0c7dbd99b8 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:28.367510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e287fe7-e528-492c-ac5e-9a0c7dbd99b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:28.367864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e287fe7-e528-492c-ac5e-9a0c7dbd99b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:28.380874 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e287fe7-e528-492c-ac5e-9a0c7dbd99b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:17:28.389850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-1e287fe7-e528-492c-ac5e-9a0c7dbd99b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:17:28.389850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:17:28.389850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:17:28.389850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:17:28.389850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:17:28.389850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:17:28.389850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:17:28.389850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:17:28.389850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:17:28.389850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:17:28.389850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:17:28.389850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:17:28.389850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:17:28.389850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:17:28.389850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:17:28.389850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:17:28.390779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:17:28.390779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:17:28.390779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:17:28.390779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:17:28.390779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:17:28.390779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:17:28.390779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:17:28.390779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:17:28.390779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:17:28.390779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:17:28.390779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:17:28.390779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:17:28.390779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:17:28.390779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:17:28.390779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:17:28.390779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:17:28.391658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:17:28.391658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:17:28.391658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:17:28.391658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:17:28.391658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:17:28.391658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:17:28.391658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:17:28.391658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:17:28.391658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:17:28.391658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:17:28.391658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:17:28.391658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:17:28.391658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 7/14] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:17:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:17:28.397703 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e287fe7-e528-492c-ac5e-9a0c7dbd99b8 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:28.448458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389a099-4cdf-4b1e-9013-36e40029472f None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:28.450819 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:28.483377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:28.485281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718cb47-a369-4180-9c53-027648f1d36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:28.486294 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718cb47-a369-4180-9c53-027648f1d36d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:28.486567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718cb47-a369-4180-9c53-027648f1d36d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:28.486837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718cb47-a369-4180-9c53-027648f1d36d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:28.502085 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e287fe7-e528-492c-ac5e-9a0c7dbd99b8 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:28.536659 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db68c89-ffab-45ed-9075-9670a581c20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:28.537266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db68c89-ffab-45ed-9075-9670a581c20a None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:28.537563 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db68c89-ffab-45ed-9075-9670a581c20a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:28.537824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db68c89-ffab-45ed-9075-9670a581c20a None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:28.538487 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db68c89-ffab-45ed-9075-9670a581c20a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:28.538784 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db68c89-ffab-45ed-9075-9670a581c20a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:28.540230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db68c89-ffab-45ed-9075-9670a581c20a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:28.552300 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 8/15] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:17:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:28.553601 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718cb47-a369-4180-9c53-027648f1d36d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:28.555165 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718cb47-a369-4180-9c53-027648f1d36d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:28.557980 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db68c89-ffab-45ed-9075-9670a581c20a None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:28.655146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 8/16] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:17:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 16:17:28.655784 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db68c89-ffab-45ed-9075-9670a581c20a None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:28.661076 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718cb47-a369-4180-9c53-027648f1d36d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:28.664050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:28.693081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd4dac-c4e9-48fe-99a0-8e751eae7f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:28.693720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd4dac-c4e9-48fe-99a0-8e751eae7f2f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:28.693992 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd4dac-c4e9-48fe-99a0-8e751eae7f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:28.694257 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd4dac-c4e9-48fe-99a0-8e751eae7f2f None admin] PATH_INFO: `/v3/users/f4a141c4b1594c35992b7b147f7c2904` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:28.695450 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd4dac-c4e9-48fe-99a0-8e751eae7f2f None admin] RBAC: Authorizing `identity:get_user(user_id=f4a141c4b1594c35992b7b147f7c2904)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:28.696903 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd4dac-c4e9-48fe-99a0-8e751eae7f2f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:28.698485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 9/17] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:17:28 2022] GET /identity/v3/users/f4a141c4b1594c35992b7b147f7c2904 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:17:28.704039 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd4dac-c4e9-48fe-99a0-8e751eae7f2f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:28.718810 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:28.760295 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718cb47-a369-4180-9c53-027648f1d36d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:28.799350 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233c4a2-69a4-4a1a-8d54-a842fffface7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:28.800167 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233c4a2-69a4-4a1a-8d54-a842fffface7 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:28.800493 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233c4a2-69a4-4a1a-8d54-a842fffface7 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:28.800692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233c4a2-69a4-4a1a-8d54-a842fffface7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:28.803933 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd4dac-c4e9-48fe-99a0-8e751eae7f2f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:28.819658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233c4a2-69a4-4a1a-8d54-a842fffface7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:28.821149 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233c4a2-69a4-4a1a-8d54-a842fffface7 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:28.839210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-7233c4a2-69a4-4a1a-8d54-a842fffface7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:17:28.839210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:17:28.839210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:17:28.839210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:17:28.839210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:17:28.839210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:17:28.839210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:17:28.839210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:17:28.839210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:17:28.839210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:17:28.839210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:17:28.839210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:17:28.839210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:17:28.839210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:17:28.839210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:17:28.839210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:17:28.840570 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:17:28.840570 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:17:28.840570 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:17:28.840570 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:17:28.840570 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:17:28.840570 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:17:28.840570 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:17:28.840570 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:17:28.840570 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:17:28.840570 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:17:28.840570 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:17:28.840570 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:17:28.840570 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:17:28.840570 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:17:28.840570 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:17:28.840570 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:17:28.840570 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:17:28.841403 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:17:28.841403 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:17:28.841403 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:17:28.841568 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ad84a-e953-41b0-ae04-a1e6fcbf3242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:28.841568 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ad84a-e953-41b0-ae04-a1e6fcbf3242 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:28.841568 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ad84a-e953-41b0-ae04-a1e6fcbf3242 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:28.841766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 9/18] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:17:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:17:28.841829 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ad84a-e953-41b0-ae04-a1e6fcbf3242 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:28.842213 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ad84a-e953-41b0-ae04-a1e6fcbf3242 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:28.843656 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ad84a-e953-41b0-ae04-a1e6fcbf3242 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:28.845213 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 10/19] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:17:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:17:28.846508 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233c4a2-69a4-4a1a-8d54-a842fffface7 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:28.851064 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ad84a-e953-41b0-ae04-a1e6fcbf3242 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:28.903372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:28.931455 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:28.949607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233c4a2-69a4-4a1a-8d54-a842fffface7 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:28.950568 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ad84a-e953-41b0-ae04-a1e6fcbf3242 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:28.982944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a77da7-0bb9-43a6-9fa4-38dbbfba38ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:28.983582 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a77da7-0bb9-43a6-9fa4-38dbbfba38ce None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:28.983859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a77da7-0bb9-43a6-9fa4-38dbbfba38ce None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:28.984081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b220153-e5f7-4bda-8192-be5a25dc795c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:28.984191 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a77da7-0bb9-43a6-9fa4-38dbbfba38ce None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:28.984687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b220153-e5f7-4bda-8192-be5a25dc795c None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:28.984787 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a77da7-0bb9-43a6-9fa4-38dbbfba38ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:28.984967 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b220153-e5f7-4bda-8192-be5a25dc795c None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:28.985066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a77da7-0bb9-43a6-9fa4-38dbbfba38ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:28.985240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b220153-e5f7-4bda-8192-be5a25dc795c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:28.985964 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b220153-e5f7-4bda-8192-be5a25dc795c None admin] RBAC: Adding query filter params (role.id=066f46534195417295e63a5316632eae, scope.domain.id=default, user.id=f4a141c4b1594c35992b7b147f7c2904) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:28.986265 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b220153-e5f7-4bda-8192-be5a25dc795c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:28.986393 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a77da7-0bb9-43a6-9fa4-38dbbfba38ce None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:28.987733 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b220153-e5f7-4bda-8192-be5a25dc795c None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:28.994436 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 11/20] 10.222.0.55 () {56 vars in 1322 bytes} [Tue Oct 4 16:17:28 2022] GET /identity/v3/role_assignments?user.id=f4a141c4b1594c35992b7b147f7c2904&scope.domain.id=default&role.id=066f46534195417295e63a5316632eae => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:29.004242 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 10/21] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:31.311925 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3861d-4d39-46ee-8655-2a87fc12e1c3 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:31.312930 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3861d-4d39-46ee-8655-2a87fc12e1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:31.313427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3861d-4d39-46ee-8655-2a87fc12e1c3 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:31.315003 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 12/22] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:17:31.320545 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ff2be-8c90-43f3-8a1b-37f96120be9e None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:31.321457 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ff2be-8c90-43f3-8a1b-37f96120be9e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:31.321926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ff2be-8c90-43f3-8a1b-37f96120be9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:31.352113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-744ff2be-8c90-43f3-8a1b-37f96120be9e None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:31.353705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-744ff2be-8c90-43f3-8a1b-37f96120be9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:31.449929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 11/23] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:17:31.694848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618a85c-4bca-487a-bdcf-980e58c7cfc6 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:31.695201 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618a85c-4bca-487a-bdcf-980e58c7cfc6 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:31.695431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618a85c-4bca-487a-bdcf-980e58c7cfc6 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:31.696937 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 13/24] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:17:31.702649 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210692f3-b21f-419f-b336-602f10cf9c42 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:31.703235 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210692f3-b21f-419f-b336-602f10cf9c42 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:31.703705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210692f3-b21f-419f-b336-602f10cf9c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:31.722633 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-210692f3-b21f-419f-b336-602f10cf9c42 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:31.724170 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-210692f3-b21f-419f-b336-602f10cf9c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:31.775189 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:31.808260 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 12/25] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:17:31.953317 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618a85c-4bca-487a-bdcf-980e58c7cfc6 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:32.073444 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7660fb5-ae14-42c6-8312-63d5cb264f0a None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:32.074244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7660fb5-ae14-42c6-8312-63d5cb264f0a None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:32.074880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7660fb5-ae14-42c6-8312-63d5cb264f0a None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:32.076666 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 13/26] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:17:32.082623 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ffce9-d926-43b7-b8bf-7c9e13e7f0ad None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:32.083252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ffce9-d926-43b7-b8bf-7c9e13e7f0ad None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:32.083789 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ffce9-d926-43b7-b8bf-7c9e13e7f0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:32.108859 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618a85c-4bca-487a-bdcf-980e58c7cfc6 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:32.113633 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-791ffce9-d926-43b7-b8bf-7c9e13e7f0ad None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:32.115074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-791ffce9-d926-43b7-b8bf-7c9e13e7f0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:32.179133 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae94ef-8937-41bc-8ef8-cdad6e8c7ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:32.180055 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae94ef-8937-41bc-8ef8-cdad6e8c7ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:32.180481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae94ef-8937-41bc-8ef8-cdad6e8c7ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:32.180901 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae94ef-8937-41bc-8ef8-cdad6e8c7ce9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:32.215705 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae94ef-8937-41bc-8ef8-cdad6e8c7ce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:17:32.220906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-c8ae94ef-8937-41bc-8ef8-cdad6e8c7ce9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:17:32.220906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:17:32.220906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:17:32.220906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:17:32.220906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:17:32.220906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:17:32.220906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:17:32.220906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:17:32.220906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:17:32.220906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:17:32.220906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:17:32.220906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:17:32.220906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:17:32.220906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:17:32.220906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:17:32.220906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:17:32.221907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:17:32.221907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:17:32.221907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:17:32.221907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:17:32.221907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:17:32.221907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:17:32.221907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:17:32.221907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:17:32.221907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:17:32.221907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:17:32.221907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:17:32.221907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:17:32.221907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:17:32.221907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:17:32.221907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:17:32.221907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:17:32.222871 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:17:32.222871 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:17:32.222871 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:17:32.222871 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:17:32.222871 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:17:32.222871 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:17:32.222871 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:17:32.222871 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:17:32.222871 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:17:32.222871 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:17:32.222871 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:17:32.222871 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:17:32.224825 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 14/27] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:17:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:17:32.230162 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 14/28] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:17:32.231542 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ffce9-d926-43b7-b8bf-7c9e13e7f0ad None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:32.255675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f8c33-4044-4b7f-90e9-f98f47507651 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:32.256208 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f8c33-4044-4b7f-90e9-f98f47507651 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:32.256639 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f8c33-4044-4b7f-90e9-f98f47507651 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:32.258713 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 15/29] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:17:32.263985 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f8c33-4044-4b7f-90e9-f98f47507651 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:32.277691 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:32.349879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ffce9-d926-43b7-b8bf-7c9e13e7f0ad None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:32.357996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:32.389314 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c99e2-f91b-4b8e-b409-eb54ecf8bcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:32.389943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c99e2-f91b-4b8e-b409-eb54ecf8bcda None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:32.390221 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c99e2-f91b-4b8e-b409-eb54ecf8bcda None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:32.390487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c99e2-f91b-4b8e-b409-eb54ecf8bcda None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:32.391187 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c99e2-f91b-4b8e-b409-eb54ecf8bcda None admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:32.391488 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c99e2-f91b-4b8e-b409-eb54ecf8bcda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:32.392885 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c99e2-f91b-4b8e-b409-eb54ecf8bcda None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:32.419042 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 15/30] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:17:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:32.422438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b2521-9b90-4c89-a306-a67e0e044273 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:32.422721 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b2521-9b90-4c89-a306-a67e0e044273 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:32.423007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b2521-9b90-4c89-a306-a67e0e044273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:32.456701 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-9c4b2521-9b90-4c89-a306-a67e0e044273 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:32.457923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-9c4b2521-9b90-4c89-a306-a67e0e044273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:32.477542 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f8c33-4044-4b7f-90e9-f98f47507651 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:32.532549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68ef34-725f-45f8-833d-74f9055b1fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:32.533652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68ef34-725f-45f8-833d-74f9055b1fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:32.534146 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68ef34-725f-45f8-833d-74f9055b1fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:32.534721 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68ef34-725f-45f8-833d-74f9055b1fe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:32.558049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68ef34-725f-45f8-833d-74f9055b1fe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:32.560068 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68ef34-725f-45f8-833d-74f9055b1fe0 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:32.591696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-4d68ef34-725f-45f8-833d-74f9055b1fe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:17:32.591696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:17:32.591696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:17:32.591696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:17:32.591696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:17:32.591696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:17:32.591696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:17:32.591696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:17:32.591696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:17:32.591696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:17:32.591696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:17:32.591696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:17:32.591696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:17:32.591696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:17:32.591696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:17:32.591696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:17:32.592610 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:17:32.592610 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:17:32.592610 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:17:32.592610 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:17:32.592610 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:17:32.592610 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:17:32.592610 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:17:32.592610 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:17:32.592610 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:17:32.592610 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:17:32.592610 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:17:32.592610 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:17:32.592610 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:17:32.592610 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:17:32.592610 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:17:32.592610 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:17:32.592610 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:17:32.593422 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:17:32.593422 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:17:32.593422 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:17:32.595014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 16/31] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:17:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:17:32.595659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 16/32] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:17:32.596169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68ef34-725f-45f8-833d-74f9055b1fe0 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:32.604047 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b2521-9b90-4c89-a306-a67e0e044273 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:32.667273 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:32.723137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68ef34-725f-45f8-833d-74f9055b1fe0 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:32.794172 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2593708-b0eb-4dcd-8f30-ee281e0d8be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:32.795502 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2593708-b0eb-4dcd-8f30-ee281e0d8be0 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:32.797935 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2593708-b0eb-4dcd-8f30-ee281e0d8be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:32.798388 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2593708-b0eb-4dcd-8f30-ee281e0d8be0 None admin] PATH_INFO: `/v3/users/f4a141c4b1594c35992b7b147f7c2904` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:32.801028 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2593708-b0eb-4dcd-8f30-ee281e0d8be0 None admin] RBAC: Authorizing `identity:get_user(user_id=f4a141c4b1594c35992b7b147f7c2904)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:32.801583 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:32.804988 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2593708-b0eb-4dcd-8f30-ee281e0d8be0 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:32.810866 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 17/33] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:17:32 2022] GET /identity/v3/users/f4a141c4b1594c35992b7b147f7c2904 => generated 247 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:32.811900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b2521-9b90-4c89-a306-a67e0e044273 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:32.814422 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2593708-b0eb-4dcd-8f30-ee281e0d8be0 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:32.882101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd5b07-2ca9-42f0-8d12-fcd6d04fd080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:32.887510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd5b07-2ca9-42f0-8d12-fcd6d04fd080 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:32.888057 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd5b07-2ca9-42f0-8d12-fcd6d04fd080 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:32.888501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd5b07-2ca9-42f0-8d12-fcd6d04fd080 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:32.889360 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd5b07-2ca9-42f0-8d12-fcd6d04fd080 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:32.891515 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd5b07-2ca9-42f0-8d12-fcd6d04fd080 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:32.994868 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2593708-b0eb-4dcd-8f30-ee281e0d8be0 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:33.022639 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:33.042753 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fedf51-063f-4bb0-92fa-9e95584ee31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:33.044123 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fedf51-063f-4bb0-92fa-9e95584ee31c None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:33.044592 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fedf51-063f-4bb0-92fa-9e95584ee31c None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:33.045442 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fedf51-063f-4bb0-92fa-9e95584ee31c None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:33.046261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fedf51-063f-4bb0-92fa-9e95584ee31c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:33.046701 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fedf51-063f-4bb0-92fa-9e95584ee31c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:33.048294 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fedf51-063f-4bb0-92fa-9e95584ee31c None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:33.068510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 18/34] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:33.074428 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fedf51-063f-4bb0-92fa-9e95584ee31c None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:33.076171 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 17/35] 10.222.0.55 () {60 vars in 1131 bytes} [Tue Oct 4 16:17:32 2022] POST /identity/v3/roles => generated 225 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:17:33.077286 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd5b07-2ca9-42f0-8d12-fcd6d04fd080 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:33.209024 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fedf51-063f-4bb0-92fa-9e95584ee31c None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:33.217411 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd5b07-2ca9-42f0-8d12-fcd6d04fd080 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:33.252547 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a21f17-637d-4bc7-8a6d-c10353480be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:33.253555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a21f17-637d-4bc7-8a6d-c10353480be2 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:33.253738 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a21f17-637d-4bc7-8a6d-c10353480be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:33.254106 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a21f17-637d-4bc7-8a6d-c10353480be2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:33.255761 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a21f17-637d-4bc7-8a6d-c10353480be2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:33.257244 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a21f17-637d-4bc7-8a6d-c10353480be2 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:33.259548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 19/36] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:17:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:33.260327 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a21f17-637d-4bc7-8a6d-c10353480be2 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:33.262776 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee2194-cd25-44ea-a338-388f29717fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:33.263641 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee2194-cd25-44ea-a338-388f29717fbf None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:33.264233 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee2194-cd25-44ea-a338-388f29717fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:33.264701 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee2194-cd25-44ea-a338-388f29717fbf None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:33.265589 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee2194-cd25-44ea-a338-388f29717fbf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:33.267520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee2194-cd25-44ea-a338-388f29717fbf None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:33.290190 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 18/37] 10.222.0.55 () {60 vars in 1131 bytes} [Tue Oct 4 16:17:33 2022] POST /identity/v3/roles => generated 219 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:17:33.292060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18108d-ebd3-422d-9697-ccb0a91ebd98 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:33.292357 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18108d-ebd3-422d-9697-ccb0a91ebd98 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:33.292719 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18108d-ebd3-422d-9697-ccb0a91ebd98 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:33.294267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 19/38] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:17:33.306359 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18108d-ebd3-422d-9697-ccb0a91ebd98 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:33.323167 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:33.355493 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:33.381583 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a21f17-637d-4bc7-8a6d-c10353480be2 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:33.419819 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3f6ff-4893-4844-9d80-16e95a9b3857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:33.420853 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3f6ff-4893-4844-9d80-16e95a9b3857 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:33.421131 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3f6ff-4893-4844-9d80-16e95a9b3857 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:33.421399 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3f6ff-4893-4844-9d80-16e95a9b3857 None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:33.422078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3f6ff-4893-4844-9d80-16e95a9b3857 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:33.423622 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3f6ff-4893-4844-9d80-16e95a9b3857 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:33.454560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18108d-ebd3-422d-9697-ccb0a91ebd98 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:33.496597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dee193-ae4f-435d-bd80-f2da8e6a85bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:33.497708 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dee193-ae4f-435d-bd80-f2da8e6a85bd None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:33.498208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dee193-ae4f-435d-bd80-f2da8e6a85bd None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:33.498682 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dee193-ae4f-435d-bd80-f2da8e6a85bd None admin] PATH_INFO: `/v3/domains/default/users/f4a141c4b1594c35992b7b147f7c2904/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:33.501520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dee193-ae4f-435d-bd80-f2da8e6a85bd None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f4a141c4b1594c35992b7b147f7c2904, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:33.503428 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dee193-ae4f-435d-bd80-f2da8e6a85bd None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:33.524628 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 20/39] 10.222.0.55 () {58 vars in 1361 bytes} [Tue Oct 4 16:17:33 2022] PUT /identity/v3/domains/default/users/f4a141c4b1594c35992b7b147f7c2904/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:17:33.526350 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dfc51-c9c0-48f3-9133-c9306ee450d1 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:33.526845 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dfc51-c9c0-48f3-9133-c9306ee450d1 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:33.527437 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dfc51-c9c0-48f3-9133-c9306ee450d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:33.560099 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-ee3dfc51-c9c0-48f3-9133-c9306ee450d1 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:33.562220 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ee3dfc51-c9c0-48f3-9133-c9306ee450d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:33.668946 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 21/40] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:17:33.669159 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd7061-3921-4a13-9bb1-77aa9f27fce0 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:33.669686 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd7061-3921-4a13-9bb1-77aa9f27fce0 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:33.669816 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd7061-3921-4a13-9bb1-77aa9f27fce0 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:33.675093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 22/41] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:17:33.677991 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f97546-b061-453e-9087-bf7cce139565 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:33.678280 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f97546-b061-453e-9087-bf7cce139565 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:33.678557 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f97546-b061-453e-9087-bf7cce139565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:33.698679 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-28f97546-b061-453e-9087-bf7cce139565 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:33.700022 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-28f97546-b061-453e-9087-bf7cce139565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:33.702311 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:33.703816 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 20/42] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Oct 4 16:17:33 2022] POST /identity/v3/projects => generated 301 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:17:33.786293 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 23/43] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 16:17:33.951916 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3f6ff-4893-4844-9d80-16e95a9b3857 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:34.055995 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f97546-b061-453e-9087-bf7cce139565 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:34.058970 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3f6ff-4893-4844-9d80-16e95a9b3857 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:34.061477 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:34.099137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4ca3f-6d2c-45a9-ae6c-49bb4cb99fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:34.099762 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4ca3f-6d2c-45a9-ae6c-49bb4cb99fac None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:34.100037 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4ca3f-6d2c-45a9-ae6c-49bb4cb99fac None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:34.100301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4ca3f-6d2c-45a9-ae6c-49bb4cb99fac None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:34.100979 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4ca3f-6d2c-45a9-ae6c-49bb4cb99fac None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:34.102496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4ca3f-6d2c-45a9-ae6c-49bb4cb99fac None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:34.118947 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 21/44] 10.222.0.55 () {60 vars in 1131 bytes} [Tue Oct 4 16:17:33 2022] POST /identity/v3/roles => generated 223 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:17:34.166846 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f97546-b061-453e-9087-bf7cce139565 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:34.220390 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526c9c1-7e1e-4bba-8235-09322b6d8dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:34.221097 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526c9c1-7e1e-4bba-8235-09322b6d8dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:34.221450 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526c9c1-7e1e-4bba-8235-09322b6d8dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:34.221728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526c9c1-7e1e-4bba-8235-09322b6d8dc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:34.223194 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526c9c1-7e1e-4bba-8235-09322b6d8dc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:34.224726 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526c9c1-7e1e-4bba-8235-09322b6d8dc2 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:34.226606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 24/45] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:17:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:17:34.232581 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4ca3f-6d2c-45a9-ae6c-49bb4cb99fac None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:34.359093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4ca3f-6d2c-45a9-ae6c-49bb4cb99fac None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:34.397684 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7676088-d804-4703-a695-3c7b216acb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:34.398328 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7676088-d804-4703-a695-3c7b216acb70 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:34.398618 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7676088-d804-4703-a695-3c7b216acb70 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:34.398884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7676088-d804-4703-a695-3c7b216acb70 None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:34.399603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7676088-d804-4703-a695-3c7b216acb70 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:34.401074 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7676088-d804-4703-a695-3c7b216acb70 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:34.433768 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 22/46] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Oct 4 16:17:34 2022] POST /identity/v3/projects => generated 312 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:17:35.769054 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8820e-f7b3-4b74-afc8-f26a191f0d13 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:35.769566 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8820e-f7b3-4b74-afc8-f26a191f0d13 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:35.769649 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8820e-f7b3-4b74-afc8-f26a191f0d13 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:35.771014 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 25/47] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:17:35.776670 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab9620-caf5-4958-8aca-7b153fa5ce25 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:35.777038 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab9620-caf5-4958-8aca-7b153fa5ce25 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:35.777226 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab9620-caf5-4958-8aca-7b153fa5ce25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:35.796969 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-abab9620-caf5-4958-8aca-7b153fa5ce25 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:35.798838 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-abab9620-caf5-4958-8aca-7b153fa5ce25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:35.810017 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:35.868356 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 23/48] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:17:36.134183 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8820e-f7b3-4b74-afc8-f26a191f0d13 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:36.143737 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:36.250344 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8820e-f7b3-4b74-afc8-f26a191f0d13 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:36.283832 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd66b7-188e-4dfb-a278-f64c238b7564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:36.284463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd66b7-188e-4dfb-a278-f64c238b7564 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:36.284747 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd66b7-188e-4dfb-a278-f64c238b7564 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:36.285008 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd66b7-188e-4dfb-a278-f64c238b7564 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:36.297280 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd66b7-188e-4dfb-a278-f64c238b7564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:17:36.303267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-38bd66b7-188e-4dfb-a278-f64c238b7564 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:17:36.303267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:17:36.303267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:17:36.303267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:17:36.303267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:17:36.303267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:17:36.303267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:17:36.303267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:17:36.303267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:17:36.303267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:17:36.303267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:17:36.303267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:17:36.303267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:17:36.303267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:17:36.303267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:17:36.303267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:17:36.304245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:17:36.304245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:17:36.304245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:17:36.304245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:17:36.304245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:17:36.304245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:17:36.304245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:17:36.304245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:17:36.304245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:17:36.304245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:17:36.304245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:17:36.304245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:17:36.304245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:17:36.304245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:17:36.304245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:17:36.304245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:17:36.305006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:17:36.305006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:17:36.305006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:17:36.305006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:17:36.305006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:17:36.305006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:17:36.305006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:17:36.305006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:17:36.305006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:17:36.305006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:17:36.305006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:17:36.305006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:17:36.305006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 26/49] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:17:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:17:36.311953 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab9620-caf5-4958-8aca-7b153fa5ce25 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:36.412540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab9620-caf5-4958-8aca-7b153fa5ce25 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:36.447555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305ff79-4745-450b-bbaa-4ed45aaae53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:36.448140 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305ff79-4745-450b-bbaa-4ed45aaae53d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:36.448442 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305ff79-4745-450b-bbaa-4ed45aaae53d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:36.448714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305ff79-4745-450b-bbaa-4ed45aaae53d None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:36.449414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305ff79-4745-450b-bbaa-4ed45aaae53d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:36.449774 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305ff79-4745-450b-bbaa-4ed45aaae53d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:36.451217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305ff79-4745-450b-bbaa-4ed45aaae53d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:36.459575 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 24/50] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:17:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:36.465747 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd66b7-188e-4dfb-a278-f64c238b7564 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:36.536015 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:36.576408 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd66b7-188e-4dfb-a278-f64c238b7564 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:36.606557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a876e9b-7c4e-47e0-9ea0-96d797caf80d None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:36.606839 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a876e9b-7c4e-47e0-9ea0-96d797caf80d None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:36.607144 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a876e9b-7c4e-47e0-9ea0-96d797caf80d None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:36.608958 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 25/51] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:17:36.612625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4761c-b681-4ea3-af80-4eedd2c0a9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:36.613270 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4761c-b681-4ea3-af80-4eedd2c0a9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:36.613546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4761c-b681-4ea3-af80-4eedd2c0a9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:36.613672 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3614a4-9511-46a3-8ae3-afac1d0ef593 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:36.613821 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4761c-b681-4ea3-af80-4eedd2c0a9f2 None admin] PATH_INFO: `/v3/users/f4a141c4b1594c35992b7b147f7c2904` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:36.613959 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3614a4-9511-46a3-8ae3-afac1d0ef593 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:36.614230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3614a4-9511-46a3-8ae3-afac1d0ef593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:36.615040 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4761c-b681-4ea3-af80-4eedd2c0a9f2 None admin] RBAC: Authorizing `identity:get_user(user_id=f4a141c4b1594c35992b7b147f7c2904)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:36.616486 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4761c-b681-4ea3-af80-4eedd2c0a9f2 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:36.618074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 27/52] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:17:36 2022] GET /identity/v3/users/f4a141c4b1594c35992b7b147f7c2904 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:36.623491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4761c-b681-4ea3-af80-4eedd2c0a9f2 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:36.633991 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-3b3614a4-9511-46a3-8ae3-afac1d0ef593 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:36.635305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-3b3614a4-9511-46a3-8ae3-afac1d0ef593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:36.637620 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:36.714026 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 26/53] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 16:17:36.833356 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4761c-b681-4ea3-af80-4eedd2c0a9f2 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:36.867577 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2b3f3-c804-4f2a-810b-2f6e4f0f30e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:36.868203 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2b3f3-c804-4f2a-810b-2f6e4f0f30e7 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:36.868489 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2b3f3-c804-4f2a-810b-2f6e4f0f30e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:36.868762 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2b3f3-c804-4f2a-810b-2f6e4f0f30e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:36.869923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2b3f3-c804-4f2a-810b-2f6e4f0f30e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:36.871464 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2b3f3-c804-4f2a-810b-2f6e4f0f30e7 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:36.873312 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 28/54] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:17:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:17:36.879166 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3614a4-9511-46a3-8ae3-afac1d0ef593 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:36.984718 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2b3f3-c804-4f2a-810b-2f6e4f0f30e7 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:36.987798 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:36.989651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3614a4-9511-46a3-8ae3-afac1d0ef593 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:37.025384 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d342426-8718-4897-bc08-6aa07e30355e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:37.026010 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d342426-8718-4897-bc08-6aa07e30355e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:37.026292 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d342426-8718-4897-bc08-6aa07e30355e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:37.026575 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d342426-8718-4897-bc08-6aa07e30355e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:37.027336 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d342426-8718-4897-bc08-6aa07e30355e None admin] RBAC: Adding query filter params (role.id=066f46534195417295e63a5316632eae, scope.domain.id=default, user.id=f4a141c4b1594c35992b7b147f7c2904) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:37.027667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d342426-8718-4897-bc08-6aa07e30355e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:37.029124 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d342426-8718-4897-bc08-6aa07e30355e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:37.035732 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 27/55] 10.222.0.55 () {56 vars in 1322 bytes} [Tue Oct 4 16:17:36 2022] GET /identity/v3/role_assignments?user.id=f4a141c4b1594c35992b7b147f7c2904&scope.domain.id=default&role.id=066f46534195417295e63a5316632eae => generated 530 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:37.094198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2b3f3-c804-4f2a-810b-2f6e4f0f30e7 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:37.136313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01f9f3-2e08-4d73-a0fb-bd17245a7d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:37.136979 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01f9f3-2e08-4d73-a0fb-bd17245a7d52 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:37.137261 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01f9f3-2e08-4d73-a0fb-bd17245a7d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:37.137536 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01f9f3-2e08-4d73-a0fb-bd17245a7d52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:37.138709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01f9f3-2e08-4d73-a0fb-bd17245a7d52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:37.140242 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01f9f3-2e08-4d73-a0fb-bd17245a7d52 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:37.141873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 29/56] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:17:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:37.147912 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d342426-8718-4897-bc08-6aa07e30355e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:37.151156 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:37.259161 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d342426-8718-4897-bc08-6aa07e30355e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:37.297415 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c99d84-e739-4d5d-b905-0180dde84247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:37.298029 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c99d84-e739-4d5d-b905-0180dde84247 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:37.298312 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c99d84-e739-4d5d-b905-0180dde84247 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:37.298587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c99d84-e739-4d5d-b905-0180dde84247 None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:37.299424 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c99d84-e739-4d5d-b905-0180dde84247 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:37.300886 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c99d84-e739-4d5d-b905-0180dde84247 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:37.330741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 28/57] 10.222.0.55 () {60 vars in 1140 bytes} [Tue Oct 4 16:17:37 2022] POST /identity/v3/projects => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:17:39.501405 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533813b8-2f3e-42c9-b5d3-40690e3679fe None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:39.501948 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533813b8-2f3e-42c9-b5d3-40690e3679fe None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:39.501948 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533813b8-2f3e-42c9-b5d3-40690e3679fe None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:39.503376 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 30/58] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:17:39.508796 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376d6f5-0722-482a-a580-a8b88fdb8e53 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:39.509243 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376d6f5-0722-482a-a580-a8b88fdb8e53 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:39.509404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376d6f5-0722-482a-a580-a8b88fdb8e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:39.529742 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-a376d6f5-0722-482a-a580-a8b88fdb8e53 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:39.531005 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a376d6f5-0722-482a-a580-a8b88fdb8e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:39.596397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:39.621907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 29/59] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:17:39.888726 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533813b8-2f3e-42c9-b5d3-40690e3679fe None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:39.979333 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:40.012220 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533813b8-2f3e-42c9-b5d3-40690e3679fe None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:40.046526 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c783b-8008-4766-80d6-26ae5b882ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:40.047182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c783b-8008-4766-80d6-26ae5b882ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:40.047462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c783b-8008-4766-80d6-26ae5b882ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:40.047734 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c783b-8008-4766-80d6-26ae5b882ec4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:40.048873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c783b-8008-4766-80d6-26ae5b882ec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:40.050330 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c783b-8008-4766-80d6-26ae5b882ec4 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:40.051971 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 31/60] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:17:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:40.058366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376d6f5-0722-482a-a580-a8b88fdb8e53 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:40.167756 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376d6f5-0722-482a-a580-a8b88fdb8e53 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:40.203118 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38abc77a-38e5-4577-9ead-deddf202689f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:40.203716 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abc77a-38e5-4577-9ead-deddf202689f None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:40.203989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abc77a-38e5-4577-9ead-deddf202689f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:40.204261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abc77a-38e5-4577-9ead-deddf202689f None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:40.204905 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38abc77a-38e5-4577-9ead-deddf202689f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:40.206485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38abc77a-38e5-4577-9ead-deddf202689f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:40.235501 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 30/61] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Oct 4 16:17:40 2022] POST /identity/v3/users => generated 275 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:17:43.666263 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a67c89-fccf-41d0-878f-35efda300296 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:43.667176 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a67c89-fccf-41d0-878f-35efda300296 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:43.667587 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a67c89-fccf-41d0-878f-35efda300296 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:43.669168 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 32/62] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:17:43.675338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989cb3f-3d75-4b97-b987-0596f264d17a None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:43.675787 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989cb3f-3d75-4b97-b987-0596f264d17a None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:43.675880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989cb3f-3d75-4b97-b987-0596f264d17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:43.704016 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-c989cb3f-3d75-4b97-b987-0596f264d17a None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:43.705587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c989cb3f-3d75-4b97-b987-0596f264d17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:43.718796 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b183d3-43b7-4709-abe1-87ecfe146e3a None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:43.719432 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b183d3-43b7-4709-abe1-87ecfe146e3a None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:43.719909 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b183d3-43b7-4709-abe1-87ecfe146e3a None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:43.721446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 33/63] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:17:43.726603 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e34f3-cead-4c03-ac5a-1c3b20bf5aec None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:43.726882 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e34f3-cead-4c03-ac5a-1c3b20bf5aec None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:43.727187 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e34f3-cead-4c03-ac5a-1c3b20bf5aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:43.753287 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-029e34f3-cead-4c03-ac5a-1c3b20bf5aec None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:43.754530 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-029e34f3-cead-4c03-ac5a-1c3b20bf5aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:43.778973 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:43.837942 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 31/64] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:17:43.869535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 34/65] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 16:17:44.174725 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbeb42-d9c4-4ec1-b795-ef7f7f31dd0b None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:44.174909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbeb42-d9c4-4ec1-b795-ef7f7f31dd0b None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:44.175209 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbeb42-d9c4-4ec1-b795-ef7f7f31dd0b None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:44.176589 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 32/66] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:17:44.189093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccbdaa-88e2-4ff8-865f-0dc9b5f73c48 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:44.189378 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccbdaa-88e2-4ff8-865f-0dc9b5f73c48 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:44.189747 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccbdaa-88e2-4ff8-865f-0dc9b5f73c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:44.196924 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbeb42-d9c4-4ec1-b795-ef7f7f31dd0b None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:44.210304 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-d5ccbdaa-88e2-4ff8-865f-0dc9b5f73c48 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:44.211834 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-d5ccbdaa-88e2-4ff8-865f-0dc9b5f73c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:44.296360 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:44.306615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 35/67] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:17:44.307987 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbe1db-9855-48e2-91e1-7e6f2eea69b1 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:44.308272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbe1db-9855-48e2-91e1-7e6f2eea69b1 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:44.308601 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbe1db-9855-48e2-91e1-7e6f2eea69b1 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:44.313995 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 36/68] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:17:44.313995 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bbe1db-9855-48e2-91e1-7e6f2eea69b1 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:44.335694 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbeb42-d9c4-4ec1-b795-ef7f7f31dd0b None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:44.371208 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f849798-7db0-44de-ad19-58f1984ffd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:44.372048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f849798-7db0-44de-ad19-58f1984ffd3e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:44.372152 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f849798-7db0-44de-ad19-58f1984ffd3e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:44.372386 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f849798-7db0-44de-ad19-58f1984ffd3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:44.383074 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f849798-7db0-44de-ad19-58f1984ffd3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:17:44.388018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-9f849798-7db0-44de-ad19-58f1984ffd3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:17:44.388018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:17:44.388018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:17:44.388018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:17:44.388018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:17:44.388018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:17:44.388018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:17:44.388018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:17:44.388018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:17:44.388018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:17:44.388018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:17:44.388018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:17:44.388018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:17:44.388018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:17:44.388018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:17:44.388018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:17:44.388864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:17:44.388864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:17:44.388864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:17:44.388864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:17:44.388864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:17:44.388864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:17:44.388864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:17:44.388864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:17:44.388864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:17:44.388864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:17:44.388864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:17:44.388864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:17:44.388864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:17:44.388864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:17:44.388864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:17:44.388864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:17:44.391781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:17:44.391781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:17:44.391781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:17:44.391781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:17:44.391781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:17:44.391781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:17:44.391781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:17:44.391781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:17:44.391781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:17:44.391781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:17:44.391781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:17:44.391781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:17:44.391781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 33/69] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:17:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:17:44.391781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31796401-c6ce-4ae7-9356-e76f81a6a58d None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:44.392459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31796401-c6ce-4ae7-9356-e76f81a6a58d None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:44.392459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31796401-c6ce-4ae7-9356-e76f81a6a58d None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:44.392903 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 34/70] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:17:44.395197 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2aaa9-179f-4828-a368-5009c806fb93 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:44.395618 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2aaa9-179f-4828-a368-5009c806fb93 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:44.395889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2aaa9-179f-4828-a368-5009c806fb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:44.413539 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-5bc2aaa9-179f-4828-a368-5009c806fb93 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:44.414722 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-5bc2aaa9-179f-4828-a368-5009c806fb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:44.424984 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bbe1db-9855-48e2-91e1-7e6f2eea69b1 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:44.438905 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:44.462023 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd1b03-d33e-4fde-9676-d18fc271d0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:44.462847 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd1b03-d33e-4fde-9676-d18fc271d0c7 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:44.463591 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd1b03-d33e-4fde-9676-d18fc271d0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:44.463999 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd1b03-d33e-4fde-9676-d18fc271d0c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:44.477240 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd1b03-d33e-4fde-9676-d18fc271d0c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:17:44.483814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-04fd1b03-d33e-4fde-9676-d18fc271d0c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:17:44.483814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:17:44.483814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:17:44.483814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:17:44.483814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:17:44.483814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:17:44.483814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:17:44.483814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:17:44.483814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:17:44.483814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:17:44.483814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:17:44.483814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:17:44.483814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:17:44.483814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:17:44.483814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:17:44.483814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:17:44.484647 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:17:44.484647 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:17:44.484647 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:17:44.484647 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:17:44.484647 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:17:44.484647 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:17:44.484647 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:17:44.484647 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:17:44.484647 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:17:44.484647 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:17:44.484647 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:17:44.484647 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:17:44.484647 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:17:44.484647 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:17:44.484647 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:17:44.484647 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:17:44.485457 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:17:44.485457 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:17:44.485457 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:17:44.485457 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:17:44.485457 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:17:44.485457 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:17:44.485457 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:17:44.485457 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:17:44.485457 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:17:44.485457 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:17:44.485457 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:17:44.485457 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:17:44.485457 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 37/71] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:17:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:17:44.486082 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 35/72] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:17:44.486836 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd1b03-d33e-4fde-9676-d18fc271d0c7 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:44.492571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcf23e-cc1d-4ae3-b8f3-6f3e156e9ba4 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:44.492861 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcf23e-cc1d-4ae3-b8f3-6f3e156e9ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:44.493136 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcf23e-cc1d-4ae3-b8f3-6f3e156e9ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:44.515289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-82dcf23e-cc1d-4ae3-b8f3-6f3e156e9ba4 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:44.516956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-82dcf23e-cc1d-4ae3-b8f3-6f3e156e9ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:44.555693 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:44.593765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 36/73] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:17:44.594631 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcf23e-cc1d-4ae3-b8f3-6f3e156e9ba4 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:44.614207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd1b03-d33e-4fde-9676-d18fc271d0c7 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:44.652835 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e08936-c7d5-4f5a-9e7c-1ae056cb3e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:44.653782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e08936-c7d5-4f5a-9e7c-1ae056cb3e40 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:44.654381 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e08936-c7d5-4f5a-9e7c-1ae056cb3e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:44.655231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e08936-c7d5-4f5a-9e7c-1ae056cb3e40 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:44.656332 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e08936-c7d5-4f5a-9e7c-1ae056cb3e40 None admin] RBAC: Adding query filter params (name=member) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:44.656831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e08936-c7d5-4f5a-9e7c-1ae056cb3e40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:44.658400 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e08936-c7d5-4f5a-9e7c-1ae056cb3e40 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:44.668315 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 38/74] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:17:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:44.669860 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e08936-c7d5-4f5a-9e7c-1ae056cb3e40 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:44.704123 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:44.715134 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcf23e-cc1d-4ae3-b8f3-6f3e156e9ba4 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:44.756907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87f75a-d6cf-4016-9d0c-4af16f4aa71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:44.757583 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87f75a-d6cf-4016-9d0c-4af16f4aa71a None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:44.758041 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87f75a-d6cf-4016-9d0c-4af16f4aa71a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:44.758697 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87f75a-d6cf-4016-9d0c-4af16f4aa71a None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:44.760429 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87f75a-d6cf-4016-9d0c-4af16f4aa71a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:44.760884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87f75a-d6cf-4016-9d0c-4af16f4aa71a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:44.762470 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87f75a-d6cf-4016-9d0c-4af16f4aa71a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:44.774129 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 37/75] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:17:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:44.774129 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87f75a-d6cf-4016-9d0c-4af16f4aa71a None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:44.795768 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e08936-c7d5-4f5a-9e7c-1ae056cb3e40 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:44.816907 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:44.832271 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593e371-9efb-447f-9419-b7e97a0cf71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:44.832916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593e371-9efb-447f-9419-b7e97a0cf71e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:44.833194 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593e371-9efb-447f-9419-b7e97a0cf71e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:44.833458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593e371-9efb-447f-9419-b7e97a0cf71e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:44.844431 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593e371-9efb-447f-9419-b7e97a0cf71e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:17:44.849826 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-f593e371-9efb-447f-9419-b7e97a0cf71e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 16:17:44.849826 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:17:44.849826 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:17:44.849826 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:17:44.849826 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:17:44.849826 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:17:44.849826 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:17:44.849826 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:17:44.849826 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:17:44.849826 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:17:44.849826 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:17:44.849826 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:17:44.849826 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:17:44.849826 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:17:44.849826 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:17:44.849826 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:17:44.850675 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:17:44.850675 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:17:44.850675 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:17:44.850675 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:17:44.850675 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:17:44.850675 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:17:44.850675 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:17:44.850675 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:17:44.850675 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:17:44.850675 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:17:44.850675 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:17:44.850675 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:17:44.850675 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:17:44.850675 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:17:44.850675 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:17:44.850675 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:17:44.851895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:17:44.851895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:17:44.851895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:17:44.851895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:17:44.851895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:17:44.851895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:17:44.851895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:17:44.851895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:17:44.851895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:17:44.851895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:17:44.851895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 16:17:44.851895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:17:44.851895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 39/76] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Oct 4 16:17:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:17:44.856593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593e371-9efb-447f-9419-b7e97a0cf71e None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:44.881972 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87f75a-d6cf-4016-9d0c-4af16f4aa71a None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:44.917473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca5f44-06e9-490a-ad2f-d5c30f8f9056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:44.918084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca5f44-06e9-490a-ad2f-d5c30f8f9056 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:44.918372 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca5f44-06e9-490a-ad2f-d5c30f8f9056 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:44.918653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca5f44-06e9-490a-ad2f-d5c30f8f9056 None admin] PATH_INFO: `/v3/users/c4eb360b9ada4b8e844014dd4b1c95a3` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:44.932452 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca5f44-06e9-490a-ad2f-d5c30f8f9056 None admin] RBAC: Authorizing `identity:get_user(user_id=c4eb360b9ada4b8e844014dd4b1c95a3)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:44.934027 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca5f44-06e9-490a-ad2f-d5c30f8f9056 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:44.935700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 38/77] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:17:44 2022] GET /identity/v3/users/c4eb360b9ada4b8e844014dd4b1c95a3 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:44.936474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca5f44-06e9-490a-ad2f-d5c30f8f9056 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:44.949141 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:44.956362 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593e371-9efb-447f-9419-b7e97a0cf71e None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:44.988956 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f813a-f561-4b39-82f8-884b223e6fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:44.989588 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f813a-f561-4b39-82f8-884b223e6fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:44.989870 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f813a-f561-4b39-82f8-884b223e6fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:44.990144 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f813a-f561-4b39-82f8-884b223e6fc3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:45.000649 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f813a-f561-4b39-82f8-884b223e6fc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:17:45.005503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-702f813a-f561-4b39-82f8-884b223e6fc3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:17:45.005503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:17:45.005503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:17:45.005503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:17:45.005503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:17:45.005503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:17:45.005503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:17:45.005503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:17:45.005503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:17:45.005503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:17:45.005503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:17:45.005503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:17:45.005503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:17:45.005503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:17:45.005503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:17:45.005503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:17:45.006337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:17:45.006337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:17:45.006337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:17:45.006337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:17:45.006337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:17:45.006337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:17:45.006337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:17:45.006337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:17:45.006337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:17:45.006337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:17:45.006337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:17:45.006337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:17:45.006337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:17:45.006337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:17:45.006337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:17:45.006337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:17:45.007223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:17:45.007223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:17:45.007223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:17:45.007223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:17:45.007223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:17:45.007223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:17:45.007223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:17:45.007223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:17:45.007223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:17:45.007223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:17:45.007223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:17:45.007223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:17:45.007223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 40/78] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:17:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:17:45.007861 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f813a-f561-4b39-82f8-884b223e6fc3 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:45.038542 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca5f44-06e9-490a-ad2f-d5c30f8f9056 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:45.049653 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:45.079184 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b6046-f689-46d5-8e1f-a1644af2c0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:45.079868 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b6046-f689-46d5-8e1f-a1644af2c0f8 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:45.080151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b6046-f689-46d5-8e1f-a1644af2c0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:45.080429 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b6046-f689-46d5-8e1f-a1644af2c0f8 None admin] PATH_INFO: `/v3/users/f4a141c4b1594c35992b7b147f7c2904` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:45.081606 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b6046-f689-46d5-8e1f-a1644af2c0f8 None admin] RBAC: Authorizing `identity:get_user(user_id=f4a141c4b1594c35992b7b147f7c2904)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:45.083117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b6046-f689-46d5-8e1f-a1644af2c0f8 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:45.084698 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 39/79] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:17:44 2022] GET /identity/v3/users/f4a141c4b1594c35992b7b147f7c2904 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:45.085474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b6046-f689-46d5-8e1f-a1644af2c0f8 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:45.114291 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f813a-f561-4b39-82f8-884b223e6fc3 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:45.147595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eba65c-d691-4850-aa97-c5f5074ced89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:45.148203 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eba65c-d691-4850-aa97-c5f5074ced89 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:45.148493 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eba65c-d691-4850-aa97-c5f5074ced89 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:45.148773 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eba65c-d691-4850-aa97-c5f5074ced89 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:45.149438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eba65c-d691-4850-aa97-c5f5074ced89 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:45.149738 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eba65c-d691-4850-aa97-c5f5074ced89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:45.151162 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eba65c-d691-4850-aa97-c5f5074ced89 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:45.158834 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 41/80] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:17:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:45.163591 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eba65c-d691-4850-aa97-c5f5074ced89 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:45.174663 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:45.196610 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b6046-f689-46d5-8e1f-a1644af2c0f8 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:45.229303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441b98e-6b45-4353-8b70-1f4b47ddd7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:45.229881 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441b98e-6b45-4353-8b70-1f4b47ddd7da None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:45.230167 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441b98e-6b45-4353-8b70-1f4b47ddd7da None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:45.230521 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441b98e-6b45-4353-8b70-1f4b47ddd7da None admin] PATH_INFO: `/v3/domains/default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:45.231629 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441b98e-6b45-4353-8b70-1f4b47ddd7da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:45.233103 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441b98e-6b45-4353-8b70-1f4b47ddd7da None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:45.234716 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 40/81] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:17:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:45.235515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441b98e-6b45-4353-8b70-1f4b47ddd7da None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:45.260234 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eba65c-d691-4850-aa97-c5f5074ced89 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:45.261830 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:45.294042 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f745fd-3342-46ff-9d58-bfa0b6c67e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:45.294672 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f745fd-3342-46ff-9d58-bfa0b6c67e4b None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:45.295355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f745fd-3342-46ff-9d58-bfa0b6c67e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:45.295638 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f745fd-3342-46ff-9d58-bfa0b6c67e4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:45.333624 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441b98e-6b45-4353-8b70-1f4b47ddd7da None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:45.361727 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f745fd-3342-46ff-9d58-bfa0b6c67e4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:45.363253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f745fd-3342-46ff-9d58-bfa0b6c67e4b None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:45.368984 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9548a8-8b56-4eb3-ad5e-8f0b2df98272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:45.369591 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9548a8-8b56-4eb3-ad5e-8f0b2df98272 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:45.369866 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9548a8-8b56-4eb3-ad5e-8f0b2df98272 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:45.370156 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9548a8-8b56-4eb3-ad5e-8f0b2df98272 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:45.370813 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9548a8-8b56-4eb3-ad5e-8f0b2df98272 None admin] RBAC: Adding query filter params (name=member) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:45.371208 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9548a8-8b56-4eb3-ad5e-8f0b2df98272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:45.372603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9548a8-8b56-4eb3-ad5e-8f0b2df98272 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:45.381299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 41/82] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:17:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:45.382154 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9548a8-8b56-4eb3-ad5e-8f0b2df98272 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:45.396861 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:45.464625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 42/83] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:17:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:17:45.465370 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f745fd-3342-46ff-9d58-bfa0b6c67e4b None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:45.467628 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:45.486761 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9548a8-8b56-4eb3-ad5e-8f0b2df98272 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:45.521480 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23c658-b25b-4462-b034-d7ddf5857c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:45.522098 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23c658-b25b-4462-b034-d7ddf5857c7a None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:45.522380 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23c658-b25b-4462-b034-d7ddf5857c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:45.522656 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23c658-b25b-4462-b034-d7ddf5857c7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:45.564067 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f745fd-3342-46ff-9d58-bfa0b6c67e4b None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:45.592766 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23c658-b25b-4462-b034-d7ddf5857c7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:45.594237 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23c658-b25b-4462-b034-d7ddf5857c7a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:45.597530 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca12ff-79d0-4e3b-8883-121d66fc2287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:45.598176 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca12ff-79d0-4e3b-8883-121d66fc2287 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:45.598461 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca12ff-79d0-4e3b-8883-121d66fc2287 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:45.598726 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca12ff-79d0-4e3b-8883-121d66fc2287 None admin] PATH_INFO: `/v3/users/c4eb360b9ada4b8e844014dd4b1c95a3` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:45.599903 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca12ff-79d0-4e3b-8883-121d66fc2287 None admin] RBAC: Authorizing `identity:get_user(user_id=c4eb360b9ada4b8e844014dd4b1c95a3)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:45.601355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca12ff-79d0-4e3b-8883-121d66fc2287 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:45.602970 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 43/84] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:17:45 2022] GET /identity/v3/users/c4eb360b9ada4b8e844014dd4b1c95a3 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:45.603801 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca12ff-79d0-4e3b-8883-121d66fc2287 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:45.604028 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:45.674753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:45.696045 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 42/85] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:17:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:17:45.698260 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23c658-b25b-4462-b034-d7ddf5857c7a None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:45.707957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca12ff-79d0-4e3b-8883-121d66fc2287 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:45.740645 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172d4bc-f134-4568-8305-b48d3789c33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:45.741193 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172d4bc-f134-4568-8305-b48d3789c33a None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:45.741475 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172d4bc-f134-4568-8305-b48d3789c33a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:45.741750 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172d4bc-f134-4568-8305-b48d3789c33a None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:45.742404 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172d4bc-f134-4568-8305-b48d3789c33a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:45.743913 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172d4bc-f134-4568-8305-b48d3789c33a None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:45.783010 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 44/86] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Oct 4 16:17:45 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:17:45.783010 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172d4bc-f134-4568-8305-b48d3789c33a None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:45.812517 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23c658-b25b-4462-b034-d7ddf5857c7a None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:45.823219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:45.851658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c498e-e57d-48b1-bf3f-05e8b036310e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:45.852322 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c498e-e57d-48b1-bf3f-05e8b036310e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:45.852755 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c498e-e57d-48b1-bf3f-05e8b036310e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:45.852967 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c498e-e57d-48b1-bf3f-05e8b036310e None admin] PATH_INFO: `/v3/users/c4eb360b9ada4b8e844014dd4b1c95a3` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:45.854343 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c498e-e57d-48b1-bf3f-05e8b036310e None admin] RBAC: Authorizing `identity:get_user(user_id=c4eb360b9ada4b8e844014dd4b1c95a3)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:45.855957 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c498e-e57d-48b1-bf3f-05e8b036310e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:45.857801 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 43/87] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:17:45 2022] GET /identity/v3/users/c4eb360b9ada4b8e844014dd4b1c95a3 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:45.858430 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c498e-e57d-48b1-bf3f-05e8b036310e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:45.891463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172d4bc-f134-4568-8305-b48d3789c33a None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:45.922176 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:45.932896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc35e3-891d-4ecd-b4fe-0e9a180ea498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:45.933692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc35e3-891d-4ecd-b4fe-0e9a180ea498 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:45.933967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc35e3-891d-4ecd-b4fe-0e9a180ea498 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:45.934375 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc35e3-891d-4ecd-b4fe-0e9a180ea498 None admin] PATH_INFO: `/v3/projects/c68abb6013ea44fb9fad2c8141d11c05` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:45.935591 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc35e3-891d-4ecd-b4fe-0e9a180ea498 None admin] RBAC: Authorizing `identity:get_project(project_id=c68abb6013ea44fb9fad2c8141d11c05)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:45.937082 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc35e3-891d-4ecd-b4fe-0e9a180ea498 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:45.943381 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 45/88] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:17:45 2022] GET /identity/v3/projects/c68abb6013ea44fb9fad2c8141d11c05 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:45.945210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc35e3-891d-4ecd-b4fe-0e9a180ea498 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:45.971597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c498e-e57d-48b1-bf3f-05e8b036310e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:46.007594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98ab16-6545-4a55-993a-c7378ea84e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:46.008151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98ab16-6545-4a55-993a-c7378ea84e82 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:46.008432 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98ab16-6545-4a55-993a-c7378ea84e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:46.008711 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98ab16-6545-4a55-993a-c7378ea84e82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:46.065894 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc35e3-891d-4ecd-b4fe-0e9a180ea498 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:46.070257 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:46.098779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98ab16-6545-4a55-993a-c7378ea84e82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:46.100436 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98ab16-6545-4a55-993a-c7378ea84e82 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:46.110105 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedc8bc-2634-4dad-9d86-e06f6ef4f389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:46.111021 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedc8bc-2634-4dad-9d86-e06f6ef4f389 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:46.111175 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedc8bc-2634-4dad-9d86-e06f6ef4f389 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:46.111440 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedc8bc-2634-4dad-9d86-e06f6ef4f389 None admin] PATH_INFO: `/v3/projects/c68abb6013ea44fb9fad2c8141d11c05` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:46.112695 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedc8bc-2634-4dad-9d86-e06f6ef4f389 None admin] RBAC: Authorizing `identity:get_project(project_id=c68abb6013ea44fb9fad2c8141d11c05)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:46.114148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedc8bc-2634-4dad-9d86-e06f6ef4f389 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:46.116393 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 46/89] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:17:45 2022] GET /identity/v3/projects/c68abb6013ea44fb9fad2c8141d11c05 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:46.117487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedc8bc-2634-4dad-9d86-e06f6ef4f389 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:46.196338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:46.238129 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedc8bc-2634-4dad-9d86-e06f6ef4f389 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:46.238541 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 44/90] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:17:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:17:46.239962 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98ab16-6545-4a55-993a-c7378ea84e82 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:46.275054 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9ee87-0197-4b0b-8ccd-bc388625b172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:46.275619 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9ee87-0197-4b0b-8ccd-bc388625b172 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:46.275901 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9ee87-0197-4b0b-8ccd-bc388625b172 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:46.276168 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9ee87-0197-4b0b-8ccd-bc388625b172 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:46.344223 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:46.349892 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9ee87-0197-4b0b-8ccd-bc388625b172 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:46.351611 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9ee87-0197-4b0b-8ccd-bc388625b172 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:46.380011 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98ab16-6545-4a55-993a-c7378ea84e82 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:46.421897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:46.427132 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc55cf-23ee-4482-9acf-c7fce7f533a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:46.427989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc55cf-23ee-4482-9acf-c7fce7f533a9 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:46.428575 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc55cf-23ee-4482-9acf-c7fce7f533a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:46.428990 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc55cf-23ee-4482-9acf-c7fce7f533a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:46.429868 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc55cf-23ee-4482-9acf-c7fce7f533a9 None admin] RBAC: Adding query filter params (role.id=5cf61f379b4d49cb9e19605796d13f62, scope.project.id=c68abb6013ea44fb9fad2c8141d11c05, user.id=c4eb360b9ada4b8e844014dd4b1c95a3) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:46.430317 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc55cf-23ee-4482-9acf-c7fce7f533a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:46.432002 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc55cf-23ee-4482-9acf-c7fce7f533a9 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:46.438400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 45/91] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:17:46 2022] GET /identity/v3/role_assignments?user.id=c4eb360b9ada4b8e844014dd4b1c95a3&scope.project.id=c68abb6013ea44fb9fad2c8141d11c05&role.id=5cf61f379b4d49cb9e19605796d13f62 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:46.439518 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc55cf-23ee-4482-9acf-c7fce7f533a9 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:46.477814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 47/92] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:17:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:17:46.480168 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9ee87-0197-4b0b-8ccd-bc388625b172 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:46.570591 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc55cf-23ee-4482-9acf-c7fce7f533a9 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:46.635054 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88533181-40e7-4b5c-9d4d-d459edfbdb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:46.635859 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88533181-40e7-4b5c-9d4d-d459edfbdb66 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:46.636233 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88533181-40e7-4b5c-9d4d-d459edfbdb66 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:46.636725 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88533181-40e7-4b5c-9d4d-d459edfbdb66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:46.637575 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88533181-40e7-4b5c-9d4d-d459edfbdb66 None admin] RBAC: Adding query filter params (role.id=066f46534195417295e63a5316632eae, scope.project.id=c68abb6013ea44fb9fad2c8141d11c05, user.id=f4a141c4b1594c35992b7b147f7c2904) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:46.637989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88533181-40e7-4b5c-9d4d-d459edfbdb66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:46.641123 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88533181-40e7-4b5c-9d4d-d459edfbdb66 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:46.648679 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 46/93] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:17:46 2022] GET /identity/v3/role_assignments?user.id=f4a141c4b1594c35992b7b147f7c2904&scope.project.id=c68abb6013ea44fb9fad2c8141d11c05&role.id=066f46534195417295e63a5316632eae => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:46.649350 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88533181-40e7-4b5c-9d4d-d459edfbdb66 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:46.654752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:46.735000 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9ee87-0197-4b0b-8ccd-bc388625b172 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:46.817396 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ca1ac-51f8-4d48-b98c-4b7eae06bc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:46.818315 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ca1ac-51f8-4d48-b98c-4b7eae06bc6a None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:46.818768 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ca1ac-51f8-4d48-b98c-4b7eae06bc6a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:46.819205 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ca1ac-51f8-4d48-b98c-4b7eae06bc6a None admin] PATH_INFO: `/v3/projects/c68abb6013ea44fb9fad2c8141d11c05` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:46.823902 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ca1ac-51f8-4d48-b98c-4b7eae06bc6a None admin] RBAC: Authorizing `identity:get_project(project_id=c68abb6013ea44fb9fad2c8141d11c05)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:46.825644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ca1ac-51f8-4d48-b98c-4b7eae06bc6a None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:46.827476 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 48/94] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:17:46 2022] GET /identity/v3/projects/c68abb6013ea44fb9fad2c8141d11c05 => generated 298 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:46.833698 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ca1ac-51f8-4d48-b98c-4b7eae06bc6a None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:46.857579 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88533181-40e7-4b5c-9d4d-d459edfbdb66 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:46.899413 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:46.930157 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce47719-3ce3-4936-96b2-7ac8f14f8937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:46.930833 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce47719-3ce3-4936-96b2-7ac8f14f8937 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:46.931135 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce47719-3ce3-4936-96b2-7ac8f14f8937 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:46.931413 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce47719-3ce3-4936-96b2-7ac8f14f8937 None admin] PATH_INFO: `/v3/projects/9ce53771b739482fa66fe777d7fd600c` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:46.933377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce47719-3ce3-4936-96b2-7ac8f14f8937 None admin] RBAC: Authorizing `identity:get_project(project_id=9ce53771b739482fa66fe777d7fd600c)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:46.934967 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce47719-3ce3-4936-96b2-7ac8f14f8937 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:46.939738 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 47/95] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:17:46 2022] GET /identity/v3/projects/9ce53771b739482fa66fe777d7fd600c => generated 312 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:46.948219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce47719-3ce3-4936-96b2-7ac8f14f8937 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:47.021221 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ca1ac-51f8-4d48-b98c-4b7eae06bc6a None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:47.035368 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:47.055261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce47719-3ce3-4936-96b2-7ac8f14f8937 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:47.081273 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b286b8e-f4c0-4727-b394-1dc29d77d182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:47.081949 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b286b8e-f4c0-4727-b394-1dc29d77d182 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:47.082296 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b286b8e-f4c0-4727-b394-1dc29d77d182 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:47.082640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b286b8e-f4c0-4727-b394-1dc29d77d182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:47.083560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b286b8e-f4c0-4727-b394-1dc29d77d182 None admin] RBAC: Adding query filter params (role.id=2497938af8354a00a7e4ec59ad8b9582, scope.project.id=c68abb6013ea44fb9fad2c8141d11c05, user.id=c4eb360b9ada4b8e844014dd4b1c95a3) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:47.083935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b286b8e-f4c0-4727-b394-1dc29d77d182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:47.085541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b286b8e-f4c0-4727-b394-1dc29d77d182 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:47.091448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77174b5-df5a-4434-b1e6-b11d5812c81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:47.092067 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77174b5-df5a-4434-b1e6-b11d5812c81c None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:47.092349 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77174b5-df5a-4434-b1e6-b11d5812c81c None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:47.092620 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77174b5-df5a-4434-b1e6-b11d5812c81c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:47.093467 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77174b5-df5a-4434-b1e6-b11d5812c81c None admin] RBAC: Adding query filter params (role.id=5cf61f379b4d49cb9e19605796d13f62, scope.project.id=9ce53771b739482fa66fe777d7fd600c, user.id=c4eb360b9ada4b8e844014dd4b1c95a3) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:47.093789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77174b5-df5a-4434-b1e6-b11d5812c81c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:47.095273 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77174b5-df5a-4434-b1e6-b11d5812c81c None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:47.098974 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 49/96] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:17:46 2022] GET /identity/v3/role_assignments?user.id=c4eb360b9ada4b8e844014dd4b1c95a3&scope.project.id=c68abb6013ea44fb9fad2c8141d11c05&role.id=2497938af8354a00a7e4ec59ad8b9582 => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:17:47.101279 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 48/97] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:17:46 2022] GET /identity/v3/role_assignments?user.id=c4eb360b9ada4b8e844014dd4b1c95a3&scope.project.id=9ce53771b739482fa66fe777d7fd600c&role.id=5cf61f379b4d49cb9e19605796d13f62 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:17:48.545911 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4850e3-af33-4773-8bc0-20626887b52a None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:48.546438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4850e3-af33-4773-8bc0-20626887b52a None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:48.546438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4850e3-af33-4773-8bc0-20626887b52a None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:48.548128 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 50/98] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:17:48.554042 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde82c84-c258-4619-896e-814e0fead617 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:48.554499 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde82c84-c258-4619-896e-814e0fead617 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:48.554674 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde82c84-c258-4619-896e-814e0fead617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:48.584040 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-cde82c84-c258-4619-896e-814e0fead617 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:48.585269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-cde82c84-c258-4619-896e-814e0fead617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:48.663006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 49/99] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:17:49.029638 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e28a86-ca8f-4ad9-a973-90085d23e87b None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:49.029919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e28a86-ca8f-4ad9-a973-90085d23e87b None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:49.030198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e28a86-ca8f-4ad9-a973-90085d23e87b None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:49.031623 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 51/100] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:17:49.037447 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d805b0-d52f-484c-9ea5-6b62bb303121 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:49.037741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d805b0-d52f-484c-9ea5-6b62bb303121 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:49.038020 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d805b0-d52f-484c-9ea5-6b62bb303121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:49.067962 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-33d805b0-d52f-484c-9ea5-6b62bb303121 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:49.069179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-33d805b0-d52f-484c-9ea5-6b62bb303121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:49.137537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:49.149571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 50/101] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:17:49.189823 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e28a86-ca8f-4ad9-a973-90085d23e87b None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:49.308358 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:49.316912 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e28a86-ca8f-4ad9-a973-90085d23e87b None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:49.359911 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70fc37-2188-42e5-943e-9adff78e2cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:49.360556 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70fc37-2188-42e5-943e-9adff78e2cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:49.360831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70fc37-2188-42e5-943e-9adff78e2cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:49.361100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70fc37-2188-42e5-943e-9adff78e2cb8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:49.379723 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70fc37-2188-42e5-943e-9adff78e2cb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:17:49.381070 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857879b-a8e3-4be1-bffe-ed998d491be4 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:49.381576 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857879b-a8e3-4be1-bffe-ed998d491be4 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:49.382054 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857879b-a8e3-4be1-bffe-ed998d491be4 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:49.383658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 51/102] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:17:49.386446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-2b70fc37-2188-42e5-943e-9adff78e2cb8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 16:17:49.386446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:17:49.386446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:17:49.386446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:17:49.386446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:17:49.386446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:17:49.386446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:17:49.386446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:17:49.386446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:17:49.386446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:17:49.386446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:17:49.386446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:17:49.386446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:17:49.386446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:17:49.386446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:17:49.386446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:17:49.387462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:17:49.387462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:17:49.387462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:17:49.387462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:17:49.387462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:17:49.387462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:17:49.387462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:17:49.387462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:17:49.387462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:17:49.387462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:17:49.387462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:17:49.387462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:17:49.387462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:17:49.387462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:17:49.387462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:17:49.387462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:17:49.388215 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:17:49.388215 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:17:49.388215 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:17:49.388215 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:17:49.388215 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:17:49.388215 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:17:49.388215 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:17:49.388215 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:17:49.388215 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:17:49.388215 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:17:49.388215 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 16:17:49.388215 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:17:49.388215 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 52/103] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:17:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:17:49.391820 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70fc37-2188-42e5-943e-9adff78e2cb8 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:49.392288 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf0f20-25b0-4805-ac03-d82b9c7e32d1 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:49.392761 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf0f20-25b0-4805-ac03-d82b9c7e32d1 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:49.393219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf0f20-25b0-4805-ac03-d82b9c7e32d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:49.427334 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-1dbf0f20-25b0-4805-ac03-d82b9c7e32d1 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:49.428862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-1dbf0f20-25b0-4805-ac03-d82b9c7e32d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:49.563576 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70fc37-2188-42e5-943e-9adff78e2cb8 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:49.565904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 52/104] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:17:49.612632 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f649a89-b3da-4237-82b3-52f52c3c248e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:49.613602 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f649a89-b3da-4237-82b3-52f52c3c248e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:49.614072 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f649a89-b3da-4237-82b3-52f52c3c248e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:49.614530 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f649a89-b3da-4237-82b3-52f52c3c248e None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:49.615426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f649a89-b3da-4237-82b3-52f52c3c248e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:49.615941 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f649a89-b3da-4237-82b3-52f52c3c248e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:49.617696 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f649a89-b3da-4237-82b3-52f52c3c248e None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:49.634177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 53/105] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:17:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:17:49.640201 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf0f20-25b0-4805-ac03-d82b9c7e32d1 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:49.755256 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f649a89-b3da-4237-82b3-52f52c3c248e None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:49.769339 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf0f20-25b0-4805-ac03-d82b9c7e32d1 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:49.792929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:49.813790 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:49.828071 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6680b-113a-4fa0-8297-27d5d932c008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:49.828733 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6680b-113a-4fa0-8297-27d5d932c008 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:49.830192 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6680b-113a-4fa0-8297-27d5d932c008 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:49.830192 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6680b-113a-4fa0-8297-27d5d932c008 None admin] PATH_INFO: `/v3/users/6feddfade28345748a6d467f0c2d725b` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:49.864128 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6680b-113a-4fa0-8297-27d5d932c008 None admin] RBAC: Authorizing `identity:get_user(user_id=6feddfade28345748a6d467f0c2d725b)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:49.867474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6680b-113a-4fa0-8297-27d5d932c008 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:49.867582 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 53/106] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:17:49 2022] GET /identity/v3/users/6feddfade28345748a6d467f0c2d725b => generated 289 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:49.874040 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6680b-113a-4fa0-8297-27d5d932c008 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:49.954692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f649a89-b3da-4237-82b3-52f52c3c248e None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:50.015745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e93978-c810-47ff-8a11-275fb646be57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:50.016406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e93978-c810-47ff-8a11-275fb646be57 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:50.016691 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e93978-c810-47ff-8a11-275fb646be57 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:50.016962 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e93978-c810-47ff-8a11-275fb646be57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:50.019658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e93978-c810-47ff-8a11-275fb646be57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:50.022342 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e93978-c810-47ff-8a11-275fb646be57 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:50.024399 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 54/107] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:17:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:17:50.026107 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e93978-c810-47ff-8a11-275fb646be57 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:50.074334 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6680b-113a-4fa0-8297-27d5d932c008 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:50.112304 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed430c-8f59-4c58-bd3f-7830181136c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:50.113310 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed430c-8f59-4c58-bd3f-7830181136c2 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:50.113846 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed430c-8f59-4c58-bd3f-7830181136c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:50.114308 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed430c-8f59-4c58-bd3f-7830181136c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:50.180843 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:50.222324 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:50.222650 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed430c-8f59-4c58-bd3f-7830181136c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:50.224271 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed430c-8f59-4c58-bd3f-7830181136c2 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:50.251747 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e93978-c810-47ff-8a11-275fb646be57 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:50.291751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676597d-bb66-4e90-a810-f2d24aa06e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:50.292439 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676597d-bb66-4e90-a810-f2d24aa06e97 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:50.292700 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676597d-bb66-4e90-a810-f2d24aa06e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:50.293120 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676597d-bb66-4e90-a810-f2d24aa06e97 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:50.304049 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676597d-bb66-4e90-a810-f2d24aa06e97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:17:50.310607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-7676597d-bb66-4e90-a810-f2d24aa06e97 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:17:50.310607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:17:50.310607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:17:50.310607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:17:50.310607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:17:50.310607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:17:50.310607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:17:50.310607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:17:50.310607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:17:50.310607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:17:50.310607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:17:50.310607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:17:50.310607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:17:50.310607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:17:50.310607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:17:50.310607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:17:50.311614 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:17:50.311614 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:17:50.311614 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:17:50.311614 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:17:50.311614 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:17:50.311614 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:17:50.311614 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:17:50.311614 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:17:50.311614 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:17:50.311614 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:17:50.311614 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:17:50.311614 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:17:50.311614 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:17:50.311614 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:17:50.311614 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:17:50.311614 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:17:50.312387 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:17:50.312387 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:17:50.312387 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:17:50.312387 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:17:50.312387 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:17:50.312387 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:17:50.312387 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:17:50.312387 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:17:50.312387 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:17:50.312387 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:17:50.312387 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:17:50.312387 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:17:50.312387 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 55/108] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:17:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:17:50.313042 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676597d-bb66-4e90-a810-f2d24aa06e97 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:50.351030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 54/109] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:17:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:17:50.352526 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b40ab8-e322-4f0d-8ce3-cf3910fa5ab5 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:50.352812 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b40ab8-e322-4f0d-8ce3-cf3910fa5ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:50.353085 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b40ab8-e322-4f0d-8ce3-cf3910fa5ab5 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:50.354489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 55/110] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:17:50.356232 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7a73f-7ef1-46db-8b0f-c2d7ea77f954 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:50.356232 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7a73f-7ef1-46db-8b0f-c2d7ea77f954 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:50.356232 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7a73f-7ef1-46db-8b0f-c2d7ea77f954 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:50.359040 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 56/111] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:17:50.359040 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7a73f-7ef1-46db-8b0f-c2d7ea77f954 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:50.434153 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676597d-bb66-4e90-a810-f2d24aa06e97 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:50.449425 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:50.467204 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7a73f-7ef1-46db-8b0f-c2d7ea77f954 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:50.470397 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc2665-b2b8-4ea6-b64e-e8691a212bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:50.471047 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc2665-b2b8-4ea6-b64e-e8691a212bf9 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:50.471430 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc2665-b2b8-4ea6-b64e-e8691a212bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:50.471705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc2665-b2b8-4ea6-b64e-e8691a212bf9 None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:50.472358 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc2665-b2b8-4ea6-b64e-e8691a212bf9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:50.473830 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc2665-b2b8-4ea6-b64e-e8691a212bf9 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:50.494875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:50.505434 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4adbf-60b1-4832-bdda-f2cb9d91594e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:50.506087 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4adbf-60b1-4832-bdda-f2cb9d91594e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:50.506354 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4adbf-60b1-4832-bdda-f2cb9d91594e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:50.506624 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4adbf-60b1-4832-bdda-f2cb9d91594e None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:50.507345 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd4adbf-60b1-4832-bdda-f2cb9d91594e None admin] RBAC: Adding query filter params (name=member) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:50.507647 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd4adbf-60b1-4832-bdda-f2cb9d91594e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:50.509102 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd4adbf-60b1-4832-bdda-f2cb9d91594e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:50.510273 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 56/112] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Oct 4 16:17:50 2022] POST /identity/v3/projects => generated 302 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:17:50.511332 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc2665-b2b8-4ea6-b64e-e8691a212bf9 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:50.548908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 57/113] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:17:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:50.551157 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4a944-67cf-4986-8aea-c39b6d8ae45f None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:50.551451 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4a944-67cf-4986-8aea-c39b6d8ae45f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:50.551727 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4a944-67cf-4986-8aea-c39b6d8ae45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:50.582846 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-cfc4a944-67cf-4986-8aea-c39b6d8ae45f None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:50.584256 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-cfc4a944-67cf-4986-8aea-c39b6d8ae45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:50.642535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc2665-b2b8-4ea6-b64e-e8691a212bf9 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:50.671237 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 58/114] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:17:50.672391 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b04fd-faed-4389-b788-2897a502d457 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:50.672679 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b04fd-faed-4389-b788-2897a502d457 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:50.672948 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b04fd-faed-4389-b788-2897a502d457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:50.691008 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aadbfda-2ced-476b-8a90-1c23a11c5d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:50.691008 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadbfda-2ced-476b-8a90-1c23a11c5d44 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:50.691008 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadbfda-2ced-476b-8a90-1c23a11c5d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:50.691008 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadbfda-2ced-476b-8a90-1c23a11c5d44 None admin] PATH_INFO: `/v3/projects/c68abb6013ea44fb9fad2c8141d11c05` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:50.691411 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-106b04fd-faed-4389-b788-2897a502d457 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:50.691481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aadbfda-2ced-476b-8a90-1c23a11c5d44 None admin] RBAC: Authorizing `identity:get_project(project_id=c68abb6013ea44fb9fad2c8141d11c05)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:50.695192 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-106b04fd-faed-4389-b788-2897a502d457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:50.695454 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aadbfda-2ced-476b-8a90-1c23a11c5d44 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:50.695454 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 57/115] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:17:50 2022] GET /identity/v3/projects/c68abb6013ea44fb9fad2c8141d11c05 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:50.697139 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aadbfda-2ced-476b-8a90-1c23a11c5d44 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:50.773340 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 59/116] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:17:50.775621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:50.776576 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9f0fb-c72e-4bb6-8050-1f7675ff0354 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:50.777122 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9f0fb-c72e-4bb6-8050-1f7675ff0354 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:50.777679 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9f0fb-c72e-4bb6-8050-1f7675ff0354 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:50.779167 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 60/117] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:17:50.780085 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9f0fb-c72e-4bb6-8050-1f7675ff0354 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:50.795416 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:50.827846 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aadbfda-2ced-476b-8a90-1c23a11c5d44 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:50.865351 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05162f1-f64a-4d9d-9a36-25fa81619276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:50.866378 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05162f1-f64a-4d9d-9a36-25fa81619276 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:50.866885 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05162f1-f64a-4d9d-9a36-25fa81619276 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:50.867470 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05162f1-f64a-4d9d-9a36-25fa81619276 None admin] PATH_INFO: `/v3/users/c4eb360b9ada4b8e844014dd4b1c95a3` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:50.868775 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05162f1-f64a-4d9d-9a36-25fa81619276 None admin] RBAC: Authorizing `identity:get_user(user_id=c4eb360b9ada4b8e844014dd4b1c95a3)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:50.870392 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05162f1-f64a-4d9d-9a36-25fa81619276 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:50.872336 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 58/118] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:17:50 2022] GET /identity/v3/users/c4eb360b9ada4b8e844014dd4b1c95a3 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:50.874610 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90862d-3026-4e9a-b488-1d804d83f4eb None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:50.874610 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90862d-3026-4e9a-b488-1d804d83f4eb None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:50.874610 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90862d-3026-4e9a-b488-1d804d83f4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:50.893081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9f0fb-c72e-4bb6-8050-1f7675ff0354 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:50.895032 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-dd90862d-3026-4e9a-b488-1d804d83f4eb None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:50.896606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-dd90862d-3026-4e9a-b488-1d804d83f4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:50.929611 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c719d0-9b29-4dfc-89bb-b4353088992d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:50.930627 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c719d0-9b29-4dfc-89bb-b4353088992d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:50.931203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c719d0-9b29-4dfc-89bb-b4353088992d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:50.931716 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c719d0-9b29-4dfc-89bb-b4353088992d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:50.932678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c719d0-9b29-4dfc-89bb-b4353088992d None admin] RBAC: Adding query filter params (role.id=f889fef4a0c74c31a7942ec629ccf0ed, scope.project.id=c68abb6013ea44fb9fad2c8141d11c05, user.id=6feddfade28345748a6d467f0c2d725b) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:50.933156 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c719d0-9b29-4dfc-89bb-b4353088992d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:50.934868 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c719d0-9b29-4dfc-89bb-b4353088992d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:50.940881 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 61/119] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:17:50 2022] GET /identity/v3/role_assignments?user.id=6feddfade28345748a6d467f0c2d725b&scope.project.id=c68abb6013ea44fb9fad2c8141d11c05&role.id=f889fef4a0c74c31a7942ec629ccf0ed => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:50.942004 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c719d0-9b29-4dfc-89bb-b4353088992d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:50.971723 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 59/120] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:17:50.978576 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90862d-3026-4e9a-b488-1d804d83f4eb None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:51.027439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:51.073830 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c719d0-9b29-4dfc-89bb-b4353088992d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:51.077470 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:51.143896 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce78c0-a621-4b76-9b6c-95e7e64f9df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:51.144882 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce78c0-a621-4b76-9b6c-95e7e64f9df3 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:51.145318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce78c0-a621-4b76-9b6c-95e7e64f9df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:51.145723 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce78c0-a621-4b76-9b6c-95e7e64f9df3 None admin] PATH_INFO: `/v3/projects/c68abb6013ea44fb9fad2c8141d11c05` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:51.147182 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce78c0-a621-4b76-9b6c-95e7e64f9df3 None admin] RBAC: Authorizing `identity:get_project(project_id=c68abb6013ea44fb9fad2c8141d11c05)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:51.148867 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce78c0-a621-4b76-9b6c-95e7e64f9df3 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:51.150495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90862d-3026-4e9a-b488-1d804d83f4eb None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:51.150816 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 62/121] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:17:50 2022] GET /identity/v3/projects/c68abb6013ea44fb9fad2c8141d11c05 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:51.158136 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce78c0-a621-4b76-9b6c-95e7e64f9df3 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:51.194488 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682da1d8-36b7-49d5-9cea-41755a9c86b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:51.195465 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682da1d8-36b7-49d5-9cea-41755a9c86b4 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:51.195919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682da1d8-36b7-49d5-9cea-41755a9c86b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:51.196328 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682da1d8-36b7-49d5-9cea-41755a9c86b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:51.209062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682da1d8-36b7-49d5-9cea-41755a9c86b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:17:51.215730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-682da1d8-36b7-49d5-9cea-41755a9c86b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:17:51.215730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:17:51.215730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:17:51.215730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:17:51.215730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:17:51.215730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:17:51.215730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:17:51.215730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:17:51.215730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:17:51.215730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:17:51.215730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:17:51.215730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:17:51.215730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:17:51.215730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:17:51.215730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:17:51.215730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:17:51.216596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:17:51.216596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:17:51.216596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:17:51.216596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:17:51.216596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:17:51.216596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:17:51.216596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:17:51.216596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:17:51.216596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:17:51.216596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:17:51.216596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:17:51.216596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:17:51.216596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:17:51.216596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:17:51.216596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:17:51.216596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:17:51.217407 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:17:51.217407 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:17:51.217407 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:17:51.217407 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:17:51.217407 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:17:51.217407 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:17:51.217407 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:17:51.217407 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:17:51.217407 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:17:51.217407 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:17:51.217407 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:17:51.217407 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:17:51.219754 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 60/122] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:17:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:17:51.220917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682da1d8-36b7-49d5-9cea-41755a9c86b4 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:51.278397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce78c0-a621-4b76-9b6c-95e7e64f9df3 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:51.349829 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c416f3-2d56-43e8-8bed-dacf4d59c890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:51.350516 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c416f3-2d56-43e8-8bed-dacf4d59c890 None admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:51.350794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c416f3-2d56-43e8-8bed-dacf4d59c890 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:51.351105 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c416f3-2d56-43e8-8bed-dacf4d59c890 None admin] PATH_INFO: `/v3/projects/c68abb6013ea44fb9fad2c8141d11c05/users/c4eb360b9ada4b8e844014dd4b1c95a3/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:51.353047 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c416f3-2d56-43e8-8bed-dacf4d59c890 None admin] RBAC: Authorizing `identity:create_grant(project_id=c68abb6013ea44fb9fad2c8141d11c05, user_id=c4eb360b9ada4b8e844014dd4b1c95a3, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:51.353980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682da1d8-36b7-49d5-9cea-41755a9c86b4 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:51.354514 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c416f3-2d56-43e8-8bed-dacf4d59c890 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:51.365871 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:51.372014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 63/123] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Oct 4 16:17:51 2022] PUT /identity/v3/projects/c68abb6013ea44fb9fad2c8141d11c05/users/c4eb360b9ada4b8e844014dd4b1c95a3/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:17:51.373051 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c416f3-2d56-43e8-8bed-dacf4d59c890 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:51.380060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:51.393207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c116644-60ab-4ff5-b045-d774e9f39ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:51.393873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c116644-60ab-4ff5-b045-d774e9f39ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:51.394214 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c116644-60ab-4ff5-b045-d774e9f39ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:51.394427 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c116644-60ab-4ff5-b045-d774e9f39ed2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:51.406934 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c116644-60ab-4ff5-b045-d774e9f39ed2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:17:51.420605 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-3c116644-60ab-4ff5-b045-d774e9f39ed2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:17:51.420605 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:17:51.420605 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:17:51.420605 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:17:51.420605 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:17:51.420605 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:17:51.420605 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:17:51.420605 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:17:51.420605 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:17:51.420605 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:17:51.420605 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:17:51.420605 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:17:51.420605 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:17:51.420605 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:17:51.420605 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:17:51.420605 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:17:51.421552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:17:51.421552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:17:51.421552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:17:51.421552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:17:51.421552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:17:51.421552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:17:51.421552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:17:51.421552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:17:51.421552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:17:51.421552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:17:51.421552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:17:51.421552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:17:51.421552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:17:51.421552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:17:51.421552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:17:51.421552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:17:51.422307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:17:51.422307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:17:51.422307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:17:51.422307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:17:51.422307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:17:51.422307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:17:51.422307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:17:51.422307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:17:51.422307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:17:51.422307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:17:51.422307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:17:51.422307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:17:51.422307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 61/124] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:17:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:17:51.422939 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c116644-60ab-4ff5-b045-d774e9f39ed2 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:51.500528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c416f3-2d56-43e8-8bed-dacf4d59c890 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:51.536358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e18497-4d57-4c20-a45a-ab28356e907d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:51.536995 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e18497-4d57-4c20-a45a-ab28356e907d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:51.537273 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e18497-4d57-4c20-a45a-ab28356e907d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:51.537542 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e18497-4d57-4c20-a45a-ab28356e907d None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:51.538233 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e18497-4d57-4c20-a45a-ab28356e907d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:51.538535 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e18497-4d57-4c20-a45a-ab28356e907d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:51.539988 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e18497-4d57-4c20-a45a-ab28356e907d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:51.549963 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 64/125] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:17:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:51.550895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e18497-4d57-4c20-a45a-ab28356e907d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:51.569925 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c116644-60ab-4ff5-b045-d774e9f39ed2 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:51.617933 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22952c6b-5c5c-425c-8f91-cc68ddd7e403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:51.618971 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22952c6b-5c5c-425c-8f91-cc68ddd7e403 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:51.619709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22952c6b-5c5c-425c-8f91-cc68ddd7e403 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:51.620568 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22952c6b-5c5c-425c-8f91-cc68ddd7e403 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:51.627386 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:51.636779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22952c6b-5c5c-425c-8f91-cc68ddd7e403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:17:51.643541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-22952c6b-5c5c-425c-8f91-cc68ddd7e403 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 16:17:51.643541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:17:51.643541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:17:51.643541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:17:51.643541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:17:51.643541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:17:51.643541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:17:51.643541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:17:51.643541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:17:51.643541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:17:51.643541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:17:51.643541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:17:51.643541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:17:51.643541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:17:51.643541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:17:51.643541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:17:51.645157 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:17:51.645157 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:17:51.645157 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:17:51.645157 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:17:51.645157 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:17:51.645157 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:17:51.645157 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:17:51.645157 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:17:51.645157 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:17:51.645157 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:17:51.645157 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:17:51.645157 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:17:51.645157 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:17:51.645157 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:17:51.645157 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:17:51.645157 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:17:51.646060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:17:51.646060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:17:51.646060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:17:51.646060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:17:51.646060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:17:51.646060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:17:51.646060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:17:51.646060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:17:51.646060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:17:51.646060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:17:51.646060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 16:17:51.646060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:17:51.649341 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 62/126] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Oct 4 16:17:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:17:51.655010 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22952c6b-5c5c-425c-8f91-cc68ddd7e403 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:51.715701 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e18497-4d57-4c20-a45a-ab28356e907d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:51.730949 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:51.762854 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f1e78-6370-42bb-a0a9-c7e8443f0617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:51.763616 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f1e78-6370-42bb-a0a9-c7e8443f0617 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:51.763908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f1e78-6370-42bb-a0a9-c7e8443f0617 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:51.764260 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f1e78-6370-42bb-a0a9-c7e8443f0617 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:51.764967 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f1e78-6370-42bb-a0a9-c7e8443f0617 None admin] RBAC: Adding query filter params (name=member) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:51.765276 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f1e78-6370-42bb-a0a9-c7e8443f0617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:51.766860 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f1e78-6370-42bb-a0a9-c7e8443f0617 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:51.776874 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 65/127] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:17:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:51.777944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f1e78-6370-42bb-a0a9-c7e8443f0617 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:51.819103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22952c6b-5c5c-425c-8f91-cc68ddd7e403 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:51.866472 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac539e-fd9d-41b0-baac-677e09f7ed14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:51.867734 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac539e-fd9d-41b0-baac-677e09f7ed14 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:51.869104 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac539e-fd9d-41b0-baac-677e09f7ed14 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:51.869584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac539e-fd9d-41b0-baac-677e09f7ed14 None admin] PATH_INFO: `/v3/users/f4a141c4b1594c35992b7b147f7c2904` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:51.871266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac539e-fd9d-41b0-baac-677e09f7ed14 None admin] RBAC: Authorizing `identity:get_user(user_id=f4a141c4b1594c35992b7b147f7c2904)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:51.872944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac539e-fd9d-41b0-baac-677e09f7ed14 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:51.875754 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 63/128] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:17:51 2022] GET /identity/v3/users/f4a141c4b1594c35992b7b147f7c2904 => generated 247 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:51.877372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac539e-fd9d-41b0-baac-677e09f7ed14 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:51.946059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f1e78-6370-42bb-a0a9-c7e8443f0617 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:52.000683 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac539e-fd9d-41b0-baac-677e09f7ed14 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:52.002943 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:52.017529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:52.038476 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917928c-d26a-412f-94b9-3fab4734fc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:52.039178 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917928c-d26a-412f-94b9-3fab4734fc9d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:52.039540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917928c-d26a-412f-94b9-3fab4734fc9d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:52.039725 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917928c-d26a-412f-94b9-3fab4734fc9d None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:52.040434 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917928c-d26a-412f-94b9-3fab4734fc9d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:52.040742 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917928c-d26a-412f-94b9-3fab4734fc9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:52.042148 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917928c-d26a-412f-94b9-3fab4734fc9d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:52.053413 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ce474-3a4a-405c-9edd-38fd07b52f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:52.054543 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ce474-3a4a-405c-9edd-38fd07b52f2b None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:52.055104 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ce474-3a4a-405c-9edd-38fd07b52f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:52.055632 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ce474-3a4a-405c-9edd-38fd07b52f2b None admin] PATH_INFO: `/v3/users/c4eb360b9ada4b8e844014dd4b1c95a3` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:52.057358 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ce474-3a4a-405c-9edd-38fd07b52f2b None admin] RBAC: Authorizing `identity:get_user(user_id=c4eb360b9ada4b8e844014dd4b1c95a3)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:52.060274 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ce474-3a4a-405c-9edd-38fd07b52f2b None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:52.062627 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 64/129] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:17:51 2022] GET /identity/v3/users/c4eb360b9ada4b8e844014dd4b1c95a3 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:52.063988 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ce474-3a4a-405c-9edd-38fd07b52f2b None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:52.065067 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 66/130] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:17:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:52.071063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917928c-d26a-412f-94b9-3fab4734fc9d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:52.181979 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ce474-3a4a-405c-9edd-38fd07b52f2b None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:52.218148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd4440-4c2c-4dbf-9482-38533e2277d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:52.219170 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd4440-4c2c-4dbf-9482-38533e2277d2 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:52.219641 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd4440-4c2c-4dbf-9482-38533e2277d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:52.220433 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd4440-4c2c-4dbf-9482-38533e2277d2 None admin] PATH_INFO: `/v3/projects/c68abb6013ea44fb9fad2c8141d11c05` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:52.221892 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd4440-4c2c-4dbf-9482-38533e2277d2 None admin] RBAC: Authorizing `identity:get_project(project_id=c68abb6013ea44fb9fad2c8141d11c05)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:52.223606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd4440-4c2c-4dbf-9482-38533e2277d2 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:52.226556 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 65/131] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:17:52 2022] GET /identity/v3/projects/c68abb6013ea44fb9fad2c8141d11c05 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:52.227635 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd4440-4c2c-4dbf-9482-38533e2277d2 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:52.317917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:52.332988 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917928c-d26a-412f-94b9-3fab4734fc9d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:52.386049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa7815-af60-4a87-9ef5-f81859989e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:52.386831 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa7815-af60-4a87-9ef5-f81859989e82 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:52.387218 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa7815-af60-4a87-9ef5-f81859989e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:52.387317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd4440-4c2c-4dbf-9482-38533e2277d2 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:52.387616 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa7815-af60-4a87-9ef5-f81859989e82 None admin] PATH_INFO: `/v3/projects/9ce53771b739482fa66fe777d7fd600c` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:52.389330 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa7815-af60-4a87-9ef5-f81859989e82 None admin] RBAC: Authorizing `identity:get_project(project_id=9ce53771b739482fa66fe777d7fd600c)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:52.392136 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa7815-af60-4a87-9ef5-f81859989e82 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:52.394195 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 67/132] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:17:52 2022] GET /identity/v3/projects/9ce53771b739482fa66fe777d7fd600c => generated 312 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:17:52.395739 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa7815-af60-4a87-9ef5-f81859989e82 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:52.472366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:52.498084 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05887a2d-f2a6-4a4f-aa8b-35e67d8adab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:52.498750 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05887a2d-f2a6-4a4f-aa8b-35e67d8adab4 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:52.499044 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05887a2d-f2a6-4a4f-aa8b-35e67d8adab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:52.499319 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05887a2d-f2a6-4a4f-aa8b-35e67d8adab4 None admin] PATH_INFO: `/v3/users/c4eb360b9ada4b8e844014dd4b1c95a3` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:52.500483 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05887a2d-f2a6-4a4f-aa8b-35e67d8adab4 None admin] RBAC: Authorizing `identity:get_user(user_id=c4eb360b9ada4b8e844014dd4b1c95a3)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:52.501949 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05887a2d-f2a6-4a4f-aa8b-35e67d8adab4 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:52.511009 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 66/133] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:17:52 2022] GET /identity/v3/users/c4eb360b9ada4b8e844014dd4b1c95a3 => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:52.511009 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05887a2d-f2a6-4a4f-aa8b-35e67d8adab4 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:52.559836 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa7815-af60-4a87-9ef5-f81859989e82 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:52.653931 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05887a2d-f2a6-4a4f-aa8b-35e67d8adab4 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:52.672982 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:52.688809 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fef80-b802-43cf-9bac-35ba8bf515d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:52.689818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fef80-b802-43cf-9bac-35ba8bf515d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:52.690279 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fef80-b802-43cf-9bac-35ba8bf515d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:52.690657 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fef80-b802-43cf-9bac-35ba8bf515d1 None admin] PATH_INFO: `/v3/projects/c68abb6013ea44fb9fad2c8141d11c05/users/f4a141c4b1594c35992b7b147f7c2904/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:52.696197 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e2890-82a6-4de0-8ba5-70f4b92b14ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:52.696979 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e2890-82a6-4de0-8ba5-70f4b92b14ad None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:52.697257 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e2890-82a6-4de0-8ba5-70f4b92b14ad None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:52.697584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e2890-82a6-4de0-8ba5-70f4b92b14ad None admin] PATH_INFO: `/v3/projects/9ce53771b739482fa66fe777d7fd600c/users/c4eb360b9ada4b8e844014dd4b1c95a3/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:52.699784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e2890-82a6-4de0-8ba5-70f4b92b14ad None admin] RBAC: Authorizing `identity:create_grant(project_id=9ce53771b739482fa66fe777d7fd600c, user_id=c4eb360b9ada4b8e844014dd4b1c95a3, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:52.700657 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fef80-b802-43cf-9bac-35ba8bf515d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c68abb6013ea44fb9fad2c8141d11c05, user_id=f4a141c4b1594c35992b7b147f7c2904, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:52.701266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e2890-82a6-4de0-8ba5-70f4b92b14ad None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:52.702375 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fef80-b802-43cf-9bac-35ba8bf515d1 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:52.719404 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 67/134] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Oct 4 16:17:52 2022] PUT /identity/v3/projects/9ce53771b739482fa66fe777d7fd600c/users/c4eb360b9ada4b8e844014dd4b1c95a3/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:17:52.720541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e2890-82a6-4de0-8ba5-70f4b92b14ad None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:52.731746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 68/135] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Oct 4 16:17:52 2022] PUT /identity/v3/projects/c68abb6013ea44fb9fad2c8141d11c05/users/f4a141c4b1594c35992b7b147f7c2904/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:17:52.854190 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e2890-82a6-4de0-8ba5-70f4b92b14ad None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:52.897851 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f265a-ea0f-44bd-ab8a-6a7a41bce0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:52.898506 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f265a-ea0f-44bd-ab8a-6a7a41bce0d1 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:52.898779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f265a-ea0f-44bd-ab8a-6a7a41bce0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:52.899078 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f265a-ea0f-44bd-ab8a-6a7a41bce0d1 None admin] PATH_INFO: `/v3/projects/c68abb6013ea44fb9fad2c8141d11c05` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:52.900298 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f265a-ea0f-44bd-ab8a-6a7a41bce0d1 None admin] RBAC: Authorizing `identity:get_project(project_id=c68abb6013ea44fb9fad2c8141d11c05)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:52.901871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f265a-ea0f-44bd-ab8a-6a7a41bce0d1 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:52.903734 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 68/136] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:17:52 2022] GET /identity/v3/projects/c68abb6013ea44fb9fad2c8141d11c05 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:52.910268 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fef80-b802-43cf-9bac-35ba8bf515d1 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:53.088202 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fef80-b802-43cf-9bac-35ba8bf515d1 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:53.110353 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:53.146207 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b4d65-ef99-466f-b469-da24f93937e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:53.147033 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b4d65-ef99-466f-b469-da24f93937e4 None admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:53.147323 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b4d65-ef99-466f-b469-da24f93937e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:53.147660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b4d65-ef99-466f-b469-da24f93937e4 None admin] PATH_INFO: `/v3/projects/c68abb6013ea44fb9fad2c8141d11c05/users/c4eb360b9ada4b8e844014dd4b1c95a3/roles/2497938af8354a00a7e4ec59ad8b9582` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:53.153111 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b4d65-ef99-466f-b469-da24f93937e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c68abb6013ea44fb9fad2c8141d11c05, user_id=c4eb360b9ada4b8e844014dd4b1c95a3, role_id=2497938af8354a00a7e4ec59ad8b9582)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:53.154844 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b4d65-ef99-466f-b469-da24f93937e4 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:53.173133 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 69/137] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Oct 4 16:17:52 2022] PUT /identity/v3/projects/c68abb6013ea44fb9fad2c8141d11c05/users/c4eb360b9ada4b8e844014dd4b1c95a3/roles/2497938af8354a00a7e4ec59ad8b9582 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:17:53.823912 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d19fa-b56e-4341-922e-11dc78ae9455 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:53.824513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d19fa-b56e-4341-922e-11dc78ae9455 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:53.824513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d19fa-b56e-4341-922e-11dc78ae9455 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:53.826112 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 69/138] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:17:53.833139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e0f8a-24f5-4f62-967a-9685561fb2c4 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:53.833629 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e0f8a-24f5-4f62-967a-9685561fb2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:53.833710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e0f8a-24f5-4f62-967a-9685561fb2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:53.871345 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-f37e0f8a-24f5-4f62-967a-9685561fb2c4 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:53.872719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f37e0f8a-24f5-4f62-967a-9685561fb2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:53.971761 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 70/139] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 16:17:53.999429 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f3e9e-a0f8-4da1-b19a-137c1652907f None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:53.999787 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f3e9e-a0f8-4da1-b19a-137c1652907f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:54.000103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f3e9e-a0f8-4da1-b19a-137c1652907f None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:54.002050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 70/140] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:17:54.020006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf7779-38e8-42b7-b9f8-fd4e0a0444ac None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:54.020649 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf7779-38e8-42b7-b9f8-fd4e0a0444ac None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:54.021162 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf7779-38e8-42b7-b9f8-fd4e0a0444ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:54.044012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-afaf7779-38e8-42b7-b9f8-fd4e0a0444ac None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:54.045935 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-afaf7779-38e8-42b7-b9f8-fd4e0a0444ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:54.128601 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 71/141] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:17:54.250264 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec671d9a-511c-45a7-a666-c81f89efeaef None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:54.250610 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec671d9a-511c-45a7-a666-c81f89efeaef None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:54.250868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec671d9a-511c-45a7-a666-c81f89efeaef None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:54.252459 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 71/142] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:17:54.269062 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9ee31-19f1-48ff-b2bb-dc1b0b4a5cca None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:54.269405 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9ee31-19f1-48ff-b2bb-dc1b0b4a5cca None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:54.269614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9ee31-19f1-48ff-b2bb-dc1b0b4a5cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:54.292428 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-9fe9ee31-19f1-48ff-b2bb-dc1b0b4a5cca None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:54.293709 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-9fe9ee31-19f1-48ff-b2bb-dc1b0b4a5cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:54.321085 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:54.369283 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 72/143] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:17:54.422824 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec671d9a-511c-45a7-a666-c81f89efeaef None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:54.475150 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:54.550623 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec671d9a-511c-45a7-a666-c81f89efeaef None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:54.594365 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c831922-525a-42e6-8143-96b7fa0800d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:54.595182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c831922-525a-42e6-8143-96b7fa0800d3 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:54.595512 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c831922-525a-42e6-8143-96b7fa0800d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:54.595948 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c831922-525a-42e6-8143-96b7fa0800d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:54.609201 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c831922-525a-42e6-8143-96b7fa0800d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:17:54.615890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-3c831922-525a-42e6-8143-96b7fa0800d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 16:17:54.615890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:17:54.615890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:17:54.615890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:17:54.615890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:17:54.615890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:17:54.615890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:17:54.615890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:17:54.615890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:17:54.615890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:17:54.615890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:17:54.615890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:17:54.615890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:17:54.615890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:17:54.615890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:17:54.615890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:17:54.616893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:17:54.616893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:17:54.616893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:17:54.616893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:17:54.616893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:17:54.616893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:17:54.616893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:17:54.616893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:17:54.616893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:17:54.616893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:17:54.616893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:17:54.616893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:17:54.616893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:17:54.616893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:17:54.616893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:17:54.616893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:17:54.617671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:17:54.617671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:17:54.617671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:17:54.617671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:17:54.617671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:17:54.617671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:17:54.617671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:17:54.617671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:17:54.617671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:17:54.617671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:17:54.617671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 16:17:54.617671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:17:54.617671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 72/144] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:17:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:17:54.624472 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9ee31-19f1-48ff-b2bb-dc1b0b4a5cca None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:54.724616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c831922-525a-42e6-8143-96b7fa0800d3 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:54.764069 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9ee31-19f1-48ff-b2bb-dc1b0b4a5cca None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:54.835958 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352686ee-624f-4044-b1fd-1b9e0ce5244e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:54.836728 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352686ee-624f-4044-b1fd-1b9e0ce5244e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:54.837044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352686ee-624f-4044-b1fd-1b9e0ce5244e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:54.837372 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352686ee-624f-4044-b1fd-1b9e0ce5244e None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:54.838241 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352686ee-624f-4044-b1fd-1b9e0ce5244e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:54.838603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352686ee-624f-4044-b1fd-1b9e0ce5244e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:54.840586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352686ee-624f-4044-b1fd-1b9e0ce5244e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:54.850940 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 73/145] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:17:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:54.872632 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352686ee-624f-4044-b1fd-1b9e0ce5244e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:54.884716 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c831922-525a-42e6-8143-96b7fa0800d3 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:54.887332 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:54.926265 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:54.941976 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cde46-8641-4ff9-98e2-05f68782fab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:54.943111 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cde46-8641-4ff9-98e2-05f68782fab0 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:54.943778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cde46-8641-4ff9-98e2-05f68782fab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:54.944247 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cde46-8641-4ff9-98e2-05f68782fab0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:54.946098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cde46-8641-4ff9-98e2-05f68782fab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:54.948083 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cde46-8641-4ff9-98e2-05f68782fab0 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:54.950247 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 73/146] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:17:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:54.951359 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cde46-8641-4ff9-98e2-05f68782fab0 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:55.096734 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cde46-8641-4ff9-98e2-05f68782fab0 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:55.137805 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352686ee-624f-4044-b1fd-1b9e0ce5244e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:55.143407 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c62a5-d002-4380-8aa8-3f4d1b7ce913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:55.144596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c62a5-d002-4380-8aa8-3f4d1b7ce913 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:55.145240 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c62a5-d002-4380-8aa8-3f4d1b7ce913 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:55.145878 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c62a5-d002-4380-8aa8-3f4d1b7ce913 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:55.161919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c62a5-d002-4380-8aa8-3f4d1b7ce913 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:17:55.170831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-c68c62a5-d002-4380-8aa8-3f4d1b7ce913 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:17:55.170831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:17:55.170831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:17:55.170831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:17:55.170831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:17:55.170831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:17:55.170831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:17:55.170831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:17:55.170831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:17:55.170831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:17:55.170831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:17:55.170831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:17:55.170831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:17:55.170831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:17:55.170831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:17:55.170831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:17:55.171880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:17:55.171880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:17:55.171880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:17:55.171880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:17:55.171880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:17:55.171880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:17:55.171880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:17:55.171880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:17:55.171880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:17:55.171880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:17:55.171880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:17:55.171880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:17:55.171880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:17:55.171880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:17:55.171880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:17:55.171880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:17:55.172783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:17:55.172783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:17:55.172783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:17:55.172783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:17:55.172783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:17:55.172783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:17:55.172783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:17:55.172783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:17:55.172783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:17:55.172783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:17:55.172783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:17:55.172783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:17:55.175521 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 74/147] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:17:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:17:55.176752 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c62a5-d002-4380-8aa8-3f4d1b7ce913 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:55.217571 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:55.220397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d038f5c-9648-4fad-bd66-0b376e74e779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:55.221086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d038f5c-9648-4fad-bd66-0b376e74e779 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:55.221414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d038f5c-9648-4fad-bd66-0b376e74e779 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:55.221623 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d038f5c-9648-4fad-bd66-0b376e74e779 None admin] PATH_INFO: `/v3/users/6feddfade28345748a6d467f0c2d725b` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:55.222784 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d038f5c-9648-4fad-bd66-0b376e74e779 None admin] RBAC: Authorizing `identity:get_user(user_id=6feddfade28345748a6d467f0c2d725b)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:55.224292 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d038f5c-9648-4fad-bd66-0b376e74e779 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:55.225903 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 74/148] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:17:54 2022] GET /identity/v3/users/6feddfade28345748a6d467f0c2d725b => generated 289 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:17:55.226672 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d038f5c-9648-4fad-bd66-0b376e74e779 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:55.319286 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c62a5-d002-4380-8aa8-3f4d1b7ce913 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:55.358013 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b798a0a-e43d-474c-ac3e-95443b8f23e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:55.359059 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b798a0a-e43d-474c-ac3e-95443b8f23e1 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:55.359549 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b798a0a-e43d-474c-ac3e-95443b8f23e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:55.360012 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b798a0a-e43d-474c-ac3e-95443b8f23e1 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:55.360931 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b798a0a-e43d-474c-ac3e-95443b8f23e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:55.362796 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b798a0a-e43d-474c-ac3e-95443b8f23e1 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:55.388874 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 75/149] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Oct 4 16:17:55 2022] POST /identity/v3/users => generated 283 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:17:55.390374 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b798a0a-e43d-474c-ac3e-95443b8f23e1 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:55.449622 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:55.463356 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d038f5c-9648-4fad-bd66-0b376e74e779 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:55.529541 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a760a4-0c61-4571-89f3-0deab710c5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:55.530196 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a760a4-0c61-4571-89f3-0deab710c5a4 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:55.530494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a760a4-0c61-4571-89f3-0deab710c5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:55.530753 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a760a4-0c61-4571-89f3-0deab710c5a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:55.531482 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a760a4-0c61-4571-89f3-0deab710c5a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:55.531785 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a760a4-0c61-4571-89f3-0deab710c5a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:55.533222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a760a4-0c61-4571-89f3-0deab710c5a4 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:55.550036 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 75/150] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:17:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:55.559531 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a760a4-0c61-4571-89f3-0deab710c5a4 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:55.621057 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:55.661437 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b798a0a-e43d-474c-ac3e-95443b8f23e1 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:55.736756 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84512c-f54d-450d-9c8a-050675daf8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:55.737480 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84512c-f54d-450d-9c8a-050675daf8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:55.737773 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84512c-f54d-450d-9c8a-050675daf8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:55.738073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84512c-f54d-450d-9c8a-050675daf8d9 None admin] PATH_INFO: `/v3/projects/c68abb6013ea44fb9fad2c8141d11c05` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:55.739443 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84512c-f54d-450d-9c8a-050675daf8d9 None admin] RBAC: Authorizing `identity:get_project(project_id=c68abb6013ea44fb9fad2c8141d11c05)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:55.741047 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84512c-f54d-450d-9c8a-050675daf8d9 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:55.742951 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 76/151] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:17:55 2022] GET /identity/v3/projects/c68abb6013ea44fb9fad2c8141d11c05 => generated 298 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:55.748939 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84512c-f54d-450d-9c8a-050675daf8d9 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:55.797130 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a760a4-0c61-4571-89f3-0deab710c5a4 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:55.857768 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c41e9-6e2a-47a6-9741-fb5661037a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:55.858657 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c41e9-6e2a-47a6-9741-fb5661037a59 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:55.859019 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c41e9-6e2a-47a6-9741-fb5661037a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:55.859393 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c41e9-6e2a-47a6-9741-fb5661037a59 None admin] PATH_INFO: `/v3/users/c4eb360b9ada4b8e844014dd4b1c95a3` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:55.860809 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c41e9-6e2a-47a6-9741-fb5661037a59 None admin] RBAC: Authorizing `identity:get_user(user_id=c4eb360b9ada4b8e844014dd4b1c95a3)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:55.862533 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c41e9-6e2a-47a6-9741-fb5661037a59 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:55.864759 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 76/152] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:17:55 2022] GET /identity/v3/users/c4eb360b9ada4b8e844014dd4b1c95a3 => generated 275 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:17:55.870039 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c41e9-6e2a-47a6-9741-fb5661037a59 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:55.915418 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:55.944648 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84512c-f54d-450d-9c8a-050675daf8d9 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:55.991656 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f958b51-a814-40bd-b89d-4432ce8dca5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:55.992895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f958b51-a814-40bd-b89d-4432ce8dca5e None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:55.993444 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f958b51-a814-40bd-b89d-4432ce8dca5e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:55.993913 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f958b51-a814-40bd-b89d-4432ce8dca5e None admin] PATH_INFO: `/v3/projects/c68abb6013ea44fb9fad2c8141d11c05/users/6feddfade28345748a6d467f0c2d725b/roles/f889fef4a0c74c31a7942ec629ccf0ed` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:55.996894 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f958b51-a814-40bd-b89d-4432ce8dca5e None admin] RBAC: Authorizing `identity:create_grant(project_id=c68abb6013ea44fb9fad2c8141d11c05, user_id=6feddfade28345748a6d467f0c2d725b, role_id=f889fef4a0c74c31a7942ec629ccf0ed)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:55.999179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f958b51-a814-40bd-b89d-4432ce8dca5e None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:56.022541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 77/153] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Oct 4 16:17:55 2022] PUT /identity/v3/projects/c68abb6013ea44fb9fad2c8141d11c05/users/6feddfade28345748a6d467f0c2d725b/roles/f889fef4a0c74c31a7942ec629ccf0ed => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:17:56.074158 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c41e9-6e2a-47a6-9741-fb5661037a59 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:56.136533 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028ac8e-7bac-4a07-94cf-f7b1df7b6774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:56.137724 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028ac8e-7bac-4a07-94cf-f7b1df7b6774 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:56.138277 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028ac8e-7bac-4a07-94cf-f7b1df7b6774 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:56.138869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028ac8e-7bac-4a07-94cf-f7b1df7b6774 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:56.236931 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028ac8e-7bac-4a07-94cf-f7b1df7b6774 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:56.239061 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028ac8e-7bac-4a07-94cf-f7b1df7b6774 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:56.248254 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f2ce1-4813-4a5f-a02f-be54efb846f5 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:56.248970 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f2ce1-4813-4a5f-a02f-be54efb846f5 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:56.249576 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f2ce1-4813-4a5f-a02f-be54efb846f5 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:56.251410 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 78/154] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:17:56.257297 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a042b8-339c-4fc4-94e6-32109065d3b7 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:56.257962 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a042b8-339c-4fc4-94e6-32109065d3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:56.258476 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a042b8-339c-4fc4-94e6-32109065d3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:56.286638 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-43a042b8-339c-4fc4-94e6-32109065d3b7 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:56.287941 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-43a042b8-339c-4fc4-94e6-32109065d3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:56.302557 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:56.306817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:56.396054 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 79/155] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 16:17:56.397425 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016030fa-4902-4111-970c-f72e1a782bbc None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:56.397712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016030fa-4902-4111-970c-f72e1a782bbc None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:56.397977 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016030fa-4902-4111-970c-f72e1a782bbc None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:56.403015 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 80/156] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:17:56.405321 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe4411-de1c-486b-a2c8-55b73f02b85b None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:56.405596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe4411-de1c-486b-a2c8-55b73f02b85b None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:56.405861 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe4411-de1c-486b-a2c8-55b73f02b85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:56.425454 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-5cbe4411-de1c-486b-a2c8-55b73f02b85b None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:56.426742 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-5cbe4411-de1c-486b-a2c8-55b73f02b85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:56.438035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 77/157] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:17:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:17:56.444891 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028ac8e-7bac-4a07-94cf-f7b1df7b6774 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:56.504704 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 81/158] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:17:56.606159 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028ac8e-7bac-4a07-94cf-f7b1df7b6774 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:56.639138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:56.651359 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a81c7a-4b7f-4d03-b437-2afe66466403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:56.652280 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a81c7a-4b7f-4d03-b437-2afe66466403 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:56.652461 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a81c7a-4b7f-4d03-b437-2afe66466403 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:56.652688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a81c7a-4b7f-4d03-b437-2afe66466403 None admin] PATH_INFO: `/v3/projects/c68abb6013ea44fb9fad2c8141d11c05` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:56.653892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a81c7a-4b7f-4d03-b437-2afe66466403 None admin] RBAC: Authorizing `identity:get_project(project_id=c68abb6013ea44fb9fad2c8141d11c05)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:56.654556 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ef794-6b17-417a-942c-61dce9d5a0f4 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:56.655077 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ef794-6b17-417a-942c-61dce9d5a0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:56.655513 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a81c7a-4b7f-4d03-b437-2afe66466403 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:56.655835 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ef794-6b17-417a-942c-61dce9d5a0f4 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:56.657221 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 78/159] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:17:56 2022] GET /identity/v3/projects/c68abb6013ea44fb9fad2c8141d11c05 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:17:56.661702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 82/160] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:17:56.667003 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a81c7a-4b7f-4d03-b437-2afe66466403 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:56.674737 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693bdd2-dad2-4700-a36b-4574d8f0f0af None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:56.675115 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693bdd2-dad2-4700-a36b-4574d8f0f0af None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:56.675439 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693bdd2-dad2-4700-a36b-4574d8f0f0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:56.707980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-c693bdd2-dad2-4700-a36b-4574d8f0f0af None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:17:56.709662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-c693bdd2-dad2-4700-a36b-4574d8f0f0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:17:56.795770 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 83/161] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 16:17:56.815419 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a81c7a-4b7f-4d03-b437-2afe66466403 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:56.861268 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506efd4b-9b92-44f2-9a14-fbd731859810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:56.862701 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506efd4b-9b92-44f2-9a14-fbd731859810 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:56.863199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506efd4b-9b92-44f2-9a14-fbd731859810 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:56.863653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506efd4b-9b92-44f2-9a14-fbd731859810 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:56.864588 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506efd4b-9b92-44f2-9a14-fbd731859810 None admin] RBAC: Adding query filter params (role.id=5cf61f379b4d49cb9e19605796d13f62, scope.project.id=c68abb6013ea44fb9fad2c8141d11c05, user.id=c4eb360b9ada4b8e844014dd4b1c95a3) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:56.865086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506efd4b-9b92-44f2-9a14-fbd731859810 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:56.866795 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506efd4b-9b92-44f2-9a14-fbd731859810 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:56.880448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 79/162] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:17:56 2022] GET /identity/v3/role_assignments?user.id=c4eb360b9ada4b8e844014dd4b1c95a3&scope.project.id=c68abb6013ea44fb9fad2c8141d11c05&role.id=5cf61f379b4d49cb9e19605796d13f62 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:56.905766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693bdd2-dad2-4700-a36b-4574d8f0f0af None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:56.910098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:56.966332 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506efd4b-9b92-44f2-9a14-fbd731859810 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:57.038923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693bdd2-dad2-4700-a36b-4574d8f0f0af None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:57.081693 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e992712-8c7c-4c56-82a0-efceadc0cc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:57.082429 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e992712-8c7c-4c56-82a0-efceadc0cc9f None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:57.082707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e992712-8c7c-4c56-82a0-efceadc0cc9f None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:57.082976 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e992712-8c7c-4c56-82a0-efceadc0cc9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:57.095986 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e992712-8c7c-4c56-82a0-efceadc0cc9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:17:57.097441 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:57.103616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-3e992712-8c7c-4c56-82a0-efceadc0cc9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:17:57.103616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:17:57.103616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:17:57.103616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:17:57.103616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:17:57.103616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:17:57.103616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:17:57.103616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:17:57.103616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:17:57.103616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:17:57.103616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:17:57.103616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:17:57.103616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:17:57.103616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:17:57.103616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:17:57.103616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:17:57.104694 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:17:57.104694 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:17:57.104694 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:17:57.104694 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:17:57.104694 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:17:57.104694 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:17:57.104694 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:17:57.104694 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:17:57.104694 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:17:57.104694 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:17:57.104694 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:17:57.104694 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:17:57.104694 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:17:57.104694 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:17:57.104694 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:17:57.104694 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:17:57.105770 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:17:57.105770 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:17:57.105770 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:17:57.105770 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:17:57.105770 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:17:57.105770 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:17:57.105770 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:17:57.105770 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:17:57.105770 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:17:57.105770 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:17:57.105770 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:17:57.105770 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:17:57.107795 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 84/163] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:17:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:17:57.114084 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e992712-8c7c-4c56-82a0-efceadc0cc9f None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:57.185862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506efd4b-9b92-44f2-9a14-fbd731859810 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:57.241833 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:57.272634 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e992712-8c7c-4c56-82a0-efceadc0cc9f None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:57.275307 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae5bcc-64d1-461c-a0ee-f139f5886068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:57.276046 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae5bcc-64d1-461c-a0ee-f139f5886068 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:57.276327 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae5bcc-64d1-461c-a0ee-f139f5886068 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:57.276601 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae5bcc-64d1-461c-a0ee-f139f5886068 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:57.311995 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae5bcc-64d1-461c-a0ee-f139f5886068 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:17:57.320047 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-efae5bcc-64d1-461c-a0ee-f139f5886068 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:17:57.320047 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:17:57.320047 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:17:57.320047 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:17:57.320047 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:17:57.320047 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:17:57.320047 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:17:57.320047 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:17:57.320047 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:17:57.320047 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:17:57.320047 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:17:57.320047 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:17:57.320047 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:17:57.320047 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:17:57.320047 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:17:57.320047 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:17:57.320970 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:17:57.320970 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:17:57.320970 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:17:57.320970 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:17:57.320970 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:17:57.320970 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:17:57.320970 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:17:57.320970 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:17:57.320970 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:17:57.320970 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:17:57.320970 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:17:57.320970 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:17:57.320970 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:17:57.320970 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:17:57.320970 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:17:57.320970 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:17:57.321906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:17:57.321906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:17:57.321906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:17:57.321906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:17:57.321906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:17:57.321906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:17:57.321906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:17:57.321906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:17:57.321906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:17:57.321906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:17:57.321906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:17:57.321906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:17:57.321906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 80/164] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:17:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:17:57.325488 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153324f5-d185-46cf-8c9d-28e8efab0461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:57.326220 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153324f5-d185-46cf-8c9d-28e8efab0461 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:57.327888 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae5bcc-64d1-461c-a0ee-f139f5886068 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:57.328352 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153324f5-d185-46cf-8c9d-28e8efab0461 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:57.328661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153324f5-d185-46cf-8c9d-28e8efab0461 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:57.329444 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153324f5-d185-46cf-8c9d-28e8efab0461 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:57.329798 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153324f5-d185-46cf-8c9d-28e8efab0461 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:57.335789 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153324f5-d185-46cf-8c9d-28e8efab0461 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:57.353125 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 85/165] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:17:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:17:57.359626 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153324f5-d185-46cf-8c9d-28e8efab0461 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:57.562259 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae5bcc-64d1-461c-a0ee-f139f5886068 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:57.592307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153324f5-d185-46cf-8c9d-28e8efab0461 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:57.597720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:57.627771 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:57.628687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343db31-a178-4b2b-92eb-952b236b9e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:57.629548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343db31-a178-4b2b-92eb-952b236b9e43 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:57.630036 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343db31-a178-4b2b-92eb-952b236b9e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:57.630278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343db31-a178-4b2b-92eb-952b236b9e43 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:57.631068 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343db31-a178-4b2b-92eb-952b236b9e43 None admin] RBAC: Adding query filter params (name=member) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:57.631507 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343db31-a178-4b2b-92eb-952b236b9e43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:57.632924 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343db31-a178-4b2b-92eb-952b236b9e43 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:57.636921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99859262-a231-44fa-8485-1932c3719056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:57.637577 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99859262-a231-44fa-8485-1932c3719056 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:57.637852 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99859262-a231-44fa-8485-1932c3719056 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:57.638122 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99859262-a231-44fa-8485-1932c3719056 None admin] PATH_INFO: `/v3/users/f4a141c4b1594c35992b7b147f7c2904` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:57.639298 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99859262-a231-44fa-8485-1932c3719056 None admin] RBAC: Authorizing `identity:get_user(user_id=f4a141c4b1594c35992b7b147f7c2904)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:57.641863 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99859262-a231-44fa-8485-1932c3719056 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:57.643530 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 86/166] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:17:57 2022] GET /identity/v3/users/f4a141c4b1594c35992b7b147f7c2904 => generated 247 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:57.644845 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99859262-a231-44fa-8485-1932c3719056 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:57.656006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 81/167] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:17:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:57.656954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343db31-a178-4b2b-92eb-952b236b9e43 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:57.885147 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99859262-a231-44fa-8485-1932c3719056 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:57.901669 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343db31-a178-4b2b-92eb-952b236b9e43 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:57.964972 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d913ac-d222-4ec8-b597-29f5d0c17c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:57.965604 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d913ac-d222-4ec8-b597-29f5d0c17c62 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:57.965888 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d913ac-d222-4ec8-b597-29f5d0c17c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:57.966157 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d913ac-d222-4ec8-b597-29f5d0c17c62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:58.011719 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf330fe-a0cc-4803-81aa-8bf904121c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:58.012496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf330fe-a0cc-4803-81aa-8bf904121c47 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:58.012780 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf330fe-a0cc-4803-81aa-8bf904121c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:58.013054 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf330fe-a0cc-4803-81aa-8bf904121c47 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:58.041384 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf330fe-a0cc-4803-81aa-8bf904121c47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:17:58.050625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-bcf330fe-a0cc-4803-81aa-8bf904121c47 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 16:17:58.050625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:17:58.050625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:17:58.050625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:17:58.050625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:17:58.050625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:17:58.050625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:17:58.050625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:17:58.050625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:17:58.050625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:17:58.050625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:17:58.050625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:17:58.050625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:17:58.050625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:17:58.050625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:17:58.050625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:17:58.051736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:17:58.051736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:17:58.051736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:17:58.051736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:17:58.051736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:17:58.051736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:17:58.051736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:17:58.051736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:17:58.051736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:17:58.051736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:17:58.051736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:17:58.051736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:17:58.051736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:17:58.051736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:17:58.051736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:17:58.051736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:17:58.052524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:17:58.052524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:17:58.052524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:17:58.052524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:17:58.052524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:17:58.052524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:17:58.052524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:17:58.052524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:17:58.052524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:17:58.052524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:17:58.052524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 16:17:58.052524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:17:58.056310 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 87/168] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Oct 4 16:17:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:17:58.057246 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf330fe-a0cc-4803-81aa-8bf904121c47 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:58.080665 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:58.137892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d913ac-d222-4ec8-b597-29f5d0c17c62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:58.139562 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d913ac-d222-4ec8-b597-29f5d0c17c62 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:58.164682 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:58.255397 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf330fe-a0cc-4803-81aa-8bf904121c47 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:58.338280 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04783195-0112-45e0-8092-fd47a383ba2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:58.338944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04783195-0112-45e0-8092-fd47a383ba2d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:58.339249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04783195-0112-45e0-8092-fd47a383ba2d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:58.339524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04783195-0112-45e0-8092-fd47a383ba2d None admin] PATH_INFO: `/v3/users/c4eb360b9ada4b8e844014dd4b1c95a3` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:58.342151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04783195-0112-45e0-8092-fd47a383ba2d None admin] RBAC: Authorizing `identity:get_user(user_id=c4eb360b9ada4b8e844014dd4b1c95a3)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:58.347749 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04783195-0112-45e0-8092-fd47a383ba2d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:58.349839 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 88/169] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:17:58 2022] GET /identity/v3/users/c4eb360b9ada4b8e844014dd4b1c95a3 => generated 275 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:58.351349 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04783195-0112-45e0-8092-fd47a383ba2d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:58.411839 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 82/170] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:17:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 755 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:17:58.412659 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d913ac-d222-4ec8-b597-29f5d0c17c62 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:58.552180 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04783195-0112-45e0-8092-fd47a383ba2d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:58.577274 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:58.615612 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:58.632989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d913ac-d222-4ec8-b597-29f5d0c17c62 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:58.650099 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6532e96-d342-4671-ba70-1d3ad4863198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:58.650729 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6532e96-d342-4671-ba70-1d3ad4863198 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:58.651032 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6532e96-d342-4671-ba70-1d3ad4863198 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:58.651295 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6532e96-d342-4671-ba70-1d3ad4863198 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:58.651972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6532e96-d342-4671-ba70-1d3ad4863198 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:58.652323 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6532e96-d342-4671-ba70-1d3ad4863198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:58.653727 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6532e96-d342-4671-ba70-1d3ad4863198 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:58.674415 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 89/171] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:17:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:58.675372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6532e96-d342-4671-ba70-1d3ad4863198 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:58.714335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c16df-a769-47bd-9cc6-a95cad40230d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:58.715404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c16df-a769-47bd-9cc6-a95cad40230d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:58.715892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c16df-a769-47bd-9cc6-a95cad40230d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:58.716355 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c16df-a769-47bd-9cc6-a95cad40230d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:58.848809 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6532e96-d342-4671-ba70-1d3ad4863198 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:58.909385 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c16df-a769-47bd-9cc6-a95cad40230d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:58.910902 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c16df-a769-47bd-9cc6-a95cad40230d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:58.919706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916d538-95cd-4748-965a-f0f8c0bfa0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:58.920703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916d538-95cd-4748-965a-f0f8c0bfa0ad None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:58.920975 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916d538-95cd-4748-965a-f0f8c0bfa0ad None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:58.921239 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916d538-95cd-4748-965a-f0f8c0bfa0ad None admin] PATH_INFO: `/v3/projects/c68abb6013ea44fb9fad2c8141d11c05` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:58.922444 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916d538-95cd-4748-965a-f0f8c0bfa0ad None admin] RBAC: Authorizing `identity:get_project(project_id=c68abb6013ea44fb9fad2c8141d11c05)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:58.924025 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916d538-95cd-4748-965a-f0f8c0bfa0ad None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:58.925744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 90/172] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:17:58 2022] GET /identity/v3/projects/c68abb6013ea44fb9fad2c8141d11c05 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:58.927414 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916d538-95cd-4748-965a-f0f8c0bfa0ad None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:59.038598 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:59.070497 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:59.133847 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 83/173] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:17:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:17:59.134963 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c16df-a769-47bd-9cc6-a95cad40230d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:59.138836 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916d538-95cd-4748-965a-f0f8c0bfa0ad None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:59.277118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607280ee-542c-4cee-b5a5-6b704deb4f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:59.277870 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607280ee-542c-4cee-b5a5-6b704deb4f7e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:59.278155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607280ee-542c-4cee-b5a5-6b704deb4f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:59.278432 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607280ee-542c-4cee-b5a5-6b704deb4f7e None admin] PATH_INFO: `/v3/users/c4eb360b9ada4b8e844014dd4b1c95a3` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:59.283004 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607280ee-542c-4cee-b5a5-6b704deb4f7e None admin] RBAC: Authorizing `identity:get_user(user_id=c4eb360b9ada4b8e844014dd4b1c95a3)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:59.283004 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607280ee-542c-4cee-b5a5-6b704deb4f7e None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:59.293180 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 91/174] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:17:58 2022] GET /identity/v3/users/c4eb360b9ada4b8e844014dd4b1c95a3 => generated 275 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:59.294004 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607280ee-542c-4cee-b5a5-6b704deb4f7e None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:59.477952 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c16df-a769-47bd-9cc6-a95cad40230d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:59.611175 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddee264-f014-4ba6-962d-e9b003f65bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:59.613022 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddee264-f014-4ba6-962d-e9b003f65bae None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:59.613977 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddee264-f014-4ba6-962d-e9b003f65bae None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:59.614499 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddee264-f014-4ba6-962d-e9b003f65bae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:59.615516 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddee264-f014-4ba6-962d-e9b003f65bae None admin] RBAC: Adding query filter params (role.id=066f46534195417295e63a5316632eae, scope.project.id=c68abb6013ea44fb9fad2c8141d11c05, user.id=f4a141c4b1594c35992b7b147f7c2904) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:17:59.616090 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddee264-f014-4ba6-962d-e9b003f65bae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:59.617880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddee264-f014-4ba6-962d-e9b003f65bae None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:59.627677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 84/175] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:17:59 2022] GET /identity/v3/role_assignments?user.id=f4a141c4b1594c35992b7b147f7c2904&scope.project.id=c68abb6013ea44fb9fad2c8141d11c05&role.id=066f46534195417295e63a5316632eae => generated 608 bytes in 493 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:59.637753 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddee264-f014-4ba6-962d-e9b003f65bae None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:59.661370 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607280ee-542c-4cee-b5a5-6b704deb4f7e None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:17:59.706033 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:59.769482 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826770f-9f08-4838-ba2b-4f130aa09b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:17:59.770222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826770f-9f08-4838-ba2b-4f130aa09b54 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:59.770505 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826770f-9f08-4838-ba2b-4f130aa09b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:59.770775 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826770f-9f08-4838-ba2b-4f130aa09b54 None admin] PATH_INFO: `/v3/projects/9ce53771b739482fa66fe777d7fd600c` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:59.773944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826770f-9f08-4838-ba2b-4f130aa09b54 None admin] RBAC: Authorizing `identity:get_project(project_id=9ce53771b739482fa66fe777d7fd600c)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:17:59.775485 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826770f-9f08-4838-ba2b-4f130aa09b54 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:17:59.777364 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 92/176] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:17:59 2022] GET /identity/v3/projects/9ce53771b739482fa66fe777d7fd600c => generated 312 bytes in 484 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:17:59.778619 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79320c-f377-4cea-ac37-5537d0446520 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:59.778901 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79320c-f377-4cea-ac37-5537d0446520 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:59.783729 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79320c-f377-4cea-ac37-5537d0446520 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:59.784282 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:17:59.785752 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 93/177] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:17:59.786939 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c29769-bc0d-4be8-af94-63491a420441 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:17:59.808211 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c29769-bc0d-4be8-af94-63491a420441 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:17:59.808752 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c29769-bc0d-4be8-af94-63491a420441 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:17:59.810301 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 94/178] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:17:59 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:17:59.826897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c29769-bc0d-4be8-af94-63491a420441 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:17:59.989021 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddee264-f014-4ba6-962d-e9b003f65bae None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:00.046238 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c29769-bc0d-4be8-af94-63491a420441 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:00.062293 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197efd4-85dd-47ff-8a9f-b468401229da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:00.063108 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197efd4-85dd-47ff-8a9f-b468401229da None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:00.063732 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197efd4-85dd-47ff-8a9f-b468401229da None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:00.064229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197efd4-85dd-47ff-8a9f-b468401229da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:00.094615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eeccf9-11d8-4706-bcc9-d7737310ab7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:00.095750 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eeccf9-11d8-4706-bcc9-d7737310ab7e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:00.096374 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eeccf9-11d8-4706-bcc9-d7737310ab7e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:00.096948 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eeccf9-11d8-4706-bcc9-d7737310ab7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:00.098147 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eeccf9-11d8-4706-bcc9-d7737310ab7e None admin] RBAC: Adding query filter params (role.id=5cf61f379b4d49cb9e19605796d13f62, scope.project.id=9ce53771b739482fa66fe777d7fd600c, user.id=c4eb360b9ada4b8e844014dd4b1c95a3) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:00.098684 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eeccf9-11d8-4706-bcc9-d7737310ab7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:00.100957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eeccf9-11d8-4706-bcc9-d7737310ab7e None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:00.110111 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 95/179] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:17:59 2022] GET /identity/v3/role_assignments?user.id=c4eb360b9ada4b8e844014dd4b1c95a3&scope.project.id=9ce53771b739482fa66fe777d7fd600c&role.id=5cf61f379b4d49cb9e19605796d13f62 => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:00.111817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab55c58-7657-4fb5-a87a-b99a5a37547d None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:00.112100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab55c58-7657-4fb5-a87a-b99a5a37547d None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:00.112367 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab55c58-7657-4fb5-a87a-b99a5a37547d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:00.132889 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-7ab55c58-7657-4fb5-a87a-b99a5a37547d None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:00.134485 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-7ab55c58-7657-4fb5-a87a-b99a5a37547d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:00.175746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197efd4-85dd-47ff-8a9f-b468401229da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:00.177857 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197efd4-85dd-47ff-8a9f-b468401229da None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:00.207554 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:00.216248 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 96/180] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:00.219193 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e9a4a-a3e8-4d1e-9847-f30392fe4713 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:00.219554 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e9a4a-a3e8-4d1e-9847-f30392fe4713 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:00.219862 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e9a4a-a3e8-4d1e-9847-f30392fe4713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:00.243462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-304e9a4a-a3e8-4d1e-9847-f30392fe4713 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:00.244596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-304e9a4a-a3e8-4d1e-9847-f30392fe4713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:00.253151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:00.331015 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 97/181] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:00.332748 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67752edf-8e21-4a4d-be48-4f3fa0604ae4 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:00.333049 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67752edf-8e21-4a4d-be48-4f3fa0604ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:00.333325 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67752edf-8e21-4a4d-be48-4f3fa0604ae4 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:00.334607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 98/182] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:00.335960 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78415e60-1fd9-4d06-b804-b899165e6e0b None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:00.336206 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78415e60-1fd9-4d06-b804-b899165e6e0b None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:00.336471 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78415e60-1fd9-4d06-b804-b899165e6e0b None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:00.338085 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 99/183] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:00.344650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cee245-f639-4636-8df8-357aee22a2f8 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:00.344988 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cee245-f639-4636-8df8-357aee22a2f8 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:00.345247 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cee245-f639-4636-8df8-357aee22a2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:00.367590 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-37cee245-f639-4636-8df8-357aee22a2f8 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:00.369093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-37cee245-f639-4636-8df8-357aee22a2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:00.374472 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 85/184] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:17:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 738 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:18:00.376832 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5985c-5c22-4b87-844a-c6f13109503b None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:00.378285 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5985c-5c22-4b87-844a-c6f13109503b None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:00.379045 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5985c-5c22-4b87-844a-c6f13109503b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:00.408789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-00c5985c-5c22-4b87-844a-c6f13109503b None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:00.410793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-00c5985c-5c22-4b87-844a-c6f13109503b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:00.461757 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 100/185] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:00.462660 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cee245-f639-4636-8df8-357aee22a2f8 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:00.524259 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 86/186] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:00.538927 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:00.559409 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5985c-5c22-4b87-844a-c6f13109503b None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:00.640678 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cee245-f639-4636-8df8-357aee22a2f8 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:00.667917 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:00.697961 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c72bb1-079d-4116-a971-60a12661aeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:00.698890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c72bb1-079d-4116-a971-60a12661aeb9 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:00.699252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c72bb1-079d-4116-a971-60a12661aeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:00.699583 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c72bb1-079d-4116-a971-60a12661aeb9 None admin] PATH_INFO: `/v3/projects/c68abb6013ea44fb9fad2c8141d11c05` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:00.700985 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c72bb1-079d-4116-a971-60a12661aeb9 None admin] RBAC: Authorizing `identity:get_project(project_id=c68abb6013ea44fb9fad2c8141d11c05)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:00.702448 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c72bb1-079d-4116-a971-60a12661aeb9 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:00.703684 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5985c-5c22-4b87-844a-c6f13109503b None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:00.704744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 101/187] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:00 2022] GET /identity/v3/projects/c68abb6013ea44fb9fad2c8141d11c05 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:00.707631 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c72bb1-079d-4116-a971-60a12661aeb9 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:00.765352 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcce85a-5e7b-451a-be87-83ffe385c840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:00.766036 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcce85a-5e7b-451a-be87-83ffe385c840 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:00.766325 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcce85a-5e7b-451a-be87-83ffe385c840 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:00.766597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcce85a-5e7b-451a-be87-83ffe385c840 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:00.778226 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcce85a-5e7b-451a-be87-83ffe385c840 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:00.783653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-5bcce85a-5e7b-451a-be87-83ffe385c840 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:18:00.783653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:00.783653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:00.783653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:00.783653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:00.783653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:00.783653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:00.783653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:00.783653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:00.783653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:00.783653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:00.783653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:00.783653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:00.783653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:00.783653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:00.783653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:00.784515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:00.784515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:00.784515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:00.784515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:00.784515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:00.784515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:00.784515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:00.784515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:00.784515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:00.784515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:00.784515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:00.784515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:00.784515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:00.784515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:00.784515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:00.784515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:00.785897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:00.785897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:00.785897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:00.785897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:00.785897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:00.785897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:00.785897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:00.785897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:00.785897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:00.785897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:00.785897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:18:00.785897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:00.785897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 87/188] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:18:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:18:00.785897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcce85a-5e7b-451a-be87-83ffe385c840 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:00.833305 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c72bb1-079d-4116-a971-60a12661aeb9 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:00.844912 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:00.872944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79373913-17a4-4a25-a142-9f3a63bd7db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:00.873748 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79373913-17a4-4a25-a142-9f3a63bd7db6 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:00.874081 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79373913-17a4-4a25-a142-9f3a63bd7db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:00.874405 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79373913-17a4-4a25-a142-9f3a63bd7db6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:00.886711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79373913-17a4-4a25-a142-9f3a63bd7db6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:00.892618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-79373913-17a4-4a25-a142-9f3a63bd7db6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 16:18:00.892618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:00.892618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:00.892618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:00.892618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:00.892618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:00.892618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:00.892618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:00.892618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:00.892618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:00.892618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:00.892618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:00.892618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:00.892618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:00.892618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:00.892618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:00.893692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:00.893692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:00.893692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:00.893692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:00.893692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:00.893692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:00.893692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:00.893692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:00.893692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:00.893692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:00.893692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:00.893692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:00.893692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:00.893692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:00.893692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:00.893692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:00.894703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:00.894703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:00.894703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:00.894703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:00.894703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:00.894703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:00.894703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:00.894703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:00.894703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:00.894703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:00.894703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 16:18:00.894703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:00.894703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 102/189] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:00.895478 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79373913-17a4-4a25-a142-9f3a63bd7db6 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:00.909484 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcce85a-5e7b-451a-be87-83ffe385c840 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:00.940918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:00.950775 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea3eac-f499-4e42-a21a-41d0f57bdb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:00.951818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea3eac-f499-4e42-a21a-41d0f57bdb79 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:00.952164 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea3eac-f499-4e42-a21a-41d0f57bdb79 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:00.952438 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea3eac-f499-4e42-a21a-41d0f57bdb79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:00.953244 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea3eac-f499-4e42-a21a-41d0f57bdb79 None admin] RBAC: Adding query filter params (role.id=2497938af8354a00a7e4ec59ad8b9582, scope.project.id=c68abb6013ea44fb9fad2c8141d11c05, user.id=c4eb360b9ada4b8e844014dd4b1c95a3) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:00.953605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea3eac-f499-4e42-a21a-41d0f57bdb79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:00.955306 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea3eac-f499-4e42-a21a-41d0f57bdb79 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:00.961924 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 88/190] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:18:00 2022] GET /identity/v3/role_assignments?user.id=c4eb360b9ada4b8e844014dd4b1c95a3&scope.project.id=c68abb6013ea44fb9fad2c8141d11c05&role.id=2497938af8354a00a7e4ec59ad8b9582 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:00.962971 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea3eac-f499-4e42-a21a-41d0f57bdb79 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:01.026051 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79373913-17a4-4a25-a142-9f3a63bd7db6 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:01.067238 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00837b6b-5347-4235-b704-f66680ad79f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:01.067887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00837b6b-5347-4235-b704-f66680ad79f7 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:01.068307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00837b6b-5347-4235-b704-f66680ad79f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:01.068415 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00837b6b-5347-4235-b704-f66680ad79f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:01.069077 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00837b6b-5347-4235-b704-f66680ad79f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:01.069374 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00837b6b-5347-4235-b704-f66680ad79f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:01.070796 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00837b6b-5347-4235-b704-f66680ad79f7 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:01.079877 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 103/191] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:01.080764 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00837b6b-5347-4235-b704-f66680ad79f7 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:01.093604 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea3eac-f499-4e42-a21a-41d0f57bdb79 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:01.121197 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:01.142669 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb8165-5b02-4fd2-adc8-7110c801a1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:01.143357 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb8165-5b02-4fd2-adc8-7110c801a1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:01.143749 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb8165-5b02-4fd2-adc8-7110c801a1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:01.144004 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb8165-5b02-4fd2-adc8-7110c801a1a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:01.151283 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb8165-5b02-4fd2-adc8-7110c801a1a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:01.152513 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb8165-5b02-4fd2-adc8-7110c801a1a9 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:01.154237 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 89/192] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:01.155126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb8165-5b02-4fd2-adc8-7110c801a1a9 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:01.220169 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00837b6b-5347-4235-b704-f66680ad79f7 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:01.235551 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:01.266735 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66114f41-8f6e-4717-ac8f-8ddb4333d1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:01.267406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66114f41-8f6e-4717-ac8f-8ddb4333d1a6 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:01.267683 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66114f41-8f6e-4717-ac8f-8ddb4333d1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:01.267953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66114f41-8f6e-4717-ac8f-8ddb4333d1a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:01.279106 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66114f41-8f6e-4717-ac8f-8ddb4333d1a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:01.280239 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb8165-5b02-4fd2-adc8-7110c801a1a9 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:01.284484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-66114f41-8f6e-4717-ac8f-8ddb4333d1a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 16:18:01.284484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:01.284484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:01.284484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:01.284484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:01.284484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:01.284484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:01.284484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:01.284484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:01.284484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:01.284484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:01.284484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:01.284484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:01.284484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:01.284484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:01.284484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:01.285592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:01.285592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:01.285592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:01.285592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:01.285592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:01.285592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:01.285592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:01.285592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:01.285592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:01.285592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:01.285592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:01.285592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:01.285592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:01.285592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:01.285592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:01.285592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:01.286615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:01.286615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:01.286615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:01.286615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:01.286615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:01.286615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:01.286615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:01.286615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:01.286615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:01.286615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:01.286615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 16:18:01.286615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:01.286615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 104/193] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Oct 4 16:18:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:01.286615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66114f41-8f6e-4717-ac8f-8ddb4333d1a6 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:01.318876 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eef476-7093-4b48-bab0-a48dce2f8b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:01.319474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eef476-7093-4b48-bab0-a48dce2f8b03 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:01.319801 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eef476-7093-4b48-bab0-a48dce2f8b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:01.320070 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eef476-7093-4b48-bab0-a48dce2f8b03 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:01.320801 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eef476-7093-4b48-bab0-a48dce2f8b03 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:01.321144 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eef476-7093-4b48-bab0-a48dce2f8b03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:01.322663 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eef476-7093-4b48-bab0-a48dce2f8b03 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:01.332346 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 90/194] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:18:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:01.332944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eef476-7093-4b48-bab0-a48dce2f8b03 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:01.379759 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:01.389172 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66114f41-8f6e-4717-ac8f-8ddb4333d1a6 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:01.426425 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd980c-3165-4874-9694-fee91a03744e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:01.427148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd980c-3165-4874-9694-fee91a03744e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:01.427465 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd980c-3165-4874-9694-fee91a03744e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:01.427738 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd980c-3165-4874-9694-fee91a03744e None admin] PATH_INFO: `/v3/users/79c393fc188844fabea676bb2b03e0cc` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:01.444382 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd980c-3165-4874-9694-fee91a03744e None admin] RBAC: Authorizing `identity:get_user(user_id=79c393fc188844fabea676bb2b03e0cc)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:01.445962 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd980c-3165-4874-9694-fee91a03744e None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:01.447865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 105/195] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:18:01 2022] GET /identity/v3/users/79c393fc188844fabea676bb2b03e0cc => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:01.448537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eef476-7093-4b48-bab0-a48dce2f8b03 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:01.448713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd980c-3165-4874-9694-fee91a03744e None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:01.475647 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:01.488259 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a99fb-f1e6-4759-ab65-b9a560f83792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:01.488969 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a99fb-f1e6-4759-ab65-b9a560f83792 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:01.489315 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a99fb-f1e6-4759-ab65-b9a560f83792 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:01.489587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a99fb-f1e6-4759-ab65-b9a560f83792 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:01.490326 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a99fb-f1e6-4759-ab65-b9a560f83792 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:01.492035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a99fb-f1e6-4759-ab65-b9a560f83792 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:01.516989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 91/196] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Oct 4 16:18:01 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:18:01.524185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a99fb-f1e6-4759-ab65-b9a560f83792 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:01.569204 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd980c-3165-4874-9694-fee91a03744e None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:01.621872 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ca26a-30de-40b1-84a4-636d18585c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:01.622923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ca26a-30de-40b1-84a4-636d18585c13 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:01.623497 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ca26a-30de-40b1-84a4-636d18585c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:01.624018 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ca26a-30de-40b1-84a4-636d18585c13 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:01.624908 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ca26a-30de-40b1-84a4-636d18585c13 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:01.625429 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ca26a-30de-40b1-84a4-636d18585c13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:01.627084 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ca26a-30de-40b1-84a4-636d18585c13 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:01.638210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 106/197] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:18:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:01.639880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ca26a-30de-40b1-84a4-636d18585c13 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:01.661881 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:01.667592 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a99fb-f1e6-4759-ab65-b9a560f83792 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:01.712115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc30fe0-be4e-4951-ab8f-653a70a7cc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:01.712810 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc30fe0-be4e-4951-ab8f-653a70a7cc8f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:01.713094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc30fe0-be4e-4951-ab8f-653a70a7cc8f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:01.713391 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc30fe0-be4e-4951-ab8f-653a70a7cc8f None admin] PATH_INFO: `/v3/users/6feddfade28345748a6d467f0c2d725b` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:01.715144 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc30fe0-be4e-4951-ab8f-653a70a7cc8f None admin] RBAC: Authorizing `identity:get_user(user_id=6feddfade28345748a6d467f0c2d725b)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:01.716356 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc30fe0-be4e-4951-ab8f-653a70a7cc8f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:01.718161 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 92/198] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:18:01 2022] GET /identity/v3/users/6feddfade28345748a6d467f0c2d725b => generated 289 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:01.719030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc30fe0-be4e-4951-ab8f-653a70a7cc8f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:01.773977 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ca26a-30de-40b1-84a4-636d18585c13 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:01.778720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:01.820633 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00458c9c-a9ef-447e-a92a-51af3eb34d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:01.820633 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00458c9c-a9ef-447e-a92a-51af3eb34d77 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:01.820896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00458c9c-a9ef-447e-a92a-51af3eb34d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:01.821132 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00458c9c-a9ef-447e-a92a-51af3eb34d77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:01.856817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc30fe0-be4e-4951-ab8f-653a70a7cc8f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:01.900111 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab5e61-4cfa-4a09-ae50-fe7736f6a6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:01.900868 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab5e61-4cfa-4a09-ae50-fe7736f6a6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:01.901149 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab5e61-4cfa-4a09-ae50-fe7736f6a6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:01.901420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab5e61-4cfa-4a09-ae50-fe7736f6a6d4 None admin] PATH_INFO: `/v3/users/79c393fc188844fabea676bb2b03e0cc` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:01.902645 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab5e61-4cfa-4a09-ae50-fe7736f6a6d4 None admin] RBAC: Authorizing `identity:get_user(user_id=79c393fc188844fabea676bb2b03e0cc)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:01.904163 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab5e61-4cfa-4a09-ae50-fe7736f6a6d4 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:01.905954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 93/199] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:18:01 2022] GET /identity/v3/users/79c393fc188844fabea676bb2b03e0cc => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:01.906663 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab5e61-4cfa-4a09-ae50-fe7736f6a6d4 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:01.913126 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00458c9c-a9ef-447e-a92a-51af3eb34d77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:01.914633 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00458c9c-a9ef-447e-a92a-51af3eb34d77 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:01.931968 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:02.042088 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 107/200] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:18:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:18:02.043613 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00458c9c-a9ef-447e-a92a-51af3eb34d77 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:02.052014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab5e61-4cfa-4a09-ae50-fe7736f6a6d4 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:02.077660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:02.102662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b5833-39aa-4e12-9dfc-ba2e982a8763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:02.104098 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b5833-39aa-4e12-9dfc-ba2e982a8763 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:02.104564 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b5833-39aa-4e12-9dfc-ba2e982a8763 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:02.105604 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b5833-39aa-4e12-9dfc-ba2e982a8763 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:02.166794 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00458c9c-a9ef-447e-a92a-51af3eb34d77 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:02.181227 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:02.190296 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b5833-39aa-4e12-9dfc-ba2e982a8763 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:02.192402 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b5833-39aa-4e12-9dfc-ba2e982a8763 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:02.205106 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91628b9f-fce4-4c7e-80c1-b244914a78c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:02.205808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91628b9f-fce4-4c7e-80c1-b244914a78c6 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:02.206080 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91628b9f-fce4-4c7e-80c1-b244914a78c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:02.206352 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91628b9f-fce4-4c7e-80c1-b244914a78c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:02.275601 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91628b9f-fce4-4c7e-80c1-b244914a78c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:02.277089 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91628b9f-fce4-4c7e-80c1-b244914a78c6 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:02.323236 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 94/201] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:18:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:18:02.324569 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b5833-39aa-4e12-9dfc-ba2e982a8763 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:02.345949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:02.395376 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 108/202] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:18:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:18:02.400546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91628b9f-fce4-4c7e-80c1-b244914a78c6 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:02.419138 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:02.447434 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b5833-39aa-4e12-9dfc-ba2e982a8763 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:02.485460 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238e705-f354-4ad0-98bc-f1bdd3a47206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:02.486356 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238e705-f354-4ad0-98bc-f1bdd3a47206 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:02.486514 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238e705-f354-4ad0-98bc-f1bdd3a47206 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:02.486786 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238e705-f354-4ad0-98bc-f1bdd3a47206 None admin] PATH_INFO: `/v3/projects/85526afc0e3249f2af1dd595350c99ca` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:02.487939 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238e705-f354-4ad0-98bc-f1bdd3a47206 None admin] RBAC: Authorizing `identity:get_project(project_id=85526afc0e3249f2af1dd595350c99ca)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:02.489474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238e705-f354-4ad0-98bc-f1bdd3a47206 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:02.491296 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 95/203] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:02 2022] GET /identity/v3/projects/85526afc0e3249f2af1dd595350c99ca => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:02.497096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238e705-f354-4ad0-98bc-f1bdd3a47206 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:02.535279 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91628b9f-fce4-4c7e-80c1-b244914a78c6 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:02.590398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af303a58-4bdd-4e5f-8c72-aeac56767cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:02.591466 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af303a58-4bdd-4e5f-8c72-aeac56767cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:02.592080 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af303a58-4bdd-4e5f-8c72-aeac56767cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:02.593160 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af303a58-4bdd-4e5f-8c72-aeac56767cf4 None admin] PATH_INFO: `/v3/projects/c68abb6013ea44fb9fad2c8141d11c05` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:02.595530 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af303a58-4bdd-4e5f-8c72-aeac56767cf4 None admin] RBAC: Authorizing `identity:get_project(project_id=c68abb6013ea44fb9fad2c8141d11c05)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:02.597977 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af303a58-4bdd-4e5f-8c72-aeac56767cf4 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:02.600764 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 109/204] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:02 2022] GET /identity/v3/projects/c68abb6013ea44fb9fad2c8141d11c05 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:02.602419 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af303a58-4bdd-4e5f-8c72-aeac56767cf4 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:02.628545 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:02.651693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238e705-f354-4ad0-98bc-f1bdd3a47206 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:02.690913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f5df5-a26e-4104-8f0f-d8970db235e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:02.691787 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f5df5-a26e-4104-8f0f-d8970db235e5 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:02.692133 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f5df5-a26e-4104-8f0f-d8970db235e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:02.692557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f5df5-a26e-4104-8f0f-d8970db235e5 None admin] PATH_INFO: `/v3/projects/85526afc0e3249f2af1dd595350c99ca` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:02.693954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f5df5-a26e-4104-8f0f-d8970db235e5 None admin] RBAC: Authorizing `identity:get_project(project_id=85526afc0e3249f2af1dd595350c99ca)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:02.695823 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f5df5-a26e-4104-8f0f-d8970db235e5 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:02.702861 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 96/205] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:02 2022] GET /identity/v3/projects/85526afc0e3249f2af1dd595350c99ca => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:02.702861 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f5df5-a26e-4104-8f0f-d8970db235e5 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:02.720353 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:02.744055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af303a58-4bdd-4e5f-8c72-aeac56767cf4 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:02.784839 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760fa77e-149f-489e-9960-a44a0bea3402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:02.786287 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fa77e-149f-489e-9960-a44a0bea3402 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:02.786868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fa77e-149f-489e-9960-a44a0bea3402 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:02.787467 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fa77e-149f-489e-9960-a44a0bea3402 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:02.788337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760fa77e-149f-489e-9960-a44a0bea3402 None admin] RBAC: Adding query filter params (role.id=066f46534195417295e63a5316632eae, scope.project.id=85526afc0e3249f2af1dd595350c99ca, user.id=79c393fc188844fabea676bb2b03e0cc) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:02.788754 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760fa77e-149f-489e-9960-a44a0bea3402 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:02.790461 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760fa77e-149f-489e-9960-a44a0bea3402 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:02.798498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 110/206] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:18:02 2022] GET /identity/v3/role_assignments?user.id=79c393fc188844fabea676bb2b03e0cc&scope.project.id=85526afc0e3249f2af1dd595350c99ca&role.id=066f46534195417295e63a5316632eae => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:02.801248 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760fa77e-149f-489e-9960-a44a0bea3402 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:02.856904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f5df5-a26e-4104-8f0f-d8970db235e5 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:02.951612 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63103a-46f1-484e-b728-91cf5cf54337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:02.953836 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63103a-46f1-484e-b728-91cf5cf54337 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:02.954343 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63103a-46f1-484e-b728-91cf5cf54337 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:02.955576 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63103a-46f1-484e-b728-91cf5cf54337 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:02.956821 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63103a-46f1-484e-b728-91cf5cf54337 None admin] RBAC: Adding query filter params (role.id=f889fef4a0c74c31a7942ec629ccf0ed, scope.project.id=c68abb6013ea44fb9fad2c8141d11c05, user.id=6feddfade28345748a6d467f0c2d725b) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:02.957310 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63103a-46f1-484e-b728-91cf5cf54337 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:02.959981 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63103a-46f1-484e-b728-91cf5cf54337 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:02.984274 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 97/207] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:18:02 2022] GET /identity/v3/role_assignments?user.id=6feddfade28345748a6d467f0c2d725b&scope.project.id=c68abb6013ea44fb9fad2c8141d11c05&role.id=f889fef4a0c74c31a7942ec629ccf0ed => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:03.025406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760fa77e-149f-489e-9960-a44a0bea3402 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:03.065336 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b617a8-5140-4ffe-9fa6-c3318c7aa449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:03.066322 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b617a8-5140-4ffe-9fa6-c3318c7aa449 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:03.066791 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b617a8-5140-4ffe-9fa6-c3318c7aa449 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:03.067337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b617a8-5140-4ffe-9fa6-c3318c7aa449 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:03.068380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b617a8-5140-4ffe-9fa6-c3318c7aa449 None admin] RBAC: Adding query filter params (role.id=2497938af8354a00a7e4ec59ad8b9582, scope.project.id=85526afc0e3249f2af1dd595350c99ca, user.id=79c393fc188844fabea676bb2b03e0cc) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:03.068944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b617a8-5140-4ffe-9fa6-c3318c7aa449 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:03.071036 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b617a8-5140-4ffe-9fa6-c3318c7aa449 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:03.077917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 111/208] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:18:02 2022] GET /identity/v3/role_assignments?user.id=79c393fc188844fabea676bb2b03e0cc&scope.project.id=85526afc0e3249f2af1dd595350c99ca&role.id=2497938af8354a00a7e4ec59ad8b9582 => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:03.931502 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c0024-a6a1-4263-bc18-4e7b0350697c None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:03.931994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c0024-a6a1-4263-bc18-4e7b0350697c None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:03.932300 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c0024-a6a1-4263-bc18-4e7b0350697c None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:03.934692 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 98/209] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:03.940472 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0680d-a0d2-48c1-b637-78e68bf879a0 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:03.941344 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0680d-a0d2-48c1-b637-78e68bf879a0 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:03.941815 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0680d-a0d2-48c1-b637-78e68bf879a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:03.961135 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-cba0680d-a0d2-48c1-b637-78e68bf879a0 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:03.962630 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-cba0680d-a0d2-48c1-b637-78e68bf879a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:03.965180 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:04.039120 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 112/210] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 16:18:04.303481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c0024-a6a1-4263-bc18-4e7b0350697c None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:04.330795 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:04.464194 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c0024-a6a1-4263-bc18-4e7b0350697c None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:04.476712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d92bab-2b31-4414-a261-9ae5dbd30418 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:04.477223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d92bab-2b31-4414-a261-9ae5dbd30418 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:04.477669 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d92bab-2b31-4414-a261-9ae5dbd30418 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:04.479510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 113/211] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:04.485281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ecb1e-ad4e-4957-897b-d503562cd5ab None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:04.485758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ecb1e-ad4e-4957-897b-d503562cd5ab None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:04.486176 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ecb1e-ad4e-4957-897b-d503562cd5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:04.507853 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-6f9ecb1e-ad4e-4957-897b-d503562cd5ab None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:04.509890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-6f9ecb1e-ad4e-4957-897b-d503562cd5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:04.520062 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2a0ae-8c06-4b5f-a167-4ad05c57fbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:04.521254 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2a0ae-8c06-4b5f-a167-4ad05c57fbdc None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:04.521925 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2a0ae-8c06-4b5f-a167-4ad05c57fbdc None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:04.522543 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2a0ae-8c06-4b5f-a167-4ad05c57fbdc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:04.524546 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2a0ae-8c06-4b5f-a167-4ad05c57fbdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:04.527276 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2a0ae-8c06-4b5f-a167-4ad05c57fbdc None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:04.530174 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 99/212] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:04.539177 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2a0ae-8c06-4b5f-a167-4ad05c57fbdc None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:04.596558 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 114/213] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 16:18:04.662087 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:04.681580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2a0ae-8c06-4b5f-a167-4ad05c57fbdc None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:04.720119 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd76f1-9bfc-47a2-bfee-9b808e4ffe43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:04.721190 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd76f1-9bfc-47a2-bfee-9b808e4ffe43 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:04.721756 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd76f1-9bfc-47a2-bfee-9b808e4ffe43 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:04.722229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd76f1-9bfc-47a2-bfee-9b808e4ffe43 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:04.723230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd76f1-9bfc-47a2-bfee-9b808e4ffe43 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:04.725032 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd76f1-9bfc-47a2-bfee-9b808e4ffe43 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:04.753528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 100/214] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Oct 4 16:18:04 2022] POST /identity/v3/users => generated 297 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:18:04.873581 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ecb1e-ad4e-4957-897b-d503562cd5ab None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:04.948537 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:04.988190 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ecb1e-ad4e-4957-897b-d503562cd5ab None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:05.028131 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d24a8-bfe6-4969-a8c1-84b0ccc0cc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:05.029226 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d24a8-bfe6-4969-a8c1-84b0ccc0cc30 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:05.029783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d24a8-bfe6-4969-a8c1-84b0ccc0cc30 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:05.030303 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d24a8-bfe6-4969-a8c1-84b0ccc0cc30 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:05.043557 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d24a8-bfe6-4969-a8c1-84b0ccc0cc30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:05.050140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-2c4d24a8-bfe6-4969-a8c1-84b0ccc0cc30 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:18:05.050140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:05.050140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:05.050140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:05.050140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:05.050140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:05.050140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:05.050140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:05.050140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:05.050140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:05.050140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:05.050140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:05.050140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:05.050140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:05.050140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:05.050140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:05.051231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:05.051231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:05.051231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:05.051231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:05.051231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:05.051231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:05.051231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:05.051231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:05.051231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:05.051231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:05.051231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:05.051231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:05.051231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:05.051231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:05.051231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:05.051231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:05.052091 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:05.052091 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:05.052091 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:05.052091 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:05.052091 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:05.052091 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:05.052091 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:05.052091 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:05.052091 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:05.052091 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:05.052091 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:18:05.052091 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:05.055102 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 115/215] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:05.062192 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd76f1-9bfc-47a2-bfee-9b808e4ffe43 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:05.179408 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd76f1-9bfc-47a2-bfee-9b808e4ffe43 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:05.215582 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de3ec9-788e-40b4-a7f6-12ee00a9cecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:05.216204 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de3ec9-788e-40b4-a7f6-12ee00a9cecd None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:05.216480 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de3ec9-788e-40b4-a7f6-12ee00a9cecd None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:05.216738 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de3ec9-788e-40b4-a7f6-12ee00a9cecd None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:05.217415 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de3ec9-788e-40b4-a7f6-12ee00a9cecd None admin] RBAC: Adding query filter params (name=member) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:05.217712 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de3ec9-788e-40b4-a7f6-12ee00a9cecd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:05.219126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de3ec9-788e-40b4-a7f6-12ee00a9cecd None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:05.228741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 101/216] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:18:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:05.236032 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d24a8-bfe6-4969-a8c1-84b0ccc0cc30 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:05.253500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34392f-081a-4777-bb4a-993e7b74d3db None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:05.253811 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34392f-081a-4777-bb4a-993e7b74d3db None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:05.254050 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34392f-081a-4777-bb4a-993e7b74d3db None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:05.256379 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 102/217] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:05.266706 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a7a96-8df0-4a76-b3eb-b55dff5e78b3 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:05.266706 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a7a96-8df0-4a76-b3eb-b55dff5e78b3 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:05.266706 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a7a96-8df0-4a76-b3eb-b55dff5e78b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:05.273353 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:05.293040 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-564a7a96-8df0-4a76-b3eb-b55dff5e78b3 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:05.295218 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-564a7a96-8df0-4a76-b3eb-b55dff5e78b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:05.371953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d24a8-bfe6-4969-a8c1-84b0ccc0cc30 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:05.409232 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 103/218] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 16:18:05.410789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b8fbe-7163-4d61-9315-c10624f63026 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:05.415580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b8fbe-7163-4d61-9315-c10624f63026 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:05.415879 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b8fbe-7163-4d61-9315-c10624f63026 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:05.417363 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 104/219] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:05.426205 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebd8d8-839f-4312-a2a4-f75b3f25b71f None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:05.426528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebd8d8-839f-4312-a2a4-f75b3f25b71f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:05.426804 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebd8d8-839f-4312-a2a4-f75b3f25b71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:05.428340 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:05.444680 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ab2b4-3139-44d4-8321-a86e81f03e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:05.445341 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ab2b4-3139-44d4-8321-a86e81f03e8b None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:05.445625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ab2b4-3139-44d4-8321-a86e81f03e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:05.445954 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ab2b4-3139-44d4-8321-a86e81f03e8b None admin] PATH_INFO: `/v3/users/03d88b75b3e34fdaa3c4a982d0a50823` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:05.467935 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-1eebd8d8-839f-4312-a2a4-f75b3f25b71f None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:05.469263 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-1eebd8d8-839f-4312-a2a4-f75b3f25b71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:05.477227 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ab2b4-3139-44d4-8321-a86e81f03e8b None admin] RBAC: Authorizing `identity:get_user(user_id=03d88b75b3e34fdaa3c4a982d0a50823)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:05.478806 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ab2b4-3139-44d4-8321-a86e81f03e8b None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:05.483609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 116/220] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:18:05 2022] GET /identity/v3/users/03d88b75b3e34fdaa3c4a982d0a50823 => generated 297 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:05.496256 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ab2b4-3139-44d4-8321-a86e81f03e8b None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:05.553654 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 105/221] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 16:18:05.702565 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ab2b4-3139-44d4-8321-a86e81f03e8b None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:05.717925 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebd8d8-839f-4312-a2a4-f75b3f25b71f None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:05.742663 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bfed9-8a1f-436d-9507-5843854a0123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:05.743319 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bfed9-8a1f-436d-9507-5843854a0123 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:05.743585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bfed9-8a1f-436d-9507-5843854a0123 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:05.743853 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bfed9-8a1f-436d-9507-5843854a0123 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:05.805008 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:05.831364 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:05.835058 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5bfed9-8a1f-436d-9507-5843854a0123 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:05.837643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5bfed9-8a1f-436d-9507-5843854a0123 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:05.875924 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebd8d8-839f-4312-a2a4-f75b3f25b71f None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:05.937663 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46be72-d957-4768-9b20-9a0ea223b287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:05.939130 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46be72-d957-4768-9b20-9a0ea223b287 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:05.939626 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46be72-d957-4768-9b20-9a0ea223b287 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:05.940217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46be72-d957-4768-9b20-9a0ea223b287 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:05.955597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46be72-d957-4768-9b20-9a0ea223b287 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:05.961272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-db46be72-d957-4768-9b20-9a0ea223b287 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:18:05.961272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:05.961272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:05.961272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:05.961272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:05.961272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:05.961272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:05.961272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:05.961272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:05.961272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:05.961272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:05.961272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:05.961272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:05.961272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:05.961272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:05.961272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:05.962137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:05.962137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:05.962137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:05.962137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:05.962137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:05.962137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:05.962137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:05.962137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:05.962137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:05.962137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:05.962137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:05.962137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:05.962137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:05.962137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:05.962137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:05.962137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:05.962906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:05.962906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:05.962906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:05.962906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:05.962906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:05.962906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:05.962906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:05.962906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:05.962906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:05.962906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:05.962906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:18:05.962906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:05.965840 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 106/222] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:18:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:05.966809 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46be72-d957-4768-9b20-9a0ea223b287 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:06.036101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 117/223] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:18:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:18:06.037930 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bfed9-8a1f-436d-9507-5843854a0123 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:06.107197 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46be72-d957-4768-9b20-9a0ea223b287 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:06.131650 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:06.147273 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7278511-cf7b-424b-9ddb-18d020ac8d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:06.148304 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7278511-cf7b-424b-9ddb-18d020ac8d23 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:06.148789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7278511-cf7b-424b-9ddb-18d020ac8d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:06.149241 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7278511-cf7b-424b-9ddb-18d020ac8d23 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:06.162540 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:06.164356 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7278511-cf7b-424b-9ddb-18d020ac8d23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:06.173963 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-a7278511-cf7b-424b-9ddb-18d020ac8d23 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 16:18:06.173963 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:06.173963 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:06.173963 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:06.173963 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:06.173963 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:06.173963 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:06.173963 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:06.173963 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:06.173963 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:06.173963 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:06.173963 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:06.173963 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:06.173963 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:06.173963 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:06.173963 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:06.174946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:06.174946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:06.174946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:06.174946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:06.174946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:06.174946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:06.174946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:06.174946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:06.174946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:06.174946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:06.174946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:06.174946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:06.174946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:06.174946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:06.174946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:06.174946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:06.176279 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:06.176279 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:06.176279 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:06.176279 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:06.176279 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:06.176279 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:06.176279 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:06.176279 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:06.176279 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:06.176279 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:06.176279 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 16:18:06.176279 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:06.177193 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 107/224] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Oct 4 16:18:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:06.179409 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7278511-cf7b-424b-9ddb-18d020ac8d23 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:06.191336 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bfed9-8a1f-436d-9507-5843854a0123 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:06.268707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73a894-5e9e-43c3-b938-ee4f14a94124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:06.269647 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73a894-5e9e-43c3-b938-ee4f14a94124 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:06.270116 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73a894-5e9e-43c3-b938-ee4f14a94124 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:06.270579 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73a894-5e9e-43c3-b938-ee4f14a94124 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:06.272054 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73a894-5e9e-43c3-b938-ee4f14a94124 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:06.273198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73a894-5e9e-43c3-b938-ee4f14a94124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:06.276270 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73a894-5e9e-43c3-b938-ee4f14a94124 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:06.297775 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 118/225] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:06.298970 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73a894-5e9e-43c3-b938-ee4f14a94124 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:06.307655 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7278511-cf7b-424b-9ddb-18d020ac8d23 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:06.357230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861206a2-aeb4-4b80-a70b-c707ca3d6d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:06.359696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861206a2-aeb4-4b80-a70b-c707ca3d6d6c None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:06.360155 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861206a2-aeb4-4b80-a70b-c707ca3d6d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:06.360600 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861206a2-aeb4-4b80-a70b-c707ca3d6d6c None admin] PATH_INFO: `/v3/projects/85526afc0e3249f2af1dd595350c99ca` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:06.362801 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861206a2-aeb4-4b80-a70b-c707ca3d6d6c None admin] RBAC: Authorizing `identity:get_project(project_id=85526afc0e3249f2af1dd595350c99ca)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:06.366799 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861206a2-aeb4-4b80-a70b-c707ca3d6d6c None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:06.371918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 108/226] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:06 2022] GET /identity/v3/projects/85526afc0e3249f2af1dd595350c99ca => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:06.373480 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861206a2-aeb4-4b80-a70b-c707ca3d6d6c None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:06.432098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73a894-5e9e-43c3-b938-ee4f14a94124 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:06.460216 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:06.472730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c83e2-2a2a-4329-8f26-99808ab66d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:06.474109 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c83e2-2a2a-4329-8f26-99808ab66d18 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:06.474770 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c83e2-2a2a-4329-8f26-99808ab66d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:06.475466 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c83e2-2a2a-4329-8f26-99808ab66d18 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:06.476991 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c83e2-2a2a-4329-8f26-99808ab66d18 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:06.477830 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c83e2-2a2a-4329-8f26-99808ab66d18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:06.480857 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c83e2-2a2a-4329-8f26-99808ab66d18 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:06.498512 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 119/227] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:18:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:06.500386 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c83e2-2a2a-4329-8f26-99808ab66d18 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:06.526194 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:06.567131 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861206a2-aeb4-4b80-a70b-c707ca3d6d6c None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:06.639586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d0139-5c32-497b-bcdf-37b5979ca41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:06.640629 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d0139-5c32-497b-bcdf-37b5979ca41d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:06.641072 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d0139-5c32-497b-bcdf-37b5979ca41d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:06.641539 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d0139-5c32-497b-bcdf-37b5979ca41d None admin] PATH_INFO: `/v3/users/79c393fc188844fabea676bb2b03e0cc` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:06.643472 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d0139-5c32-497b-bcdf-37b5979ca41d None admin] RBAC: Authorizing `identity:get_user(user_id=79c393fc188844fabea676bb2b03e0cc)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:06.647441 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d0139-5c32-497b-bcdf-37b5979ca41d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:06.658042 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 109/228] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:18:06 2022] GET /identity/v3/users/79c393fc188844fabea676bb2b03e0cc => generated 283 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:06.658042 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d0139-5c32-497b-bcdf-37b5979ca41d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:06.705524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c83e2-2a2a-4329-8f26-99808ab66d18 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:06.753979 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226dd88-c6e7-449a-b87b-34b1e06ea6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:06.755732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226dd88-c6e7-449a-b87b-34b1e06ea6ab None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:06.756207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226dd88-c6e7-449a-b87b-34b1e06ea6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:06.756674 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226dd88-c6e7-449a-b87b-34b1e06ea6ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:06.758045 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226dd88-c6e7-449a-b87b-34b1e06ea6ab None admin] RBAC: Adding query filter params (role.id=5cf61f379b4d49cb9e19605796d13f62, scope.project.id=85526afc0e3249f2af1dd595350c99ca, user.id=03d88b75b3e34fdaa3c4a982d0a50823) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:06.758577 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226dd88-c6e7-449a-b87b-34b1e06ea6ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:06.762706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226dd88-c6e7-449a-b87b-34b1e06ea6ab None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:06.778560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 120/229] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:18:06 2022] GET /identity/v3/role_assignments?user.id=03d88b75b3e34fdaa3c4a982d0a50823&scope.project.id=85526afc0e3249f2af1dd595350c99ca&role.id=5cf61f379b4d49cb9e19605796d13f62 => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:06.781282 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226dd88-c6e7-449a-b87b-34b1e06ea6ab None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:06.841764 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d0139-5c32-497b-bcdf-37b5979ca41d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:06.877693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:06.924150 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34036aa8-a077-473e-9cad-fcd174d496b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:06.925222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34036aa8-a077-473e-9cad-fcd174d496b4 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:06.926570 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34036aa8-a077-473e-9cad-fcd174d496b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:06.927094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34036aa8-a077-473e-9cad-fcd174d496b4 None admin] PATH_INFO: `/v3/users/79c393fc188844fabea676bb2b03e0cc` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:06.930348 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34036aa8-a077-473e-9cad-fcd174d496b4 None admin] RBAC: Authorizing `identity:get_user(user_id=79c393fc188844fabea676bb2b03e0cc)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:06.932206 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34036aa8-a077-473e-9cad-fcd174d496b4 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:06.939121 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 110/230] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:18:06 2022] GET /identity/v3/users/79c393fc188844fabea676bb2b03e0cc => generated 283 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:06.941914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34036aa8-a077-473e-9cad-fcd174d496b4 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:06.958551 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:06.994864 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226dd88-c6e7-449a-b87b-34b1e06ea6ab None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:07.042055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f95c1-8557-405d-a6b1-230c8aef6703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:07.042660 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f95c1-8557-405d-a6b1-230c8aef6703 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:07.043222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f95c1-8557-405d-a6b1-230c8aef6703 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:07.043486 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f95c1-8557-405d-a6b1-230c8aef6703 None admin] PATH_INFO: `/v3/projects/85526afc0e3249f2af1dd595350c99ca` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:07.047039 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f95c1-8557-405d-a6b1-230c8aef6703 None admin] RBAC: Authorizing `identity:get_project(project_id=85526afc0e3249f2af1dd595350c99ca)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:07.047638 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f95c1-8557-405d-a6b1-230c8aef6703 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:07.050043 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 121/231] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:06 2022] GET /identity/v3/projects/85526afc0e3249f2af1dd595350c99ca => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:07.057108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f95c1-8557-405d-a6b1-230c8aef6703 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:07.106366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34036aa8-a077-473e-9cad-fcd174d496b4 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:07.172809 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499db873-192c-4bb2-8fba-fbd122ccc187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:07.174195 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499db873-192c-4bb2-8fba-fbd122ccc187 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:07.174827 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499db873-192c-4bb2-8fba-fbd122ccc187 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:07.175965 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499db873-192c-4bb2-8fba-fbd122ccc187 None admin] PATH_INFO: `/v3/projects/85526afc0e3249f2af1dd595350c99ca` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:07.178169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499db873-192c-4bb2-8fba-fbd122ccc187 None admin] RBAC: Authorizing `identity:get_project(project_id=85526afc0e3249f2af1dd595350c99ca)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:07.181274 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499db873-192c-4bb2-8fba-fbd122ccc187 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:07.185111 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 111/232] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:06 2022] GET /identity/v3/projects/85526afc0e3249f2af1dd595350c99ca => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:07.191631 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499db873-192c-4bb2-8fba-fbd122ccc187 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:07.262709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f95c1-8557-405d-a6b1-230c8aef6703 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:07.275970 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:07.331531 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca37245-7549-493f-bec6-f052ad7205a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:07.332200 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca37245-7549-493f-bec6-f052ad7205a1 None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:07.332472 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca37245-7549-493f-bec6-f052ad7205a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:07.332740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca37245-7549-493f-bec6-f052ad7205a1 None admin] PATH_INFO: `/v3/projects/85526afc0e3249f2af1dd595350c99ca/users/79c393fc188844fabea676bb2b03e0cc/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:07.336527 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca37245-7549-493f-bec6-f052ad7205a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=85526afc0e3249f2af1dd595350c99ca, user_id=79c393fc188844fabea676bb2b03e0cc, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:07.337994 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca37245-7549-493f-bec6-f052ad7205a1 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:07.368896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 122/233] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Oct 4 16:18:07 2022] PUT /identity/v3/projects/85526afc0e3249f2af1dd595350c99ca/users/79c393fc188844fabea676bb2b03e0cc/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:18:07.375888 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499db873-192c-4bb2-8fba-fbd122ccc187 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:07.400198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc399870-32a7-4ce9-8924-9c0443fcf8ed None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:07.400489 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc399870-32a7-4ce9-8924-9c0443fcf8ed None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:07.400776 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc399870-32a7-4ce9-8924-9c0443fcf8ed None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:07.402616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 123/234] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:18:07.408347 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d2eab-99c6-46a3-a0c9-469f2f3839d1 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:07.408643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d2eab-99c6-46a3-a0c9-469f2f3839d1 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:07.408903 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d2eab-99c6-46a3-a0c9-469f2f3839d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:07.417468 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:07.430567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-f27d2eab-99c6-46a3-a0c9-469f2f3839d1 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:07.431937 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-f27d2eab-99c6-46a3-a0c9-469f2f3839d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:07.446227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e578a-1072-4b90-98e4-6d96b3171780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:07.448641 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e578a-1072-4b90-98e4-6d96b3171780 None admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:07.448641 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e578a-1072-4b90-98e4-6d96b3171780 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:07.448641 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e578a-1072-4b90-98e4-6d96b3171780 None admin] PATH_INFO: `/v3/projects/85526afc0e3249f2af1dd595350c99ca/users/79c393fc188844fabea676bb2b03e0cc/roles/2497938af8354a00a7e4ec59ad8b9582` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:07.452550 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e578a-1072-4b90-98e4-6d96b3171780 None admin] RBAC: Authorizing `identity:create_grant(project_id=85526afc0e3249f2af1dd595350c99ca, user_id=79c393fc188844fabea676bb2b03e0cc, role_id=2497938af8354a00a7e4ec59ad8b9582)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:07.455409 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e578a-1072-4b90-98e4-6d96b3171780 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:07.489415 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 112/235] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Oct 4 16:18:07 2022] PUT /identity/v3/projects/85526afc0e3249f2af1dd595350c99ca/users/79c393fc188844fabea676bb2b03e0cc/roles/2497938af8354a00a7e4ec59ad8b9582 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:18:07.597665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 124/236] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 16:18:07.671615 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffb62a-9e0b-48ec-9937-7b03494b5503 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:07.672277 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffb62a-9e0b-48ec-9937-7b03494b5503 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:07.672754 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffb62a-9e0b-48ec-9937-7b03494b5503 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:07.675888 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 113/237] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:07.682711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1a69b-062e-42e5-b51e-aa3af6145543 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:07.683037 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1a69b-062e-42e5-b51e-aa3af6145543 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:07.683291 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1a69b-062e-42e5-b51e-aa3af6145543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:07.707643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-b2e1a69b-062e-42e5-b51e-aa3af6145543 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:07.709199 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b2e1a69b-062e-42e5-b51e-aa3af6145543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:07.788389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 125/238] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:08.005044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffb62a-9e0b-48ec-9937-7b03494b5503 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:08.146601 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffb62a-9e0b-48ec-9937-7b03494b5503 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:08.161392 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1a69b-062e-42e5-b51e-aa3af6145543 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:08.167020 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:08.205546 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2cbbb-52a2-4756-b898-500dd9199ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:08.206202 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2cbbb-52a2-4756-b898-500dd9199ffb None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:08.206457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2cbbb-52a2-4756-b898-500dd9199ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:08.206728 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2cbbb-52a2-4756-b898-500dd9199ffb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:08.228284 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2cbbb-52a2-4756-b898-500dd9199ffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:08.234690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-30a2cbbb-52a2-4756-b898-500dd9199ffb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 16:18:08.234690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:08.234690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:08.234690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:08.234690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:08.234690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:08.234690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:08.234690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:08.234690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:08.234690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:08.234690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:08.234690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:08.234690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:08.234690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:08.234690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:08.234690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:08.235607 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:08.235607 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:08.235607 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:08.235607 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:08.235607 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:08.235607 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:08.235607 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:08.235607 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:08.235607 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:08.235607 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:08.235607 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:08.235607 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:08.235607 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:08.235607 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:08.235607 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:08.235607 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:08.236620 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:08.236620 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:08.236620 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:08.236620 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:08.236620 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:08.236620 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:08.236620 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:08.236620 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:08.236620 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:08.236620 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:08.236620 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 16:18:08.236620 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:08.237241 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 114/239] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:08.242596 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2cbbb-52a2-4756-b898-500dd9199ffb None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:08.267084 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:08.337934 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1a69b-062e-42e5-b51e-aa3af6145543 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:08.397942 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc1141-6ec8-4ca9-bc99-2154ab93fc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:08.399003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc1141-6ec8-4ca9-bc99-2154ab93fc64 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:08.399305 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc1141-6ec8-4ca9-bc99-2154ab93fc64 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:08.399572 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc1141-6ec8-4ca9-bc99-2154ab93fc64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:08.400753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc1141-6ec8-4ca9-bc99-2154ab93fc64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:08.402244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc1141-6ec8-4ca9-bc99-2154ab93fc64 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:08.404848 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 126/240] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:08.410566 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc1141-6ec8-4ca9-bc99-2154ab93fc64 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:08.434500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2cbbb-52a2-4756-b898-500dd9199ffb None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:08.519843 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573267d-a68c-46c2-aa9a-8972a2627c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:08.520566 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573267d-a68c-46c2-aa9a-8972a2627c60 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:08.520934 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573267d-a68c-46c2-aa9a-8972a2627c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:08.521295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573267d-a68c-46c2-aa9a-8972a2627c60 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:08.522081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573267d-a68c-46c2-aa9a-8972a2627c60 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:08.522492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573267d-a68c-46c2-aa9a-8972a2627c60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:08.524038 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573267d-a68c-46c2-aa9a-8972a2627c60 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:08.546804 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc1141-6ec8-4ca9-bc99-2154ab93fc64 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:08.549156 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 115/241] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:18:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:08.560015 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573267d-a68c-46c2-aa9a-8972a2627c60 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:08.588072 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:08.592437 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d52f8-32dd-4a5d-b897-898592058945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:08.593314 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d52f8-32dd-4a5d-b897-898592058945 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:08.593804 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d52f8-32dd-4a5d-b897-898592058945 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:08.594725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d52f8-32dd-4a5d-b897-898592058945 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:08.597207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d52f8-32dd-4a5d-b897-898592058945 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:08.600499 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d52f8-32dd-4a5d-b897-898592058945 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:08.633664 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:08.643549 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 127/242] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Oct 4 16:18:08 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:18:08.745839 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573267d-a68c-46c2-aa9a-8972a2627c60 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:08.784089 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cb2e1-c669-4183-b3cc-f683fce4f76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:08.785117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cb2e1-c669-4183-b3cc-f683fce4f76a None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:08.785610 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cb2e1-c669-4183-b3cc-f683fce4f76a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:08.786072 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cb2e1-c669-4183-b3cc-f683fce4f76a None admin] PATH_INFO: `/v3/users/f8720d64610c4ec0ac9241ce795203d9` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:08.801774 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cb2e1-c669-4183-b3cc-f683fce4f76a None admin] RBAC: Authorizing `identity:get_user(user_id=f8720d64610c4ec0ac9241ce795203d9)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:08.803725 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cb2e1-c669-4183-b3cc-f683fce4f76a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:08.806166 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 116/243] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:18:08 2022] GET /identity/v3/users/f8720d64610c4ec0ac9241ce795203d9 => generated 297 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:08.812228 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d52f8-32dd-4a5d-b897-898592058945 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:08.967680 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d52f8-32dd-4a5d-b897-898592058945 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:09.005777 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e8394-0a78-4528-a9b8-0585b106bf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:09.006814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e8394-0a78-4528-a9b8-0585b106bf81 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:09.007310 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e8394-0a78-4528-a9b8-0585b106bf81 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:09.007782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e8394-0a78-4528-a9b8-0585b106bf81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:09.068871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:09.083182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e8394-0a78-4528-a9b8-0585b106bf81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:09.085160 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e8394-0a78-4528-a9b8-0585b106bf81 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:09.200908 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 128/244] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:18:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:18:09.206892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cb2e1-c669-4183-b3cc-f683fce4f76a None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:09.311414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:09.314540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cb2e1-c669-4183-b3cc-f683fce4f76a None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:09.350844 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6b292-d1f7-4341-b6d7-ec3855559ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:09.351446 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6b292-d1f7-4341-b6d7-ec3855559ebe None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:09.351727 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6b292-d1f7-4341-b6d7-ec3855559ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:09.351997 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6b292-d1f7-4341-b6d7-ec3855559ebe None admin] PATH_INFO: `/v3/projects/85526afc0e3249f2af1dd595350c99ca` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:09.353123 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6b292-d1f7-4341-b6d7-ec3855559ebe None admin] RBAC: Authorizing `identity:get_project(project_id=85526afc0e3249f2af1dd595350c99ca)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:09.354579 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6b292-d1f7-4341-b6d7-ec3855559ebe None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:09.356654 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 117/245] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:09 2022] GET /identity/v3/projects/85526afc0e3249f2af1dd595350c99ca => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:09.362859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e8394-0a78-4528-a9b8-0585b106bf81 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:09.463524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:09.482709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e8394-0a78-4528-a9b8-0585b106bf81 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:09.523375 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23a4bc-b47b-468a-a303-96e6ea0f99a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:09.524008 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23a4bc-b47b-468a-a303-96e6ea0f99a1 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:09.524287 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23a4bc-b47b-468a-a303-96e6ea0f99a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:09.524556 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23a4bc-b47b-468a-a303-96e6ea0f99a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:09.525359 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23a4bc-b47b-468a-a303-96e6ea0f99a1 None admin] RBAC: Adding query filter params (role.id=f889fef4a0c74c31a7942ec629ccf0ed, scope.project.id=85526afc0e3249f2af1dd595350c99ca, user.id=f8720d64610c4ec0ac9241ce795203d9) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:09.525671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23a4bc-b47b-468a-a303-96e6ea0f99a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:09.527209 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23a4bc-b47b-468a-a303-96e6ea0f99a1 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:09.533694 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 129/246] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:18:09 2022] GET /identity/v3/role_assignments?user.id=f8720d64610c4ec0ac9241ce795203d9&scope.project.id=85526afc0e3249f2af1dd595350c99ca&role.id=f889fef4a0c74c31a7942ec629ccf0ed => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:09.581416 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b462e-4a85-41e4-ba34-6ba12c39ed45 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:09.581704 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b462e-4a85-41e4-ba34-6ba12c39ed45 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:09.581969 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b462e-4a85-41e4-ba34-6ba12c39ed45 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:09.583690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 118/247] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:09.589501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34981329-e63c-4955-9fce-38c921c31aba None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:09.589874 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34981329-e63c-4955-9fce-38c921c31aba None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:09.590147 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34981329-e63c-4955-9fce-38c921c31aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:09.610482 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-34981329-e63c-4955-9fce-38c921c31aba None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:09.611904 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-34981329-e63c-4955-9fce-38c921c31aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:09.705539 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 130/248] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 16:18:09.996029 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628e7ab-41b0-43ce-aa91-83b1c1207564 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:09.996681 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628e7ab-41b0-43ce-aa91-83b1c1207564 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:09.997160 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628e7ab-41b0-43ce-aa91-83b1c1207564 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:09.999020 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 119/249] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:10.004830 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a3dbe-ecfc-406b-95c9-f4433fb24809 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:10.005341 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a3dbe-ecfc-406b-95c9-f4433fb24809 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:10.005810 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a3dbe-ecfc-406b-95c9-f4433fb24809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:10.036047 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-3f5a3dbe-ecfc-406b-95c9-f4433fb24809 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:10.037853 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-3f5a3dbe-ecfc-406b-95c9-f4433fb24809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:10.128896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 131/250] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:10.141940 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628e7ab-41b0-43ce-aa91-83b1c1207564 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:10.436120 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628e7ab-41b0-43ce-aa91-83b1c1207564 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:10.477383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a3dbe-ecfc-406b-95c9-f4433fb24809 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:10.508631 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:10.513282 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48b93d-1703-4e7a-bf12-81166302f1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:10.514378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48b93d-1703-4e7a-bf12-81166302f1be None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:10.514855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48b93d-1703-4e7a-bf12-81166302f1be None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:10.515338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48b93d-1703-4e7a-bf12-81166302f1be None admin] PATH_INFO: `/v3/roles/member` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:10.544246 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48b93d-1703-4e7a-bf12-81166302f1be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:10.560540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-8b48b93d-1703-4e7a-bf12-81166302f1be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:18:10.560540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:10.560540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:10.560540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:10.560540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:10.560540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:10.560540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:10.560540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:10.560540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:10.560540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:10.560540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:10.560540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:10.560540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:10.560540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:10.560540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:10.560540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:10.561512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:10.561512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:10.561512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:10.561512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:10.561512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:10.561512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:10.561512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:10.561512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:10.561512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:10.561512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:10.561512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:10.561512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:10.561512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:10.561512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:10.561512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:10.561512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:10.562335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:10.562335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:10.562335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:10.562335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:10.562335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:10.562335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:10.562335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:10.562335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:10.562335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:10.562335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:10.562335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:18:10.562335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:10.563541 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 120/251] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 422 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:10.572176 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48b93d-1703-4e7a-bf12-81166302f1be None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:10.638933 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:10.740495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a3dbe-ecfc-406b-95c9-f4433fb24809 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:10.809147 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8275ed-f687-4944-97eb-11b8abbc2f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:10.810147 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8275ed-f687-4944-97eb-11b8abbc2f1b None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:10.810568 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8275ed-f687-4944-97eb-11b8abbc2f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:10.811000 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8275ed-f687-4944-97eb-11b8abbc2f1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:10.844175 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8275ed-f687-4944-97eb-11b8abbc2f1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:10.853779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-2d8275ed-f687-4944-97eb-11b8abbc2f1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:18:10.853779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:10.853779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:10.853779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:10.853779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:10.853779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:10.853779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:10.853779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:10.853779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:10.853779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:10.853779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:10.853779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:10.853779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:10.853779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:10.853779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:10.853779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:10.854665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:10.854665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:10.854665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:10.854665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:10.854665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:10.854665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:10.854665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:10.854665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:10.854665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:10.854665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:10.854665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:10.854665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:10.854665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:10.854665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:10.854665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:10.854665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:10.855535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:10.855535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:10.855535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:10.855535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:10.855535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:10.855535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:10.855535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:10.855535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:10.855535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:10.855535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:10.855535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:18:10.855535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:10.866654 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 132/252] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:18:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:10.868753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b900d-76af-40e0-86f5-7913a9fa177f None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:10.870356 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b900d-76af-40e0-86f5-7913a9fa177f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:10.870536 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b900d-76af-40e0-86f5-7913a9fa177f None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:10.882328 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 133/253] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:10 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:10.889227 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b900d-76af-40e0-86f5-7913a9fa177f None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:10.901955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48b93d-1703-4e7a-bf12-81166302f1be None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:10.997914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bd397-c593-46eb-ae08-7be1feb6b0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:10.998854 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bd397-c593-46eb-ae08-7be1feb6b0b5 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:10.999318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bd397-c593-46eb-ae08-7be1feb6b0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:10.999785 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bd397-c593-46eb-ae08-7be1feb6b0b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:11.000932 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bd397-c593-46eb-ae08-7be1feb6b0b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:11.001459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bd397-c593-46eb-ae08-7be1feb6b0b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:11.003960 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bd397-c593-46eb-ae08-7be1feb6b0b5 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:11.019924 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 121/254] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:18:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:11.028481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748cf61-6184-4049-ad2e-811b55733b6c None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:11.028968 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748cf61-6184-4049-ad2e-811b55733b6c None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:11.029439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748cf61-6184-4049-ad2e-811b55733b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:11.063833 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-f748cf61-6184-4049-ad2e-811b55733b6c None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:11.066536 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f748cf61-6184-4049-ad2e-811b55733b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:11.154808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:11.209500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b900d-76af-40e0-86f5-7913a9fa177f None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:11.241500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 122/255] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:11.242906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748cf61-6184-4049-ad2e-811b55733b6c None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:11.268064 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d0669-c83e-4048-9fce-42d01644fa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:11.269184 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d0669-c83e-4048-9fce-42d01644fa22 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:11.269803 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d0669-c83e-4048-9fce-42d01644fa22 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:11.270402 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d0669-c83e-4048-9fce-42d01644fa22 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:11.271690 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d0669-c83e-4048-9fce-42d01644fa22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:11.272294 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d0669-c83e-4048-9fce-42d01644fa22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:11.274833 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d0669-c83e-4048-9fce-42d01644fa22 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:11.289895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 134/256] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:11.291377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:11.299613 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d0669-c83e-4048-9fce-42d01644fa22 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:11.465691 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d0669-c83e-4048-9fce-42d01644fa22 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:11.532134 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748cf61-6184-4049-ad2e-811b55733b6c None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:11.563338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:11.589876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609eeeb4-15cb-44fd-8063-e47931055254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:11.591009 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609eeeb4-15cb-44fd-8063-e47931055254 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:11.591481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609eeeb4-15cb-44fd-8063-e47931055254 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:11.591951 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609eeeb4-15cb-44fd-8063-e47931055254 None admin] PATH_INFO: `/v3/users/79c393fc188844fabea676bb2b03e0cc` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:11.596962 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609eeeb4-15cb-44fd-8063-e47931055254 None admin] RBAC: Authorizing `identity:get_user(user_id=79c393fc188844fabea676bb2b03e0cc)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:11.601118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609eeeb4-15cb-44fd-8063-e47931055254 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:11.604630 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 135/257] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:18:11 2022] GET /identity/v3/users/79c393fc188844fabea676bb2b03e0cc => generated 283 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:11.613267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609eeeb4-15cb-44fd-8063-e47931055254 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:11.679270 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cbda4-8b47-455b-a8cd-5c4b1e46751b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:11.687009 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cbda4-8b47-455b-a8cd-5c4b1e46751b None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:11.687831 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cbda4-8b47-455b-a8cd-5c4b1e46751b None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:11.688569 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cbda4-8b47-455b-a8cd-5c4b1e46751b None admin] PATH_INFO: `/v3/users/03d88b75b3e34fdaa3c4a982d0a50823` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:11.690852 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896cbda4-8b47-455b-a8cd-5c4b1e46751b None admin] RBAC: Authorizing `identity:get_user(user_id=03d88b75b3e34fdaa3c4a982d0a50823)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:11.693715 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896cbda4-8b47-455b-a8cd-5c4b1e46751b None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:11.698897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 123/258] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:18:11 2022] GET /identity/v3/users/03d88b75b3e34fdaa3c4a982d0a50823 => generated 297 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:11.708522 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cbda4-8b47-455b-a8cd-5c4b1e46751b None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:11.933112 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609eeeb4-15cb-44fd-8063-e47931055254 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:11.951344 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:11.987114 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cbda4-8b47-455b-a8cd-5c4b1e46751b None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:12.009663 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4aaff0-c965-4389-b132-59336a1f4da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:12.011252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4aaff0-c965-4389-b132-59336a1f4da3 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:12.012074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4aaff0-c965-4389-b132-59336a1f4da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:12.012812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4aaff0-c965-4389-b132-59336a1f4da3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:12.062141 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1419d8-46cd-4247-959c-a6be90144813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:12.063762 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1419d8-46cd-4247-959c-a6be90144813 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:12.064548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1419d8-46cd-4247-959c-a6be90144813 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:12.065289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1419d8-46cd-4247-959c-a6be90144813 None admin] PATH_INFO: `/v3/projects/85526afc0e3249f2af1dd595350c99ca` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:12.068104 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1419d8-46cd-4247-959c-a6be90144813 None admin] RBAC: Authorizing `identity:get_project(project_id=85526afc0e3249f2af1dd595350c99ca)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:12.074246 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1419d8-46cd-4247-959c-a6be90144813 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:12.078380 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 124/259] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:11 2022] GET /identity/v3/projects/85526afc0e3249f2af1dd595350c99ca => generated 302 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:12.082747 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1419d8-46cd-4247-959c-a6be90144813 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:12.182455 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:12.185917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4aaff0-c965-4389-b132-59336a1f4da3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:12.187358 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4aaff0-c965-4389-b132-59336a1f4da3 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:12.277565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1419d8-46cd-4247-959c-a6be90144813 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:12.317772 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698ef87-ccc0-4b29-939e-b8720733c47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:12.318455 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698ef87-ccc0-4b29-939e-b8720733c47f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:12.318735 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698ef87-ccc0-4b29-939e-b8720733c47f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:12.319020 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698ef87-ccc0-4b29-939e-b8720733c47f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:12.332122 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698ef87-ccc0-4b29-939e-b8720733c47f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:12.337859 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-5698ef87-ccc0-4b29-939e-b8720733c47f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 16:18:12.337859 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:12.337859 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:12.337859 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:12.337859 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:12.337859 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:12.337859 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:12.337859 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:12.337859 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:12.337859 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:12.337859 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:12.337859 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:12.337859 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:12.337859 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:12.337859 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:12.337859 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:12.339469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:12.339469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:12.339469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:12.339469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:12.339469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:12.339469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:12.339469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:12.339469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:12.339469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:12.339469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:12.339469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:12.339469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:12.339469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:12.339469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:12.339469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:12.339469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:12.341186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:12.341186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:12.341186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:12.341186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:12.341186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:12.341186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:12.341186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:12.341186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:12.341186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:12.341186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:12.341186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 16:18:12.341186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:12.341186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 125/260] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Oct 4 16:18:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:12.341186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698ef87-ccc0-4b29-939e-b8720733c47f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:12.354543 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:12.419771 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 136/261] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:18:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 807 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 16:18:12.421025 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4aaff0-c965-4389-b132-59336a1f4da3 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:12.480502 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698ef87-ccc0-4b29-939e-b8720733c47f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:12.531981 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad785e-0248-4f73-a6eb-223d644bb349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:12.532667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad785e-0248-4f73-a6eb-223d644bb349 None admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:12.533449 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad785e-0248-4f73-a6eb-223d644bb349 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:12.533449 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad785e-0248-4f73-a6eb-223d644bb349 None admin] PATH_INFO: `/v3/projects/85526afc0e3249f2af1dd595350c99ca/users/03d88b75b3e34fdaa3c4a982d0a50823/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:12.536780 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad785e-0248-4f73-a6eb-223d644bb349 None admin] RBAC: Authorizing `identity:create_grant(project_id=85526afc0e3249f2af1dd595350c99ca, user_id=03d88b75b3e34fdaa3c4a982d0a50823, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:12.539810 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad785e-0248-4f73-a6eb-223d644bb349 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:12.566329 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 126/262] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Oct 4 16:18:12 2022] PUT /identity/v3/projects/85526afc0e3249f2af1dd595350c99ca/users/03d88b75b3e34fdaa3c4a982d0a50823/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:18:12.567290 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad785e-0248-4f73-a6eb-223d644bb349 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:12.633184 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:12.643834 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4aaff0-c965-4389-b132-59336a1f4da3 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:12.699948 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76fea2-fc89-4280-8fa6-ceaf0dc7f3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:12.700568 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76fea2-fc89-4280-8fa6-ceaf0dc7f3ea None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:12.700862 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76fea2-fc89-4280-8fa6-ceaf0dc7f3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:12.701119 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76fea2-fc89-4280-8fa6-ceaf0dc7f3ea None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:12.701800 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76fea2-fc89-4280-8fa6-ceaf0dc7f3ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:12.702101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76fea2-fc89-4280-8fa6-ceaf0dc7f3ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:12.707020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76fea2-fc89-4280-8fa6-ceaf0dc7f3ea None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:12.714253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 137/263] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:18:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:12.720216 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76fea2-fc89-4280-8fa6-ceaf0dc7f3ea None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:12.760447 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:12.885466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad785e-0248-4f73-a6eb-223d644bb349 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:12.969821 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e6ed9-e4c4-4355-8b86-a18a1a749368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:12.970893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e6ed9-e4c4-4355-8b86-a18a1a749368 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:12.971935 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e6ed9-e4c4-4355-8b86-a18a1a749368 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:12.972559 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e6ed9-e4c4-4355-8b86-a18a1a749368 None admin] PATH_INFO: `/v3/projects/85526afc0e3249f2af1dd595350c99ca` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:12.974637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e6ed9-e4c4-4355-8b86-a18a1a749368 None admin] RBAC: Authorizing `identity:get_project(project_id=85526afc0e3249f2af1dd595350c99ca)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:12.975055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76fea2-fc89-4280-8fa6-ceaf0dc7f3ea None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:12.978866 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e6ed9-e4c4-4355-8b86-a18a1a749368 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:12.982498 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 127/264] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:12 2022] GET /identity/v3/projects/85526afc0e3249f2af1dd595350c99ca => generated 302 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:12.984598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a79e4-3f84-4926-8cc3-dbef344e754b None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:12.985076 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a79e4-3f84-4926-8cc3-dbef344e754b None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:12.985543 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a79e4-3f84-4926-8cc3-dbef344e754b None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:12.988753 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 128/265] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:12.996464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a79e4-3f84-4926-8cc3-dbef344e754b None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:13.018862 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3a688-5d49-438c-b7dd-efc2f7c8af4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:13.019867 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3a688-5d49-438c-b7dd-efc2f7c8af4e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:13.020478 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3a688-5d49-438c-b7dd-efc2f7c8af4e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:13.020969 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3a688-5d49-438c-b7dd-efc2f7c8af4e None admin] PATH_INFO: `/v3/users/79c393fc188844fabea676bb2b03e0cc` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:13.022442 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3a688-5d49-438c-b7dd-efc2f7c8af4e None admin] RBAC: Authorizing `identity:get_user(user_id=79c393fc188844fabea676bb2b03e0cc)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:13.024318 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3a688-5d49-438c-b7dd-efc2f7c8af4e None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:13.026200 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 138/266] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:18:12 2022] GET /identity/v3/users/79c393fc188844fabea676bb2b03e0cc => generated 283 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:13.027854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b67bc-403d-44d0-82a3-176f25081ae9 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:13.028339 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b67bc-403d-44d0-82a3-176f25081ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:13.028826 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b67bc-403d-44d0-82a3-176f25081ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:13.049866 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-e99b67bc-403d-44d0-82a3-176f25081ae9 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:13.051682 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-e99b67bc-403d-44d0-82a3-176f25081ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:13.080365 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:13.128213 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 139/267] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:13.129104 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b67bc-403d-44d0-82a3-176f25081ae9 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:13.169503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a79e4-3f84-4926-8cc3-dbef344e754b None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:13.233611 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b119d5f-291f-4d0b-85be-a988d7e00351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:13.234232 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b119d5f-291f-4d0b-85be-a988d7e00351 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:13.234511 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b119d5f-291f-4d0b-85be-a988d7e00351 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:13.234779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b119d5f-291f-4d0b-85be-a988d7e00351 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:13.235549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b119d5f-291f-4d0b-85be-a988d7e00351 None admin] RBAC: Adding query filter params (role.id=066f46534195417295e63a5316632eae, scope.project.id=85526afc0e3249f2af1dd595350c99ca, user.id=79c393fc188844fabea676bb2b03e0cc) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:13.235852 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b119d5f-291f-4d0b-85be-a988d7e00351 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:13.237314 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b119d5f-291f-4d0b-85be-a988d7e00351 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:13.254192 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 129/268] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:18:12 2022] GET /identity/v3/role_assignments?user.id=79c393fc188844fabea676bb2b03e0cc&scope.project.id=85526afc0e3249f2af1dd595350c99ca&role.id=066f46534195417295e63a5316632eae => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:13.255612 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef190f-f84b-4cb8-a6c8-fe782752ed9d None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:13.255901 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef190f-f84b-4cb8-a6c8-fe782752ed9d None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:13.256171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef190f-f84b-4cb8-a6c8-fe782752ed9d None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:13.261163 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 130/269] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:13.263679 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d86dc1-c3e8-4c12-a87d-a6f5417a5c9a None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:13.263960 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d86dc1-c3e8-4c12-a87d-a6f5417a5c9a None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:13.264256 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d86dc1-c3e8-4c12-a87d-a6f5417a5c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:13.279980 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:13.302796 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b67bc-403d-44d0-82a3-176f25081ae9 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:13.305449 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-98d86dc1-c3e8-4c12-a87d-a6f5417a5c9a None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:13.306686 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-98d86dc1-c3e8-4c12-a87d-a6f5417a5c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:13.385685 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f79def-41e7-44b1-8455-e55256c17362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:13.387020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f79def-41e7-44b1-8455-e55256c17362 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:13.387509 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f79def-41e7-44b1-8455-e55256c17362 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:13.388021 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f79def-41e7-44b1-8455-e55256c17362 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:13.459823 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:13.469793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 131/270] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:13.480358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41b979-2fcd-4bb2-8af0-9d24e6cb7876 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:13.481015 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41b979-2fcd-4bb2-8af0-9d24e6cb7876 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:13.481466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41b979-2fcd-4bb2-8af0-9d24e6cb7876 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:13.483172 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 132/271] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:13 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:13.491509 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995243fd-d61f-4a46-a71b-c5fd0220235c None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:13.492078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995243fd-d61f-4a46-a71b-c5fd0220235c None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:13.492575 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995243fd-d61f-4a46-a71b-c5fd0220235c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:13.525754 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-995243fd-d61f-4a46-a71b-c5fd0220235c None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:13.527568 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-995243fd-d61f-4a46-a71b-c5fd0220235c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:13.585209 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f79def-41e7-44b1-8455-e55256c17362 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:13.589910 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f79def-41e7-44b1-8455-e55256c17362 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:13.681601 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 133/272] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:13.682689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995243fd-d61f-4a46-a71b-c5fd0220235c None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:13.766772 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:13.787132 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 140/273] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:18:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:18:13.793442 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f79def-41e7-44b1-8455-e55256c17362 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:13.819995 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995243fd-d61f-4a46-a71b-c5fd0220235c None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:13.881831 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861e281-ffb8-4bdf-a2e9-afe6edf045b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:13.883424 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861e281-ffb8-4bdf-a2e9-afe6edf045b8 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:13.883958 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861e281-ffb8-4bdf-a2e9-afe6edf045b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:13.884452 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861e281-ffb8-4bdf-a2e9-afe6edf045b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:13.894769 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:13.902768 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861e281-ffb8-4bdf-a2e9-afe6edf045b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:13.910766 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-9861e281-ffb8-4bdf-a2e9-afe6edf045b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:18:13.910766 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:13.910766 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:13.910766 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:13.910766 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:13.910766 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:13.910766 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:13.910766 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:13.910766 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:13.910766 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:13.910766 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:13.910766 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:13.910766 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:13.910766 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:13.910766 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:13.910766 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:13.911736 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:13.911736 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:13.911736 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:13.911736 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:13.911736 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:13.911736 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:13.911736 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:13.911736 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:13.911736 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:13.911736 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:13.911736 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:13.911736 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:13.911736 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:13.911736 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:13.911736 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:13.911736 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:13.912530 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:13.912530 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:13.912530 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:13.912530 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:13.912530 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:13.912530 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:13.912530 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:13.912530 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:13.912530 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:13.912530 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:13.912530 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:18:13.912530 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:13.919512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 134/274] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:13.922008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861e281-ffb8-4bdf-a2e9-afe6edf045b8 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:13.950105 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f79def-41e7-44b1-8455-e55256c17362 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:13.988057 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9f450-7f03-40c5-9eae-d44036e545b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:13.988733 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9f450-7f03-40c5-9eae-d44036e545b2 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:13.989231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9f450-7f03-40c5-9eae-d44036e545b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:13.989231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9f450-7f03-40c5-9eae-d44036e545b2 None admin] PATH_INFO: `/v3/projects/85526afc0e3249f2af1dd595350c99ca` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:13.990433 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9f450-7f03-40c5-9eae-d44036e545b2 None admin] RBAC: Authorizing `identity:get_project(project_id=85526afc0e3249f2af1dd595350c99ca)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:13.991956 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9f450-7f03-40c5-9eae-d44036e545b2 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:13.993995 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 141/275] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:13 2022] GET /identity/v3/projects/85526afc0e3249f2af1dd595350c99ca => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:13.999703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9f450-7f03-40c5-9eae-d44036e545b2 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:14.037868 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861e281-ffb8-4bdf-a2e9-afe6edf045b8 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:14.065146 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:14.078862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b89cef-9d5e-49df-862d-259859064a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:14.079926 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b89cef-9d5e-49df-862d-259859064a8d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:14.080419 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b89cef-9d5e-49df-862d-259859064a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:14.080882 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b89cef-9d5e-49df-862d-259859064a8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:14.082215 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b89cef-9d5e-49df-862d-259859064a8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:14.083995 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b89cef-9d5e-49df-862d-259859064a8d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:14.085856 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 135/276] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:14.086931 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b89cef-9d5e-49df-862d-259859064a8d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:14.115782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9f450-7f03-40c5-9eae-d44036e545b2 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:14.145636 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:14.156129 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd26df-f11e-4501-83f9-8f91da9c44eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:14.156967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd26df-f11e-4501-83f9-8f91da9c44eb None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:14.157413 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd26df-f11e-4501-83f9-8f91da9c44eb None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:14.157825 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd26df-f11e-4501-83f9-8f91da9c44eb None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:14.158737 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd26df-f11e-4501-83f9-8f91da9c44eb None admin] RBAC: Adding query filter params (name=member) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:14.159199 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd26df-f11e-4501-83f9-8f91da9c44eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:14.160916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd26df-f11e-4501-83f9-8f91da9c44eb None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:14.171548 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 142/277] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:18:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:14.173334 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd26df-f11e-4501-83f9-8f91da9c44eb None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:14.202212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b89cef-9d5e-49df-862d-259859064a8d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:14.240261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156ffc9-b03c-471b-9a28-2c0f63b89930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:14.241017 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156ffc9-b03c-471b-9a28-2c0f63b89930 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:14.241361 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156ffc9-b03c-471b-9a28-2c0f63b89930 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:14.241705 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156ffc9-b03c-471b-9a28-2c0f63b89930 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:14.242825 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156ffc9-b03c-471b-9a28-2c0f63b89930 None admin] RBAC: Adding query filter params (role.id=2497938af8354a00a7e4ec59ad8b9582, scope.project.id=85526afc0e3249f2af1dd595350c99ca, user.id=79c393fc188844fabea676bb2b03e0cc) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:14.243268 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156ffc9-b03c-471b-9a28-2c0f63b89930 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:14.244854 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156ffc9-b03c-471b-9a28-2c0f63b89930 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:14.259095 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 136/278] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:18:14 2022] GET /identity/v3/role_assignments?user.id=79c393fc188844fabea676bb2b03e0cc&scope.project.id=85526afc0e3249f2af1dd595350c99ca&role.id=2497938af8354a00a7e4ec59ad8b9582 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:14.260200 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156ffc9-b03c-471b-9a28-2c0f63b89930 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:14.294559 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd26df-f11e-4501-83f9-8f91da9c44eb None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:14.331182 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:14.344760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73a8a3-d80d-48c3-bbdc-934c6f463021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:14.347808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73a8a3-d80d-48c3-bbdc-934c6f463021 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:14.348871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73a8a3-d80d-48c3-bbdc-934c6f463021 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:14.349607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73a8a3-d80d-48c3-bbdc-934c6f463021 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:14.351306 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73a8a3-d80d-48c3-bbdc-934c6f463021 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:14.354172 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73a8a3-d80d-48c3-bbdc-934c6f463021 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:14.397020 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156ffc9-b03c-471b-9a28-2c0f63b89930 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:14.401508 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 143/279] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Oct 4 16:18:14 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:18:14.403350 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73a8a3-d80d-48c3-bbdc-934c6f463021 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:14.483117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446ed9c-2e02-42c0-8609-e341971ef50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:14.484046 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446ed9c-2e02-42c0-8609-e341971ef50b None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:14.484425 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446ed9c-2e02-42c0-8609-e341971ef50b None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:14.484754 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:14.484924 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446ed9c-2e02-42c0-8609-e341971ef50b None admin] PATH_INFO: `/v3/users/fc49aa6e760148e4ba7c683401c41b57` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:14.528643 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446ed9c-2e02-42c0-8609-e341971ef50b None admin] RBAC: Authorizing `identity:get_user(user_id=fc49aa6e760148e4ba7c683401c41b57)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:14.530337 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446ed9c-2e02-42c0-8609-e341971ef50b None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:14.532652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 137/280] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:18:14 2022] GET /identity/v3/users/fc49aa6e760148e4ba7c683401c41b57 => generated 293 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:14.539268 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446ed9c-2e02-42c0-8609-e341971ef50b None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:14.620636 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73a8a3-d80d-48c3-bbdc-934c6f463021 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:14.681229 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761e3b0-c853-484d-8d44-362d35c72e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:14.681817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761e3b0-c853-484d-8d44-362d35c72e29 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:14.682101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761e3b0-c853-484d-8d44-362d35c72e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:14.682372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761e3b0-c853-484d-8d44-362d35c72e29 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:14.702945 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446ed9c-2e02-42c0-8609-e341971ef50b None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:14.706527 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761e3b0-c853-484d-8d44-362d35c72e29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:14.712103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-b761e3b0-c853-484d-8d44-362d35c72e29 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 16:18:14.712103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:14.712103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:14.712103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:14.712103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:14.712103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:14.712103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:14.712103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:14.712103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:14.712103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:14.712103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:14.712103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:14.712103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:14.712103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:14.712103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:14.712103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:14.713005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:14.713005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:14.713005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:14.713005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:14.713005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:14.713005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:14.713005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:14.713005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:14.713005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:14.713005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:14.713005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:14.713005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:14.713005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:14.713005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:14.713005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:14.713005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:14.713817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:14.713817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:14.713817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:14.713817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:14.713817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:14.713817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:14.713817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:14.713817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:14.713817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:14.713817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:14.713817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 16:18:14.713817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:14.713817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 144/281] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:14.722041 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761e3b0-c853-484d-8d44-362d35c72e29 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:14.729070 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:14.766814 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ded2d6-c9b8-41c8-92db-6d5efc3e15ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:14.767872 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ded2d6-c9b8-41c8-92db-6d5efc3e15ee None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:14.768356 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ded2d6-c9b8-41c8-92db-6d5efc3e15ee None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:14.768830 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ded2d6-c9b8-41c8-92db-6d5efc3e15ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:14.770168 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ded2d6-c9b8-41c8-92db-6d5efc3e15ee None admin] RBAC: Adding query filter params (role.id=5cf61f379b4d49cb9e19605796d13f62, user.id=fc49aa6e760148e4ba7c683401c41b57, scope.system=all) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:14.770696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ded2d6-c9b8-41c8-92db-6d5efc3e15ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:14.773448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ded2d6-c9b8-41c8-92db-6d5efc3e15ee None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:14.782710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 138/282] 10.222.0.55 () {56 vars in 1308 bytes} [Tue Oct 4 16:18:14 2022] GET /identity/v3/role_assignments?user.id=fc49aa6e760148e4ba7c683401c41b57&scope.system=all&role.id=5cf61f379b4d49cb9e19605796d13f62 => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:14.896470 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761e3b0-c853-484d-8d44-362d35c72e29 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:14.909236 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:14.954419 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae174acd-b7ee-49b0-af1a-0c17735a5329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:14.955799 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae174acd-b7ee-49b0-af1a-0c17735a5329 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:14.956505 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae174acd-b7ee-49b0-af1a-0c17735a5329 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:14.956998 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae174acd-b7ee-49b0-af1a-0c17735a5329 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:14.957929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae174acd-b7ee-49b0-af1a-0c17735a5329 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:14.958427 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae174acd-b7ee-49b0-af1a-0c17735a5329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:14.960847 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae174acd-b7ee-49b0-af1a-0c17735a5329 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:14.977468 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 145/283] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:18:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:14.984220 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ded2d6-c9b8-41c8-92db-6d5efc3e15ee None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:15.162223 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ded2d6-c9b8-41c8-92db-6d5efc3e15ee None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:15.236458 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acf817-7489-4c42-bd70-4fd86eff6adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:15.238012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acf817-7489-4c42-bd70-4fd86eff6adb None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:15.238734 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acf817-7489-4c42-bd70-4fd86eff6adb None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:15.239481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acf817-7489-4c42-bd70-4fd86eff6adb None admin] PATH_INFO: `/v3/users/f8720d64610c4ec0ac9241ce795203d9` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:15.243316 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acf817-7489-4c42-bd70-4fd86eff6adb None admin] RBAC: Authorizing `identity:get_user(user_id=f8720d64610c4ec0ac9241ce795203d9)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:15.246259 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acf817-7489-4c42-bd70-4fd86eff6adb None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:15.249932 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 139/284] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:18:14 2022] GET /identity/v3/users/f8720d64610c4ec0ac9241ce795203d9 => generated 297 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:15.258178 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae174acd-b7ee-49b0-af1a-0c17735a5329 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:15.445125 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae174acd-b7ee-49b0-af1a-0c17735a5329 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:15.492714 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacaa70-942e-4904-b502-a70c93def52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:15.493264 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacaa70-942e-4904-b502-a70c93def52a None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:15.493549 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacaa70-942e-4904-b502-a70c93def52a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:15.493816 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacaa70-942e-4904-b502-a70c93def52a None admin] PATH_INFO: `/v3/projects/85526afc0e3249f2af1dd595350c99ca` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:15.495023 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceacaa70-942e-4904-b502-a70c93def52a None admin] RBAC: Authorizing `identity:get_project(project_id=85526afc0e3249f2af1dd595350c99ca)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:15.496563 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceacaa70-942e-4904-b502-a70c93def52a None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:15.498294 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 146/285] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:15 2022] GET /identity/v3/projects/85526afc0e3249f2af1dd595350c99ca => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:15.507499 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acf817-7489-4c42-bd70-4fd86eff6adb None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:15.614231 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:15.707112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acf817-7489-4c42-bd70-4fd86eff6adb None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:15.763811 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdca0e-da7c-41cd-8996-d330a80a593d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:15.764424 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdca0e-da7c-41cd-8996-d330a80a593d None admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:15.764705 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdca0e-da7c-41cd-8996-d330a80a593d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:15.764983 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdca0e-da7c-41cd-8996-d330a80a593d None admin] PATH_INFO: `/v3/projects/85526afc0e3249f2af1dd595350c99ca/users/f8720d64610c4ec0ac9241ce795203d9/roles/f889fef4a0c74c31a7942ec629ccf0ed` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:15.767086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdca0e-da7c-41cd-8996-d330a80a593d None admin] RBAC: Authorizing `identity:create_grant(project_id=85526afc0e3249f2af1dd595350c99ca, user_id=f8720d64610c4ec0ac9241ce795203d9, role_id=f889fef4a0c74c31a7942ec629ccf0ed)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:15.768606 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdca0e-da7c-41cd-8996-d330a80a593d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:15.786895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 140/286] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Oct 4 16:18:15 2022] PUT /identity/v3/projects/85526afc0e3249f2af1dd595350c99ca/users/f8720d64610c4ec0ac9241ce795203d9/roles/f889fef4a0c74c31a7942ec629ccf0ed => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:18:16.297854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac1eda-c473-4a1d-8775-588fa1eeb0a0 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:16.298391 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac1eda-c473-4a1d-8775-588fa1eeb0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:16.298391 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac1eda-c473-4a1d-8775-588fa1eeb0a0 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:16.299964 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 147/287] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:16.306055 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc0cb2-ffdf-4b8e-913e-6194647e2697 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:16.306610 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc0cb2-ffdf-4b8e-913e-6194647e2697 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:16.307100 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc0cb2-ffdf-4b8e-913e-6194647e2697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:16.328884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-2cfc0cb2-ffdf-4b8e-913e-6194647e2697 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:16.330604 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-2cfc0cb2-ffdf-4b8e-913e-6194647e2697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:16.426162 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 141/288] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 16:18:16.824246 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac1eda-c473-4a1d-8775-588fa1eeb0a0 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:16.864038 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:16.953049 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac1eda-c473-4a1d-8775-588fa1eeb0a0 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:17.008016 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc3d14-d734-4de3-bc6c-8a92a5febd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:17.008934 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc3d14-d734-4de3-bc6c-8a92a5febd37 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:17.009341 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc3d14-d734-4de3-bc6c-8a92a5febd37 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:17.009737 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc3d14-d734-4de3-bc6c-8a92a5febd37 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:17.032161 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc3d14-d734-4de3-bc6c-8a92a5febd37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:17.042548 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-dacc3d14-d734-4de3-bc6c-8a92a5febd37 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:18:17.042548 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:17.042548 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:17.042548 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:17.042548 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:17.042548 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:17.042548 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:17.042548 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:17.042548 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:17.042548 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:17.042548 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:17.042548 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:17.042548 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:17.042548 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:17.042548 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:17.042548 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:17.043567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:17.043567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:17.043567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:17.043567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:17.043567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:17.043567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:17.043567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:17.043567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:17.043567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:17.043567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:17.043567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:17.043567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:17.043567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:17.043567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:17.043567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:17.043567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:17.044683 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:17.044683 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:17.044683 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:17.044683 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:17.044683 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:17.044683 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:17.044683 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:17.044683 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:17.044683 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:17.044683 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:17.044683 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:18:17.044683 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:17.046334 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 148/289] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:18:17.053336 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc0cb2-ffdf-4b8e-913e-6194647e2697 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:17.114493 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:17.214664 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc0cb2-ffdf-4b8e-913e-6194647e2697 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:17.266999 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbf42c-698f-4943-af28-adb792d1a421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:17.268023 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbf42c-698f-4943-af28-adb792d1a421 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:17.268498 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbf42c-698f-4943-af28-adb792d1a421 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:17.268973 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbf42c-698f-4943-af28-adb792d1a421 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:17.270096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbf42c-698f-4943-af28-adb792d1a421 None admin] RBAC: Adding query filter params (name=member) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:17.270616 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbf42c-698f-4943-af28-adb792d1a421 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:17.272289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbf42c-698f-4943-af28-adb792d1a421 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:17.286930 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 142/290] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:18:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:17.296699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc3d14-d734-4de3-bc6c-8a92a5febd37 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:17.502580 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:17.514037 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc3d14-d734-4de3-bc6c-8a92a5febd37 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:17.598660 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d465749-a2fa-431d-b8a2-e19bed33d45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:17.599753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d465749-a2fa-431d-b8a2-e19bed33d45a None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:17.600232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d465749-a2fa-431d-b8a2-e19bed33d45a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:17.600696 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d465749-a2fa-431d-b8a2-e19bed33d45a None admin] PATH_INFO: `/v3/users/03d88b75b3e34fdaa3c4a982d0a50823` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:17.603012 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d465749-a2fa-431d-b8a2-e19bed33d45a None admin] RBAC: Authorizing `identity:get_user(user_id=03d88b75b3e34fdaa3c4a982d0a50823)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:17.610286 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d465749-a2fa-431d-b8a2-e19bed33d45a None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:17.614001 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 149/291] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:18:17 2022] GET /identity/v3/users/03d88b75b3e34fdaa3c4a982d0a50823 => generated 297 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:17.622795 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbf42c-698f-4943-af28-adb792d1a421 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:17.738039 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01834451-eddd-4e11-90cf-f3c0009659c1 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:17.738517 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01834451-eddd-4e11-90cf-f3c0009659c1 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:17.739015 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01834451-eddd-4e11-90cf-f3c0009659c1 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:17.741426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 150/292] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:18:17.747980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b3b4f-cdbb-47c3-ab09-3a4ab37b84fc None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:17.748810 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b3b4f-cdbb-47c3-ab09-3a4ab37b84fc None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:17.749038 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b3b4f-cdbb-47c3-ab09-3a4ab37b84fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:17.787213 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-b59b3b4f-cdbb-47c3-ab09-3a4ab37b84fc None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:17.789636 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b59b3b4f-cdbb-47c3-ab09-3a4ab37b84fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:17.834528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:17.844507 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbf42c-698f-4943-af28-adb792d1a421 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:17.909365 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5780ba-c665-4929-a5b8-abed80807912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:17.910390 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5780ba-c665-4929-a5b8-abed80807912 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:17.910863 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5780ba-c665-4929-a5b8-abed80807912 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:17.911355 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5780ba-c665-4929-a5b8-abed80807912 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:17.946940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 151/293] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 16:18:17.998933 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5780ba-c665-4929-a5b8-abed80807912 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:18.000805 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5780ba-c665-4929-a5b8-abed80807912 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:18.122104 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:18.131584 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 143/294] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:18:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:18:18.140193 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b3b4f-cdbb-47c3-ab09-3a4ab37b84fc None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:18.269299 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:18.278308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b3b4f-cdbb-47c3-ab09-3a4ab37b84fc None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:18.326503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a992b50-224f-4b07-a0e3-f516fe2440ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:18.327594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a992b50-224f-4b07-a0e3-f516fe2440ed None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:18.328073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a992b50-224f-4b07-a0e3-f516fe2440ed None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:18.328539 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a992b50-224f-4b07-a0e3-f516fe2440ed None admin] PATH_INFO: `/v3/projects/85526afc0e3249f2af1dd595350c99ca` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:18.332247 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a992b50-224f-4b07-a0e3-f516fe2440ed None admin] RBAC: Authorizing `identity:get_project(project_id=85526afc0e3249f2af1dd595350c99ca)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:18.334040 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a992b50-224f-4b07-a0e3-f516fe2440ed None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:18.336411 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 152/295] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:18 2022] GET /identity/v3/projects/85526afc0e3249f2af1dd595350c99ca => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:18.342751 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5780ba-c665-4929-a5b8-abed80807912 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:18.394833 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fb585-9953-4054-bd44-2d184e515131 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:18.395462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fb585-9953-4054-bd44-2d184e515131 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:18.395952 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fb585-9953-4054-bd44-2d184e515131 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:18.397542 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 153/296] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:18:18.410150 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71845cc1-d70f-46ae-bff6-7605f01c25fc None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:18.410751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71845cc1-d70f-46ae-bff6-7605f01c25fc None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:18.411248 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71845cc1-d70f-46ae-bff6-7605f01c25fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:18.435250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-71845cc1-d70f-46ae-bff6-7605f01c25fc None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:18.437486 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-71845cc1-d70f-46ae-bff6-7605f01c25fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:18.478192 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5780ba-c665-4929-a5b8-abed80807912 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:18.521344 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae3cf9-d1ea-4f11-86ac-9ce68676b004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:18.522121 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae3cf9-d1ea-4f11-86ac-9ce68676b004 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:18.522623 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 154/297] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 16:18:18.523353 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae3cf9-d1ea-4f11-86ac-9ce68676b004 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:18.523353 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae3cf9-d1ea-4f11-86ac-9ce68676b004 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:18.523895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4c408-5f52-434b-898d-f3d038dff779 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:18.524182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4c408-5f52-434b-898d-f3d038dff779 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:18.524453 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4c408-5f52-434b-898d-f3d038dff779 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:18.524596 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae3cf9-d1ea-4f11-86ac-9ce68676b004 None admin] RBAC: Adding query filter params (role.id=5cf61f379b4d49cb9e19605796d13f62, scope.project.id=85526afc0e3249f2af1dd595350c99ca, user.id=03d88b75b3e34fdaa3c4a982d0a50823) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:18.524971 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae3cf9-d1ea-4f11-86ac-9ce68676b004 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:18.532113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 155/298] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:18.532113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4c408-5f52-434b-898d-f3d038dff779 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:18.532473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae3cf9-d1ea-4f11-86ac-9ce68676b004 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:18.538972 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 144/299] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:18:18 2022] GET /identity/v3/role_assignments?user.id=03d88b75b3e34fdaa3c4a982d0a50823&scope.project.id=85526afc0e3249f2af1dd595350c99ca&role.id=5cf61f379b4d49cb9e19605796d13f62 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:18.541556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ddee0-4604-4485-94eb-217d7002e2b4 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:18.541720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ddee0-4604-4485-94eb-217d7002e2b4 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:18.542155 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ddee0-4604-4485-94eb-217d7002e2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:18.571859 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-b53ddee0-4604-4485-94eb-217d7002e2b4 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:18.573411 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-b53ddee0-4604-4485-94eb-217d7002e2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:18.677101 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:18.698756 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 145/300] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:18.762372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:18.781225 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4c408-5f52-434b-898d-f3d038dff779 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:18.842852 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af36a77-ecba-42c4-aa0d-0cc89a469f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:18.844264 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af36a77-ecba-42c4-aa0d-0cc89a469f1c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:18.844927 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af36a77-ecba-42c4-aa0d-0cc89a469f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:18.845742 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af36a77-ecba-42c4-aa0d-0cc89a469f1c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:18.864763 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af36a77-ecba-42c4-aa0d-0cc89a469f1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:18.875495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-9af36a77-ecba-42c4-aa0d-0cc89a469f1c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 16:18:18.875495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:18.875495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:18.875495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:18.875495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:18.875495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:18.875495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:18.875495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:18.875495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:18.875495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:18.875495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:18.875495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:18.875495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:18.875495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:18.875495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:18.875495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:18.877164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:18.877164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:18.877164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:18.877164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:18.877164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:18.877164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:18.877164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:18.877164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:18.877164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:18.877164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:18.877164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:18.877164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:18.877164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:18.877164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:18.877164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:18.877164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:18.878692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:18.878692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:18.878692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:18.878692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:18.878692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:18.878692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:18.878692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:18.878692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:18.878692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:18.878692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:18.878692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 16:18:18.878692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:18.883276 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 156/301] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:18.890561 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ddee0-4604-4485-94eb-217d7002e2b4 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:18.893147 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af36a77-ecba-42c4-aa0d-0cc89a469f1c None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:19.055037 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af36a77-ecba-42c4-aa0d-0cc89a469f1c None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:19.073078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ddee0-4604-4485-94eb-217d7002e2b4 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:19.092470 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc612f-347f-4d8a-84b5-ca7dcc3e0f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:19.093488 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc612f-347f-4d8a-84b5-ca7dcc3e0f14 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:19.093981 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc612f-347f-4d8a-84b5-ca7dcc3e0f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:19.094439 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc612f-347f-4d8a-84b5-ca7dcc3e0f14 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:19.095334 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc612f-347f-4d8a-84b5-ca7dcc3e0f14 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:19.095980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc612f-347f-4d8a-84b5-ca7dcc3e0f14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:19.097581 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc612f-347f-4d8a-84b5-ca7dcc3e0f14 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:19.107053 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 157/302] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:18:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:19.114669 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc612f-347f-4d8a-84b5-ca7dcc3e0f14 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:19.135947 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:19.160335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3256b-a80c-40d6-a711-cc7f2e7e0228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:19.162176 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3256b-a80c-40d6-a711-cc7f2e7e0228 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:19.162908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3256b-a80c-40d6-a711-cc7f2e7e0228 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:19.163589 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3256b-a80c-40d6-a711-cc7f2e7e0228 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:19.181048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3256b-a80c-40d6-a711-cc7f2e7e0228 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:19.186180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-fab3256b-a80c-40d6-a711-cc7f2e7e0228 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:18:19.186180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:19.186180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:19.186180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:19.186180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:19.186180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:19.186180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:19.186180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:19.186180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:19.186180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:19.186180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:19.186180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:19.186180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:19.186180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:19.186180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:19.186180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:19.188086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:19.188086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:19.188086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:19.188086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:19.188086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:19.188086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:19.188086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:19.188086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:19.188086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:19.188086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:19.188086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:19.188086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:19.188086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:19.188086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:19.188086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:19.188086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:19.189358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:19.189358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:19.189358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:19.189358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:19.189358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:19.189358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:19.189358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:19.189358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:19.189358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:19.189358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:19.189358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:18:19.189358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:19.189358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 146/303] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:19.189358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3256b-a80c-40d6-a711-cc7f2e7e0228 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:19.235503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc612f-347f-4d8a-84b5-ca7dcc3e0f14 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:19.263838 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:19.274397 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c9ae0-b556-412f-9791-319ddbf0fb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:19.275317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c9ae0-b556-412f-9791-319ddbf0fb6d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:19.275317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c9ae0-b556-412f-9791-319ddbf0fb6d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:19.275686 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c9ae0-b556-412f-9791-319ddbf0fb6d None admin] PATH_INFO: `/v3/users/0719cd5a8f844d1db1ecf3a57130c841` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:19.296013 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c9ae0-b556-412f-9791-319ddbf0fb6d None admin] RBAC: Authorizing `identity:get_user(user_id=0719cd5a8f844d1db1ecf3a57130c841)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:19.297900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c9ae0-b556-412f-9791-319ddbf0fb6d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:19.306068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 158/304] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:18:19 2022] GET /identity/v3/users/0719cd5a8f844d1db1ecf3a57130c841 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:19.306068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c9ae0-b556-412f-9791-319ddbf0fb6d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:19.338391 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3256b-a80c-40d6-a711-cc7f2e7e0228 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:19.378879 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa464ff9-35d7-4bdf-a4ec-66780dcc4a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:19.379901 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa464ff9-35d7-4bdf-a4ec-66780dcc4a17 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:19.380349 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa464ff9-35d7-4bdf-a4ec-66780dcc4a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:19.380789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa464ff9-35d7-4bdf-a4ec-66780dcc4a17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:19.382415 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa464ff9-35d7-4bdf-a4ec-66780dcc4a17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:19.384928 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa464ff9-35d7-4bdf-a4ec-66780dcc4a17 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:19.387592 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 147/305] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:19.388805 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa464ff9-35d7-4bdf-a4ec-66780dcc4a17 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:19.396965 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:19.427796 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c9ae0-b556-412f-9791-319ddbf0fb6d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:19.463711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa85c6-b832-4123-85a9-685f3bb2bd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:19.464698 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa85c6-b832-4123-85a9-685f3bb2bd7d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:19.465065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa85c6-b832-4123-85a9-685f3bb2bd7d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:19.465441 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa85c6-b832-4123-85a9-685f3bb2bd7d None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:19.466225 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa85c6-b832-4123-85a9-685f3bb2bd7d None admin] RBAC: Adding query filter params (name=member) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:19.466613 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa85c6-b832-4123-85a9-685f3bb2bd7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:19.468150 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa85c6-b832-4123-85a9-685f3bb2bd7d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:19.476959 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 159/306] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:18:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:19.477908 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445d332-8308-4df2-85d0-095801e90f1b None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:19.478242 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445d332-8308-4df2-85d0-095801e90f1b None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:19.478525 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445d332-8308-4df2-85d0-095801e90f1b None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:19.479704 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 160/307] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:19.484261 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445d332-8308-4df2-85d0-095801e90f1b None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:19.498445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa464ff9-35d7-4bdf-a4ec-66780dcc4a17 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:19.517146 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:19.536761 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc63014-69af-4c7d-8829-ad24d19365b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:19.537377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc63014-69af-4c7d-8829-ad24d19365b4 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:19.537650 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc63014-69af-4c7d-8829-ad24d19365b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:19.537918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc63014-69af-4c7d-8829-ad24d19365b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:19.538640 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc63014-69af-4c7d-8829-ad24d19365b4 None admin] RBAC: Adding query filter params (role.id=f889fef4a0c74c31a7942ec629ccf0ed, user.id=0719cd5a8f844d1db1ecf3a57130c841, scope.system=all) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:19.538947 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc63014-69af-4c7d-8829-ad24d19365b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:19.540433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc63014-69af-4c7d-8829-ad24d19365b4 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:19.545916 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 148/308] 10.222.0.55 () {56 vars in 1308 bytes} [Tue Oct 4 16:18:19 2022] GET /identity/v3/role_assignments?user.id=0719cd5a8f844d1db1ecf3a57130c841&scope.system=all&role.id=f889fef4a0c74c31a7942ec629ccf0ed => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:19.546726 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc63014-69af-4c7d-8829-ad24d19365b4 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:19.613851 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445d332-8308-4df2-85d0-095801e90f1b None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:19.675904 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c490a-443f-4035-b712-e35a0f47a025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:19.677020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c490a-443f-4035-b712-e35a0f47a025 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:19.677460 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c490a-443f-4035-b712-e35a0f47a025 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:19.677873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c490a-443f-4035-b712-e35a0f47a025 None admin] PATH_INFO: `/v3/groups` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:19.678871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c490a-443f-4035-b712-e35a0f47a025 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:19.681768 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c490a-443f-4035-b712-e35a0f47a025 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:19.688893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:19.689278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc63014-69af-4c7d-8829-ad24d19365b4 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:19.718854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 161/309] 10.222.0.55 () {60 vars in 1134 bytes} [Tue Oct 4 16:18:19 2022] POST /identity/v3/groups => generated 229 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:18:19.718854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886a026-3627-466f-9ffa-e3f1b35a7186 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:19.718854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886a026-3627-466f-9ffa-e3f1b35a7186 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:19.718854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886a026-3627-466f-9ffa-e3f1b35a7186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:19.738859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-5886a026-3627-466f-9ffa-e3f1b35a7186 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:19.740949 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-5886a026-3627-466f-9ffa-e3f1b35a7186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:19.750073 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6c912-f5fb-44de-a759-1ea92213fc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:19.750751 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6c912-f5fb-44de-a759-1ea92213fc75 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:19.752017 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6c912-f5fb-44de-a759-1ea92213fc75 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:19.752017 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6c912-f5fb-44de-a759-1ea92213fc75 None admin] PATH_INFO: `/v3/users/fc49aa6e760148e4ba7c683401c41b57` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:19.753499 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6c912-f5fb-44de-a759-1ea92213fc75 None admin] RBAC: Authorizing `identity:get_user(user_id=fc49aa6e760148e4ba7c683401c41b57)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:19.755105 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6c912-f5fb-44de-a759-1ea92213fc75 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:19.756890 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 149/310] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:18:19 2022] GET /identity/v3/users/fc49aa6e760148e4ba7c683401c41b57 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:19.765368 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6c912-f5fb-44de-a759-1ea92213fc75 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:19.821856 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:19.857648 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 162/311] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:19.921768 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6c912-f5fb-44de-a759-1ea92213fc75 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:19.978134 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29105e0-2569-4f1c-b334-3626eb11f2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:19.979510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29105e0-2569-4f1c-b334-3626eb11f2be None admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:19.980103 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29105e0-2569-4f1c-b334-3626eb11f2be None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:19.980757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29105e0-2569-4f1c-b334-3626eb11f2be None admin] PATH_INFO: `/v3/system/users/fc49aa6e760148e4ba7c683401c41b57/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:19.983168 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29105e0-2569-4f1c-b334-3626eb11f2be None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fc49aa6e760148e4ba7c683401c41b57, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:19.985593 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29105e0-2569-4f1c-b334-3626eb11f2be None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:20.001347 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 150/312] 10.222.0.55 () {58 vars in 1334 bytes} [Tue Oct 4 16:18:19 2022] PUT /identity/v3/system/users/fc49aa6e760148e4ba7c683401c41b57/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:18:20.140329 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886a026-3627-466f-9ffa-e3f1b35a7186 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:20.253855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886a026-3627-466f-9ffa-e3f1b35a7186 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:20.284615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:20.302035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35b3f7-0c94-458c-bdc9-f3d3c308b4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:20.302697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35b3f7-0c94-458c-bdc9-f3d3c308b4d2 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:20.302969 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35b3f7-0c94-458c-bdc9-f3d3c308b4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:20.303270 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35b3f7-0c94-458c-bdc9-f3d3c308b4d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:20.314636 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35b3f7-0c94-458c-bdc9-f3d3c308b4d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:20.319751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-ff35b3f7-0c94-458c-bdc9-f3d3c308b4d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 16:18:20.319751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:20.319751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:20.319751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:20.319751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:20.319751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:20.319751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:20.319751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:20.319751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:20.319751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:20.319751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:20.319751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:20.319751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:20.319751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:20.319751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:20.319751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:20.321146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:20.321146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:20.321146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:20.321146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:20.321146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:20.321146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:20.321146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:20.321146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:20.321146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:20.321146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:20.321146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:20.321146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:20.321146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:20.321146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:20.321146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:20.321146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:20.322430 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:20.322430 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:20.322430 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:20.322430 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:20.322430 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:20.322430 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:20.322430 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:20.322430 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:20.322430 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:20.322430 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:20.322430 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 16:18:20.322430 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:20.322430 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 163/313] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:18:20.327259 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29105e0-2569-4f1c-b334-3626eb11f2be None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:20.437652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29105e0-2569-4f1c-b334-3626eb11f2be None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:20.452348 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:20.477108 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301d521-0ad8-4a16-bb6d-527de3d43dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:20.478552 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301d521-0ad8-4a16-bb6d-527de3d43dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:20.481346 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301d521-0ad8-4a16-bb6d-527de3d43dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:20.481979 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301d521-0ad8-4a16-bb6d-527de3d43dc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:20.483247 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301d521-0ad8-4a16-bb6d-527de3d43dc9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:20.483879 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301d521-0ad8-4a16-bb6d-527de3d43dc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:20.486297 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301d521-0ad8-4a16-bb6d-527de3d43dc9 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:20.500491 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 151/314] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:18:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:20.509504 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35b3f7-0c94-458c-bdc9-f3d3c308b4d2 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:20.659115 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35b3f7-0c94-458c-bdc9-f3d3c308b4d2 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:20.714087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f1dbf-00d2-44ba-9d91-79dafd3d8b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:20.715100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f1dbf-00d2-44ba-9d91-79dafd3d8b12 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:20.715541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f1dbf-00d2-44ba-9d91-79dafd3d8b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:20.715957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f1dbf-00d2-44ba-9d91-79dafd3d8b12 None admin] PATH_INFO: `/v3/users/f8720d64610c4ec0ac9241ce795203d9` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:20.717726 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f1dbf-00d2-44ba-9d91-79dafd3d8b12 None admin] RBAC: Authorizing `identity:get_user(user_id=f8720d64610c4ec0ac9241ce795203d9)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:20.720044 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f1dbf-00d2-44ba-9d91-79dafd3d8b12 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:20.722781 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 164/315] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:18:20 2022] GET /identity/v3/users/f8720d64610c4ec0ac9241ce795203d9 => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:20.728590 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301d521-0ad8-4a16-bb6d-527de3d43dc9 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:20.833889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301d521-0ad8-4a16-bb6d-527de3d43dc9 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:20.867427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d4fcc-d4b6-40c6-ae8f-480436af908c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:20.868045 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d4fcc-d4b6-40c6-ae8f-480436af908c None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:20.868320 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d4fcc-d4b6-40c6-ae8f-480436af908c None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:20.868586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d4fcc-d4b6-40c6-ae8f-480436af908c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:20.914921 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:20.955307 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d4fcc-d4b6-40c6-ae8f-480436af908c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:20.958059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d4fcc-d4b6-40c6-ae8f-480436af908c None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:21.113257 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 152/316] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:18:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:18:21.119123 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f1dbf-00d2-44ba-9d91-79dafd3d8b12 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:21.174489 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:21.222609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f1dbf-00d2-44ba-9d91-79dafd3d8b12 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:21.256868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3a4da-833a-4421-b282-25d3ad6b6fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:21.257508 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3a4da-833a-4421-b282-25d3ad6b6fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:21.257783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3a4da-833a-4421-b282-25d3ad6b6fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:21.258052 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3a4da-833a-4421-b282-25d3ad6b6fe6 None admin] PATH_INFO: `/v3/projects/85526afc0e3249f2af1dd595350c99ca` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:21.259203 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3a4da-833a-4421-b282-25d3ad6b6fe6 None admin] RBAC: Authorizing `identity:get_project(project_id=85526afc0e3249f2af1dd595350c99ca)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:21.260722 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3a4da-833a-4421-b282-25d3ad6b6fe6 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:21.262727 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 165/317] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:21 2022] GET /identity/v3/projects/85526afc0e3249f2af1dd595350c99ca => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:21.269204 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d4fcc-d4b6-40c6-ae8f-480436af908c None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:21.386132 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:21.422866 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d4fcc-d4b6-40c6-ae8f-480436af908c None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:21.477761 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de412b9b-e4e9-48b1-8689-364d82a9bf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:21.478718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de412b9b-e4e9-48b1-8689-364d82a9bf73 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:21.479203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de412b9b-e4e9-48b1-8689-364d82a9bf73 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:21.479636 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de412b9b-e4e9-48b1-8689-364d82a9bf73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:21.480888 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de412b9b-e4e9-48b1-8689-364d82a9bf73 None admin] RBAC: Adding query filter params (role.id=f889fef4a0c74c31a7942ec629ccf0ed, scope.project.id=85526afc0e3249f2af1dd595350c99ca, user.id=f8720d64610c4ec0ac9241ce795203d9) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:21.481383 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de412b9b-e4e9-48b1-8689-364d82a9bf73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:21.483837 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de412b9b-e4e9-48b1-8689-364d82a9bf73 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:21.494414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 153/318] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:18:21 2022] GET /identity/v3/role_assignments?user.id=f8720d64610c4ec0ac9241ce795203d9&scope.project.id=85526afc0e3249f2af1dd595350c99ca&role.id=f889fef4a0c74c31a7942ec629ccf0ed => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:21.927359 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28658f13-1ecc-4bda-9717-f376831cc71d None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:21.927906 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28658f13-1ecc-4bda-9717-f376831cc71d None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:21.927906 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28658f13-1ecc-4bda-9717-f376831cc71d None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:21.929474 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 166/319] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:21.934881 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd8471-0f6c-462b-be46-9e8d4108c616 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:21.935156 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd8471-0f6c-462b-be46-9e8d4108c616 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:21.935580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd8471-0f6c-462b-be46-9e8d4108c616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:21.954904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-c3fd8471-0f6c-462b-be46-9e8d4108c616 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:21.956361 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c3fd8471-0f6c-462b-be46-9e8d4108c616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:21.986585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb956cc0-b419-40a0-bb18-b0e49dc73432 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:21.987510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb956cc0-b419-40a0-bb18-b0e49dc73432 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:21.988665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb956cc0-b419-40a0-bb18-b0e49dc73432 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:21.991683 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 167/320] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:21.997510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd40139-802c-416f-ba1c-956629b1a7eb None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:21.997510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd40139-802c-416f-ba1c-956629b1a7eb None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:21.997749 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd40139-802c-416f-ba1c-956629b1a7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:22.017645 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-dcd40139-802c-416f-ba1c-956629b1a7eb None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:22.018825 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-dcd40139-802c-416f-ba1c-956629b1a7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:22.047119 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 154/321] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:22.103020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 168/322] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 16:18:22.314263 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd8471-0f6c-462b-be46-9e8d4108c616 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:22.370522 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd40139-802c-416f-ba1c-956629b1a7eb None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:22.390019 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:22.436487 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd8471-0f6c-462b-be46-9e8d4108c616 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:22.442734 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:22.478305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b15c75-6d35-4a3f-94d6-f2d2c1d43ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:22.479275 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b15c75-6d35-4a3f-94d6-f2d2c1d43ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:22.479685 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b15c75-6d35-4a3f-94d6-f2d2c1d43ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:22.480106 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b15c75-6d35-4a3f-94d6-f2d2c1d43ce1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:22.492272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b15c75-6d35-4a3f-94d6-f2d2c1d43ce1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:22.497318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-d7b15c75-6d35-4a3f-94d6-f2d2c1d43ce1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 16:18:22.497318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:22.497318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:22.497318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:22.497318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:22.497318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:22.497318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:22.497318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:22.497318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:22.497318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:22.497318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:22.497318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:22.497318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:22.497318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:22.497318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:22.497318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:22.498203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:22.498203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:22.498203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:22.498203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:22.498203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:22.498203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:22.498203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:22.498203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:22.498203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:22.498203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:22.498203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:22.498203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:22.498203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:22.498203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:22.498203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:22.498203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:22.504056 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:22.504056 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:22.504056 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:22.504056 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:22.504056 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:22.504056 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:22.504056 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:22.504056 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:22.504056 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:22.504056 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:22.504056 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 16:18:22.504056 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:22.504056 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 155/323] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:22.504753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd40139-802c-416f-ba1c-956629b1a7eb None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:22.504825 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d613238-d493-46bd-8f03-1ee796fa93cd None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:22.504825 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d613238-d493-46bd-8f03-1ee796fa93cd None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:22.504825 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d613238-d493-46bd-8f03-1ee796fa93cd None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:22.504825 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 156/324] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:22.506813 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f636e-6577-4c3b-9555-0077fc4d6732 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:22.507112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f636e-6577-4c3b-9555-0077fc4d6732 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:22.507382 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f636e-6577-4c3b-9555-0077fc4d6732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:22.525413 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-0b5f636e-6577-4c3b-9555-0077fc4d6732 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:22.526566 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-0b5f636e-6577-4c3b-9555-0077fc4d6732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:22.534675 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895bbd1-e4e6-497b-b21a-15a58efb310c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:22.535341 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895bbd1-e4e6-497b-b21a-15a58efb310c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:22.535612 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895bbd1-e4e6-497b-b21a-15a58efb310c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:22.535870 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895bbd1-e4e6-497b-b21a-15a58efb310c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:22.536975 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895bbd1-e4e6-497b-b21a-15a58efb310c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:22.538415 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895bbd1-e4e6-497b-b21a-15a58efb310c None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:22.540501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 169/325] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:22.540903 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895bbd1-e4e6-497b-b21a-15a58efb310c None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:22.597323 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 157/326] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:22.599168 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f636e-6577-4c3b-9555-0077fc4d6732 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:22.643830 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895bbd1-e4e6-497b-b21a-15a58efb310c None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:22.657048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:22.666664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:22.685937 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0f151-f7bf-40e9-946a-0ebe70f58074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:22.686657 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0f151-f7bf-40e9-946a-0ebe70f58074 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:22.687016 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0f151-f7bf-40e9-946a-0ebe70f58074 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:22.687380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0f151-f7bf-40e9-946a-0ebe70f58074 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:22.688116 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0f151-f7bf-40e9-946a-0ebe70f58074 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:22.688461 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0f151-f7bf-40e9-946a-0ebe70f58074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:22.690040 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0f151-f7bf-40e9-946a-0ebe70f58074 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:22.699328 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 170/327] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:18:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:22.701527 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f636e-6577-4c3b-9555-0077fc4d6732 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:22.704931 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0f151-f7bf-40e9-946a-0ebe70f58074 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:22.735125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029fb62-82e5-42b7-955e-1f04d512d4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:22.735752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029fb62-82e5-42b7-955e-1f04d512d4db None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:22.736030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029fb62-82e5-42b7-955e-1f04d512d4db None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:22.736395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029fb62-82e5-42b7-955e-1f04d512d4db None admin] PATH_INFO: `/v3/groups` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:22.736927 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029fb62-82e5-42b7-955e-1f04d512d4db None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:22.738379 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029fb62-82e5-42b7-955e-1f04d512d4db None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:22.756975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 158/328] 10.222.0.55 () {60 vars in 1134 bytes} [Tue Oct 4 16:18:22 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:18:22.821866 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0f151-f7bf-40e9-946a-0ebe70f58074 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:22.861436 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28d845-1956-452f-87f2-c9bd8ff47ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:22.862531 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28d845-1956-452f-87f2-c9bd8ff47ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:22.862961 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28d845-1956-452f-87f2-c9bd8ff47ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:22.863392 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28d845-1956-452f-87f2-c9bd8ff47ed6 None admin] PATH_INFO: `/v3/users/0719cd5a8f844d1db1ecf3a57130c841` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:22.864882 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28d845-1956-452f-87f2-c9bd8ff47ed6 None admin] RBAC: Authorizing `identity:get_user(user_id=0719cd5a8f844d1db1ecf3a57130c841)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:22.865208 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029fb62-82e5-42b7-955e-1f04d512d4db None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:22.866716 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28d845-1956-452f-87f2-c9bd8ff47ed6 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:22.868675 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 171/329] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:18:22 2022] GET /identity/v3/users/0719cd5a8f844d1db1ecf3a57130c841 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:22.874510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28d845-1956-452f-87f2-c9bd8ff47ed6 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:22.934031 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:22.993187 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029fb62-82e5-42b7-955e-1f04d512d4db None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:22.998879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28d845-1956-452f-87f2-c9bd8ff47ed6 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:23.019034 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:23.041048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afaf0a-3f9d-40f8-aff9-a545774fcc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:23.041692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afaf0a-3f9d-40f8-aff9-a545774fcc3d None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:23.042027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afaf0a-3f9d-40f8-aff9-a545774fcc3d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:23.042290 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afaf0a-3f9d-40f8-aff9-a545774fcc3d None admin] PATH_INFO: `/v3/system/users/0719cd5a8f844d1db1ecf3a57130c841/roles/f889fef4a0c74c31a7942ec629ccf0ed` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:23.043711 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdde3d8-c633-4dfe-93e2-9fb3d49e658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:23.043973 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afaf0a-3f9d-40f8-aff9-a545774fcc3d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0719cd5a8f844d1db1ecf3a57130c841, role_id=f889fef4a0c74c31a7942ec629ccf0ed)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:23.045148 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdde3d8-c633-4dfe-93e2-9fb3d49e658d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:23.045621 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdde3d8-c633-4dfe-93e2-9fb3d49e658d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:23.045788 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afaf0a-3f9d-40f8-aff9-a545774fcc3d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:23.046259 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdde3d8-c633-4dfe-93e2-9fb3d49e658d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:23.059394 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 172/330] 10.222.0.55 () {58 vars in 1334 bytes} [Tue Oct 4 16:18:22 2022] PUT /identity/v3/system/users/0719cd5a8f844d1db1ecf3a57130c841/roles/f889fef4a0c74c31a7942ec629ccf0ed => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:18:23.063507 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdde3d8-c633-4dfe-93e2-9fb3d49e658d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:23.069489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-2cdde3d8-c633-4dfe-93e2-9fb3d49e658d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:18:23.069489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:23.069489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:23.069489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:23.069489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:23.069489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:23.069489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:23.069489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:23.069489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:23.069489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:23.069489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:23.069489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:23.069489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:23.069489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:23.069489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:23.069489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:23.070904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:23.070904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:23.070904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:23.070904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:23.070904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:23.070904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:23.070904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:23.070904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:23.070904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:23.070904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:23.070904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:23.070904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:23.070904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:23.070904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:23.070904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:23.070904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:23.071746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:23.071746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:23.071746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:23.071746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:23.071746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:23.071746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:23.071746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:23.071746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:23.071746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:23.071746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:23.071746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:18:23.071746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:23.072356 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 159/331] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:23.077807 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afaf0a-3f9d-40f8-aff9-a545774fcc3d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:23.201598 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afaf0a-3f9d-40f8-aff9-a545774fcc3d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:23.217721 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:23.246295 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98a83a-5278-401f-bcd4-069bb7abdd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:23.246938 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98a83a-5278-401f-bcd4-069bb7abdd2e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:23.247289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98a83a-5278-401f-bcd4-069bb7abdd2e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:23.247568 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98a83a-5278-401f-bcd4-069bb7abdd2e None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:23.248290 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98a83a-5278-401f-bcd4-069bb7abdd2e None admin] RBAC: Adding query filter params (name=member) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:23.248596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98a83a-5278-401f-bcd4-069bb7abdd2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:23.250117 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98a83a-5278-401f-bcd4-069bb7abdd2e None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:23.260749 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 173/332] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:18:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:23.266569 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdde3d8-c633-4dfe-93e2-9fb3d49e658d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:23.391781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdde3d8-c633-4dfe-93e2-9fb3d49e658d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:23.431423 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5fc2c-4c06-458e-9acf-4ae8882733c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:23.432699 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5fc2c-4c06-458e-9acf-4ae8882733c2 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:23.433219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5fc2c-4c06-458e-9acf-4ae8882733c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:23.433702 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5fc2c-4c06-458e-9acf-4ae8882733c2 None admin] PATH_INFO: `/v3/users/fc49aa6e760148e4ba7c683401c41b57` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:23.435125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5fc2c-4c06-458e-9acf-4ae8882733c2 None admin] RBAC: Authorizing `identity:get_user(user_id=fc49aa6e760148e4ba7c683401c41b57)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:23.436790 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5fc2c-4c06-458e-9acf-4ae8882733c2 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:23.439054 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 160/333] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:18:23 2022] GET /identity/v3/users/fc49aa6e760148e4ba7c683401c41b57 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:23.445182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98a83a-5278-401f-bcd4-069bb7abdd2e None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:23.573093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98a83a-5278-401f-bcd4-069bb7abdd2e None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:23.627940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d441bf-0e4a-48e8-924f-83f49a3cdc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:23.628571 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d441bf-0e4a-48e8-924f-83f49a3cdc4d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:23.628854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d441bf-0e4a-48e8-924f-83f49a3cdc4d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:23.629185 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d441bf-0e4a-48e8-924f-83f49a3cdc4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:23.629935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d441bf-0e4a-48e8-924f-83f49a3cdc4d None admin] RBAC: Adding query filter params (role.id=5cf61f379b4d49cb9e19605796d13f62, user.id=fc49aa6e760148e4ba7c683401c41b57, scope.system=all) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:23.630242 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d441bf-0e4a-48e8-924f-83f49a3cdc4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:23.631792 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d441bf-0e4a-48e8-924f-83f49a3cdc4d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:23.645097 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 174/334] 10.222.0.55 () {56 vars in 1308 bytes} [Tue Oct 4 16:18:23 2022] GET /identity/v3/role_assignments?user.id=fc49aa6e760148e4ba7c683401c41b57&scope.system=all&role.id=5cf61f379b4d49cb9e19605796d13f62 => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:25.285001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65429f0-37bc-487e-a0d0-62cec72d3768 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:25.285572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65429f0-37bc-487e-a0d0-62cec72d3768 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:25.285572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65429f0-37bc-487e-a0d0-62cec72d3768 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:25.287303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 161/335] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:25.293071 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179678ab-51c0-486a-8ad4-07a6317d5d20 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:25.293618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179678ab-51c0-486a-8ad4-07a6317d5d20 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:25.293618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179678ab-51c0-486a-8ad4-07a6317d5d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:25.318521 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-179678ab-51c0-486a-8ad4-07a6317d5d20 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:25.319804 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-179678ab-51c0-486a-8ad4-07a6317d5d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:25.354048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:25.399223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 175/336] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:25.494686 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac9b22-7701-400d-915b-d2a48c21f477 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:25.495036 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac9b22-7701-400d-915b-d2a48c21f477 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:25.495259 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac9b22-7701-400d-915b-d2a48c21f477 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:25.496888 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 162/337] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:25.503408 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942c254-5f60-4a89-b4af-ea881f832c72 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:25.503695 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942c254-5f60-4a89-b4af-ea881f832c72 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:25.503973 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942c254-5f60-4a89-b4af-ea881f832c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:25.523825 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-3942c254-5f60-4a89-b4af-ea881f832c72 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:25.525027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-3942c254-5f60-4a89-b4af-ea881f832c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:25.617753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 176/338] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 16:18:25.847054 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbe76d-7792-41f6-a9aa-27f26b44fc88 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:25.847728 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbe76d-7792-41f6-a9aa-27f26b44fc88 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:25.848235 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbe76d-7792-41f6-a9aa-27f26b44fc88 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:25.850086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 163/339] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:25.855996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1ef17-e95a-4536-b13d-ddff567a5665 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:25.856553 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1ef17-e95a-4536-b13d-ddff567a5665 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:25.857031 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1ef17-e95a-4536-b13d-ddff567a5665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:25.882023 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-8dd1ef17-e95a-4536-b13d-ddff567a5665 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:25.883597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8dd1ef17-e95a-4536-b13d-ddff567a5665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:25.970832 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbe76d-7792-41f6-a9aa-27f26b44fc88 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:25.977733 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 177/340] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:26.062763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:26.132738 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbe76d-7792-41f6-a9aa-27f26b44fc88 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:26.139357 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1ef17-e95a-4536-b13d-ddff567a5665 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:26.172714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2013a-cf4f-48ca-80d5-4b00c235c761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:26.173368 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2013a-cf4f-48ca-80d5-4b00c235c761 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:26.173645 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2013a-cf4f-48ca-80d5-4b00c235c761 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:26.173916 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2013a-cf4f-48ca-80d5-4b00c235c761 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:26.188384 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2013a-cf4f-48ca-80d5-4b00c235c761 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:26.191346 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:26.194027 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-eda2013a-cf4f-48ca-80d5-4b00c235c761 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:18:26.194027 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:26.194027 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:26.194027 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:26.194027 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:26.194027 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:26.194027 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:26.194027 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:26.194027 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:26.194027 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:26.194027 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:26.194027 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:26.194027 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:26.194027 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:26.194027 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:26.194027 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:26.195014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:26.195014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:26.195014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:26.195014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:26.195014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:26.195014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:26.195014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:26.195014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:26.195014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:26.195014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:26.195014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:26.195014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:26.195014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:26.195014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:26.195014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:26.195014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:26.196229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:26.196229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:26.196229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:26.196229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:26.196229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:26.196229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:26.196229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:26.196229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:26.196229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:26.196229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:26.196229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:18:26.196229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:26.196229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 164/341] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:26.201645 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2013a-cf4f-48ca-80d5-4b00c235c761 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:26.348102 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2013a-cf4f-48ca-80d5-4b00c235c761 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:26.363582 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:26.393697 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e65cf-88a5-44ed-aa78-4bc84860f417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:26.394417 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e65cf-88a5-44ed-aa78-4bc84860f417 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:26.394798 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e65cf-88a5-44ed-aa78-4bc84860f417 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:26.395190 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e65cf-88a5-44ed-aa78-4bc84860f417 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:26.396206 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e65cf-88a5-44ed-aa78-4bc84860f417 None admin] RBAC: Adding query filter params (name=member) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:26.396728 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e65cf-88a5-44ed-aa78-4bc84860f417 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:26.398566 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e65cf-88a5-44ed-aa78-4bc84860f417 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:26.409199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 165/342] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:18:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:26.414877 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e65cf-88a5-44ed-aa78-4bc84860f417 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:26.416617 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1ef17-e95a-4536-b13d-ddff567a5665 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:26.521793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3c974-e962-49ab-a2e0-895270cb7377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:26.523186 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3c974-e962-49ab-a2e0-895270cb7377 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:26.523917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3c974-e962-49ab-a2e0-895270cb7377 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:26.524491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3c974-e962-49ab-a2e0-895270cb7377 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:26.557804 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3c974-e962-49ab-a2e0-895270cb7377 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:26.563289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-4af3c974-e962-49ab-a2e0-895270cb7377 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 16:18:26.563289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:26.563289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:26.563289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:26.563289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:26.563289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:26.563289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:26.563289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:26.563289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:26.563289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:26.563289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:26.563289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:26.563289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:26.563289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:26.563289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:26.563289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:26.564281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:26.564281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:26.564281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:26.564281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:26.564281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:26.564281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:26.564281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:26.564281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:26.564281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:26.564281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:26.564281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:26.564281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:26.564281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:26.564281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:26.564281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:26.564281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:26.565136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:26.565136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:26.565136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:26.565136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:26.565136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:26.565136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:26.565136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:26.565136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:26.565136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:26.565136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:26.565136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 16:18:26.565136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:26.568606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 178/343] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:26.570246 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ec751-b991-4f56-a0c7-d71edf6a2120 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:26.570757 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ec751-b991-4f56-a0c7-d71edf6a2120 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:26.571295 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ec751-b991-4f56-a0c7-d71edf6a2120 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:26.573220 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 179/344] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:26.574298 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ec751-b991-4f56-a0c7-d71edf6a2120 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:26.639957 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e65cf-88a5-44ed-aa78-4bc84860f417 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:26.684866 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de65735-92f6-420b-bae6-3be2be2ac85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:26.685556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de65735-92f6-420b-bae6-3be2be2ac85a None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:26.685842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de65735-92f6-420b-bae6-3be2be2ac85a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:26.687058 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de65735-92f6-420b-bae6-3be2be2ac85a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:26.704373 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:26.737377 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ec751-b991-4f56-a0c7-d71edf6a2120 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:26.747561 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:26.777218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856b07f-5e50-4685-9008-eea4a07b8e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:26.777849 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856b07f-5e50-4685-9008-eea4a07b8e68 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:26.778122 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856b07f-5e50-4685-9008-eea4a07b8e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:26.778387 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856b07f-5e50-4685-9008-eea4a07b8e68 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:26.779113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856b07f-5e50-4685-9008-eea4a07b8e68 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:26.779414 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856b07f-5e50-4685-9008-eea4a07b8e68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:26.781075 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856b07f-5e50-4685-9008-eea4a07b8e68 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:26.789947 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de65735-92f6-420b-bae6-3be2be2ac85a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:26.791609 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de65735-92f6-420b-bae6-3be2be2ac85a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:26.792208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 180/345] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:18:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:26.793531 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ab2d4-b93f-4088-adea-f0d9b8a33755 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:26.800787 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ab2d4-b93f-4088-adea-f0d9b8a33755 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:26.801685 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ab2d4-b93f-4088-adea-f0d9b8a33755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:26.821113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-285ab2d4-b93f-4088-adea-f0d9b8a33755 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:26.822392 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-285ab2d4-b93f-4088-adea-f0d9b8a33755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:26.901907 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 181/346] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:26.903000 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ab2d4-b93f-4088-adea-f0d9b8a33755 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:26.922771 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 166/347] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:18:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 16:18:26.923826 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de65735-92f6-420b-bae6-3be2be2ac85a None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:27.007944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:27.047764 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de65735-92f6-420b-bae6-3be2be2ac85a None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:27.074493 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:27.091238 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24745766-45ec-4e4d-95f7-18733fa7261f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:27.092435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24745766-45ec-4e4d-95f7-18733fa7261f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:27.092723 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24745766-45ec-4e4d-95f7-18733fa7261f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:27.093000 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24745766-45ec-4e4d-95f7-18733fa7261f None admin] PATH_INFO: `/v3/users/0719cd5a8f844d1db1ecf3a57130c841` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:27.094475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24745766-45ec-4e4d-95f7-18733fa7261f None admin] RBAC: Authorizing `identity:get_user(user_id=0719cd5a8f844d1db1ecf3a57130c841)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:27.096249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24745766-45ec-4e4d-95f7-18733fa7261f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:27.098093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 167/348] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:18:26 2022] GET /identity/v3/users/0719cd5a8f844d1db1ecf3a57130c841 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:27.098659 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24745766-45ec-4e4d-95f7-18733fa7261f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:27.130564 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ab2d4-b93f-4088-adea-f0d9b8a33755 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:27.224772 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24745766-45ec-4e4d-95f7-18733fa7261f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:27.227942 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3991b-7be4-4a84-9d00-b6b13b0bde0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:27.228612 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3991b-7be4-4a84-9d00-b6b13b0bde0d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:27.228881 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3991b-7be4-4a84-9d00-b6b13b0bde0d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:27.229174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3991b-7be4-4a84-9d00-b6b13b0bde0d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:27.261632 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3991b-7be4-4a84-9d00-b6b13b0bde0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:27.273751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-e7a3991b-7be4-4a84-9d00-b6b13b0bde0d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 16:18:27.273751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:27.273751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:27.273751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:27.273751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:27.273751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:27.273751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:27.273751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:27.273751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:27.273751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:27.273751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:27.273751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:27.273751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:27.273751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:27.273751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:27.273751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:27.276365 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:27.276365 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:27.276365 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:27.276365 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:27.276365 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:27.276365 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:27.276365 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:27.276365 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:27.276365 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:27.276365 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:27.276365 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:27.276365 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:27.276365 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:27.276365 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:27.276365 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:27.276365 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:27.278853 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:27.278853 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:27.278853 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:27.278853 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:27.278853 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:27.278853 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:27.278853 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:27.278853 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:27.278853 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:27.278853 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:27.278853 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 16:18:27.278853 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:27.284087 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3d8e0-5b8f-4e15-9e37-1212255a9d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:27.284087 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3d8e0-5b8f-4e15-9e37-1212255a9d8b None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:27.284087 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3d8e0-5b8f-4e15-9e37-1212255a9d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:27.284087 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3d8e0-5b8f-4e15-9e37-1212255a9d8b None admin] PATH_INFO: `/v3/projects/c68abb6013ea44fb9fad2c8141d11c05` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:27.284658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 182/349] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Oct 4 16:18:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:27.284658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3991b-7be4-4a84-9d00-b6b13b0bde0d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:27.284938 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3d8e0-5b8f-4e15-9e37-1212255a9d8b None admin] RBAC: Authorizing `identity:get_project(project_id=c68abb6013ea44fb9fad2c8141d11c05)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:27.284938 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3d8e0-5b8f-4e15-9e37-1212255a9d8b None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:27.291737 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 168/350] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:27 2022] GET /identity/v3/projects/c68abb6013ea44fb9fad2c8141d11c05 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:27.295892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3d8e0-5b8f-4e15-9e37-1212255a9d8b None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:27.319382 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:27.434917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3991b-7be4-4a84-9d00-b6b13b0bde0d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:27.435642 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3d8e0-5b8f-4e15-9e37-1212255a9d8b None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:27.473759 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be947de3-8d5d-4afe-9607-26f1a0b4bbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:27.474490 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be947de3-8d5d-4afe-9607-26f1a0b4bbe3 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:27.474774 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be947de3-8d5d-4afe-9607-26f1a0b4bbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:27.475064 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be947de3-8d5d-4afe-9607-26f1a0b4bbe3 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:27.475741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be947de3-8d5d-4afe-9607-26f1a0b4bbe3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:27.476038 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be947de3-8d5d-4afe-9607-26f1a0b4bbe3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:27.477629 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be947de3-8d5d-4afe-9607-26f1a0b4bbe3 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:27.477817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f68346-42bd-4e9b-afec-9ede38355667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:27.478291 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f68346-42bd-4e9b-afec-9ede38355667 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:27.478574 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f68346-42bd-4e9b-afec-9ede38355667 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:27.478849 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f68346-42bd-4e9b-afec-9ede38355667 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:27.479614 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f68346-42bd-4e9b-afec-9ede38355667 None admin] RBAC: Adding query filter params (role.id=f889fef4a0c74c31a7942ec629ccf0ed, user.id=0719cd5a8f844d1db1ecf3a57130c841, scope.system=all) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:27.479918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f68346-42bd-4e9b-afec-9ede38355667 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:27.482052 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f68346-42bd-4e9b-afec-9ede38355667 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:27.483825 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:27.488366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 169/351] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:18:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:27.489252 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be947de3-8d5d-4afe-9607-26f1a0b4bbe3 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:27.497463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 183/352] 10.222.0.55 () {56 vars in 1308 bytes} [Tue Oct 4 16:18:27 2022] GET /identity/v3/role_assignments?user.id=0719cd5a8f844d1db1ecf3a57130c841&scope.system=all&role.id=f889fef4a0c74c31a7942ec629ccf0ed => generated 510 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:27.498345 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f68346-42bd-4e9b-afec-9ede38355667 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:27.585592 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:27.623641 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f68346-42bd-4e9b-afec-9ede38355667 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:27.630758 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be947de3-8d5d-4afe-9607-26f1a0b4bbe3 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:27.668446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849f00d-6c6a-4cdd-b565-0d4b6ac480fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:27.669278 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849f00d-6c6a-4cdd-b565-0d4b6ac480fc None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:27.669538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849f00d-6c6a-4cdd-b565-0d4b6ac480fc None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:27.670185 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849f00d-6c6a-4cdd-b565-0d4b6ac480fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:27.675296 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2d6c9-439d-47f4-a537-5f65dcb2d661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:27.676308 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2d6c9-439d-47f4-a537-5f65dcb2d661 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:27.676808 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2d6c9-439d-47f4-a537-5f65dcb2d661 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:27.677317 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2d6c9-439d-47f4-a537-5f65dcb2d661 None admin] PATH_INFO: `/v3/groups/06e2e17186494298914cca80d561ca8d` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:27.684644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849f00d-6c6a-4cdd-b565-0d4b6ac480fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:27.687098 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2d6c9-439d-47f4-a537-5f65dcb2d661 None admin] RBAC: Authorizing `identity:get_group(group_id=06e2e17186494298914cca80d561ca8d)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:27.688846 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2d6c9-439d-47f4-a537-5f65dcb2d661 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:27.690854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-8849f00d-6c6a-4cdd-b565-0d4b6ac480fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:18:27.690854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:27.690854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:27.690854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:27.690854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:27.690854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:27.690854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:27.690854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:27.690854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:27.690854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:27.690854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:27.690854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:27.690854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:27.690854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:27.690854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:27.690854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:27.691771 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:27.691771 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:27.691771 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:27.691771 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:27.691771 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:27.691771 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:27.691771 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:27.691771 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:27.691771 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:27.691771 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:27.691771 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:27.691771 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:27.691771 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:27.691771 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:27.691771 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:27.691771 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:27.692562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:27.692562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:27.692562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:27.692562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:27.692562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:27.692562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:27.692562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:27.692562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:27.692562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:27.692562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:27.692562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:18:27.692562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:27.692562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 184/353] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:27.699662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849f00d-6c6a-4cdd-b565-0d4b6ac480fc None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:27.700055 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 170/354] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Oct 4 16:18:27 2022] GET /identity/v3/groups/06e2e17186494298914cca80d561ca8d => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:27.701769 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c596e-2106-4ee4-9bd9-d84716ee9d45 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:27.702302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c596e-2106-4ee4-9bd9-d84716ee9d45 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:27.702779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c596e-2106-4ee4-9bd9-d84716ee9d45 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:27.704733 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 171/355] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:27.709447 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c596e-2106-4ee4-9bd9-d84716ee9d45 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:27.780530 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:27.826177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849f00d-6c6a-4cdd-b565-0d4b6ac480fc None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:27.846458 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c596e-2106-4ee4-9bd9-d84716ee9d45 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:27.877630 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c5cd4-1ad5-47c0-a35d-19e18e390131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:27.878262 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c5cd4-1ad5-47c0-a35d-19e18e390131 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:27.878532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c5cd4-1ad5-47c0-a35d-19e18e390131 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:27.878805 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c5cd4-1ad5-47c0-a35d-19e18e390131 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:27.888266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:27.896314 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41728e-1467-4985-89e4-c11cf928d60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:27.897037 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41728e-1467-4985-89e4-c11cf928d60f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:27.897312 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41728e-1467-4985-89e4-c11cf928d60f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:27.897582 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41728e-1467-4985-89e4-c11cf928d60f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:27.898616 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41728e-1467-4985-89e4-c11cf928d60f None admin] RBAC: Adding query filter params (group.id=06e2e17186494298914cca80d561ca8d, role.id=5cf61f379b4d49cb9e19605796d13f62, scope.project.id=c68abb6013ea44fb9fad2c8141d11c05) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:27.899321 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41728e-1467-4985-89e4-c11cf928d60f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:27.901082 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41728e-1467-4985-89e4-c11cf928d60f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:27.908646 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 172/356] 10.222.0.55 () {56 vars in 1376 bytes} [Tue Oct 4 16:18:27 2022] GET /identity/v3/role_assignments?group.id=06e2e17186494298914cca80d561ca8d&scope.project.id=c68abb6013ea44fb9fad2c8141d11c05&role.id=5cf61f379b4d49cb9e19605796d13f62 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:27.910348 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739889d-b9c3-4985-8b8e-48b32503e99f None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:27.910622 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739889d-b9c3-4985-8b8e-48b32503e99f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:27.911835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739889d-b9c3-4985-8b8e-48b32503e99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:27.939597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-b739889d-b9c3-4985-8b8e-48b32503e99f None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:27.941631 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-b739889d-b9c3-4985-8b8e-48b32503e99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:27.960287 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c5cd4-1ad5-47c0-a35d-19e18e390131 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:27.961819 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c5cd4-1ad5-47c0-a35d-19e18e390131 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:28.035331 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:28.053984 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 173/357] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:28.055135 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739889d-b9c3-4985-8b8e-48b32503e99f None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:28.112087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 185/358] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:18:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:18:28.119054 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c5cd4-1ad5-47c0-a35d-19e18e390131 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:28.209221 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739889d-b9c3-4985-8b8e-48b32503e99f None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:28.245919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:28.258259 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6a33a-3087-4aa5-a68d-af1be4edcc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:28.258904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6a33a-3087-4aa5-a68d-af1be4edcc2b None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:28.259229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6a33a-3087-4aa5-a68d-af1be4edcc2b None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:28.259650 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6a33a-3087-4aa5-a68d-af1be4edcc2b None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:28.260353 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6a33a-3087-4aa5-a68d-af1be4edcc2b None admin] RBAC: Adding query filter params (name=member) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:28.260942 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6a33a-3087-4aa5-a68d-af1be4edcc2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:28.263324 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6a33a-3087-4aa5-a68d-af1be4edcc2b None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:28.267776 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c5cd4-1ad5-47c0-a35d-19e18e390131 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:28.277206 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 174/359] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:18:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:28.281797 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6a33a-3087-4aa5-a68d-af1be4edcc2b None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:28.346296 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2650913-dd55-4f24-b672-f64210fe5312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:28.346944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2650913-dd55-4f24-b672-f64210fe5312 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:28.347259 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2650913-dd55-4f24-b672-f64210fe5312 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:28.347527 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2650913-dd55-4f24-b672-f64210fe5312 None admin] PATH_INFO: `/v3/projects/c68abb6013ea44fb9fad2c8141d11c05` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:28.348675 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2650913-dd55-4f24-b672-f64210fe5312 None admin] RBAC: Authorizing `identity:get_project(project_id=c68abb6013ea44fb9fad2c8141d11c05)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:28.350123 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2650913-dd55-4f24-b672-f64210fe5312 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:28.352773 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 186/360] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:28 2022] GET /identity/v3/projects/c68abb6013ea44fb9fad2c8141d11c05 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:28.358883 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2650913-dd55-4f24-b672-f64210fe5312 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:28.403622 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:28.441074 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6a33a-3087-4aa5-a68d-af1be4edcc2b None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:28.498763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53a341-59ad-4d21-af1c-d7b052aa5298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:28.499600 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53a341-59ad-4d21-af1c-d7b052aa5298 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:28.499930 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53a341-59ad-4d21-af1c-d7b052aa5298 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:28.500205 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53a341-59ad-4d21-af1c-d7b052aa5298 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:28.527939 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2650913-dd55-4f24-b672-f64210fe5312 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:28.568960 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:28.576493 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30812244-3dc9-4e03-a46f-cd6194921bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:28.577179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30812244-3dc9-4e03-a46f-cd6194921bcc None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:28.577462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30812244-3dc9-4e03-a46f-cd6194921bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:28.577733 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30812244-3dc9-4e03-a46f-cd6194921bcc None admin] PATH_INFO: `/v3/groups/06e2e17186494298914cca80d561ca8d` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:28.579258 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30812244-3dc9-4e03-a46f-cd6194921bcc None admin] RBAC: Authorizing `identity:get_group(group_id=06e2e17186494298914cca80d561ca8d)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:28.580968 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30812244-3dc9-4e03-a46f-cd6194921bcc None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:28.582879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 187/361] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Oct 4 16:18:28 2022] GET /identity/v3/groups/06e2e17186494298914cca80d561ca8d => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:28.584269 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5c7ac-1e64-4e59-ad8d-e80c65ab9d90 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:28.584543 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5c7ac-1e64-4e59-ad8d-e80c65ab9d90 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:28.584816 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5c7ac-1e64-4e59-ad8d-e80c65ab9d90 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:28.586144 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 188/362] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:28.586718 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5c7ac-1e64-4e59-ad8d-e80c65ab9d90 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:28.599834 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53a341-59ad-4d21-af1c-d7b052aa5298 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:28.601537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53a341-59ad-4d21-af1c-d7b052aa5298 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:28.714359 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:28.732133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5c7ac-1e64-4e59-ad8d-e80c65ab9d90 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:28.733557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 175/363] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:18:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 16:18:28.734222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53a341-59ad-4d21-af1c-d7b052aa5298 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:28.776495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ccbbb-9d74-45a1-bac1-4120c8837900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:28.777556 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ccbbb-9d74-45a1-bac1-4120c8837900 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:28.778053 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ccbbb-9d74-45a1-bac1-4120c8837900 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:28.778489 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ccbbb-9d74-45a1-bac1-4120c8837900 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:28.791799 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ccbbb-9d74-45a1-bac1-4120c8837900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:28.796596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-5a1ccbbb-9d74-45a1-bac1-4120c8837900 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 16:18:28.796596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:28.796596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:28.796596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:28.796596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:28.796596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:28.796596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:28.796596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:28.796596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:28.796596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:28.796596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:28.796596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:28.796596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:28.796596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:28.796596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:28.796596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:28.797513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:28.797513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:28.797513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:28.797513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:28.797513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:28.797513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:28.797513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:28.797513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:28.797513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:28.797513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:28.797513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:28.797513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:28.797513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:28.797513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:28.797513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:28.797513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:28.799062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:28.799062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:28.799062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:28.799062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:28.799062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:28.799062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:28.799062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:28.799062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:28.799062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:28.799062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:28.799062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 16:18:28.799062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:28.799062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 189/364] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Oct 4 16:18:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:28.799756 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd15131-25b6-47d7-9da4-27fe8e782fc1 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:28.799756 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd15131-25b6-47d7-9da4-27fe8e782fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:28.799756 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd15131-25b6-47d7-9da4-27fe8e782fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:28.818436 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-3cd15131-25b6-47d7-9da4-27fe8e782fc1 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:28.820218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-3cd15131-25b6-47d7-9da4-27fe8e782fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:28.860432 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:28.876412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53a341-59ad-4d21-af1c-d7b052aa5298 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:28.909880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 190/365] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:28.915931 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd15131-25b6-47d7-9da4-27fe8e782fc1 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:28.917075 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5729f31-a37f-41b5-bd61-d7f1294a0f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:28.917749 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5729f31-a37f-41b5-bd61-d7f1294a0f45 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:28.918027 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5729f31-a37f-41b5-bd61-d7f1294a0f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:28.918417 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5729f31-a37f-41b5-bd61-d7f1294a0f45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:28.919204 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5729f31-a37f-41b5-bd61-d7f1294a0f45 None admin] RBAC: Adding query filter params (group.id=06e2e17186494298914cca80d561ca8d, role.id=2497938af8354a00a7e4ec59ad8b9582, scope.project.id=c68abb6013ea44fb9fad2c8141d11c05) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:28.919512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5729f31-a37f-41b5-bd61-d7f1294a0f45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:28.921339 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5729f31-a37f-41b5-bd61-d7f1294a0f45 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:28.933481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 176/366] 10.222.0.55 () {56 vars in 1376 bytes} [Tue Oct 4 16:18:28 2022] GET /identity/v3/role_assignments?group.id=06e2e17186494298914cca80d561ca8d&scope.project.id=c68abb6013ea44fb9fad2c8141d11c05&role.id=2497938af8354a00a7e4ec59ad8b9582 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:28.934372 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5729f31-a37f-41b5-bd61-d7f1294a0f45 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:29.047488 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:29.090247 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd15131-25b6-47d7-9da4-27fe8e782fc1 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:29.167883 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5729f31-a37f-41b5-bd61-d7f1294a0f45 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:29.184468 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd407dd-161e-4349-8992-20d330f73bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:29.185128 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd407dd-161e-4349-8992-20d330f73bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:29.185403 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd407dd-161e-4349-8992-20d330f73bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:29.185670 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd407dd-161e-4349-8992-20d330f73bf4 None admin] PATH_INFO: `/v3/projects/85526afc0e3249f2af1dd595350c99ca` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:29.186863 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd407dd-161e-4349-8992-20d330f73bf4 None admin] RBAC: Authorizing `identity:get_project(project_id=85526afc0e3249f2af1dd595350c99ca)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:29.188352 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd407dd-161e-4349-8992-20d330f73bf4 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:29.192265 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 191/367] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:28 2022] GET /identity/v3/projects/85526afc0e3249f2af1dd595350c99ca => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:29.198057 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd407dd-161e-4349-8992-20d330f73bf4 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:29.245957 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf093b9-50c1-4fd7-b771-05a6acf61ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:29.246649 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf093b9-50c1-4fd7-b771-05a6acf61ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:29.246922 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf093b9-50c1-4fd7-b771-05a6acf61ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:29.247350 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf093b9-50c1-4fd7-b771-05a6acf61ab6 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:29.248171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf093b9-50c1-4fd7-b771-05a6acf61ab6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:29.248474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf093b9-50c1-4fd7-b771-05a6acf61ab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:29.250128 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf093b9-50c1-4fd7-b771-05a6acf61ab6 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:29.260199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 177/368] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:18:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:29.260886 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf093b9-50c1-4fd7-b771-05a6acf61ab6 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:29.278004 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:29.332111 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd407dd-161e-4349-8992-20d330f73bf4 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:29.369745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e81750-b3d1-4abd-b72f-4277d5110537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:29.370840 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e81750-b3d1-4abd-b72f-4277d5110537 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:29.371480 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e81750-b3d1-4abd-b72f-4277d5110537 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:29.371963 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e81750-b3d1-4abd-b72f-4277d5110537 None admin] PATH_INFO: `/v3/groups/06e2e17186494298914cca80d561ca8d` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:29.372606 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf093b9-50c1-4fd7-b771-05a6acf61ab6 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:29.373582 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e81750-b3d1-4abd-b72f-4277d5110537 None admin] RBAC: Authorizing `identity:get_group(group_id=06e2e17186494298914cca80d561ca8d)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:29.375952 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e81750-b3d1-4abd-b72f-4277d5110537 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:29.378325 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 192/369] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Oct 4 16:18:29 2022] GET /identity/v3/groups/06e2e17186494298914cca80d561ca8d => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:29.379489 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e81750-b3d1-4abd-b72f-4277d5110537 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:29.402672 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:29.412041 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4833ce3-170a-40ba-96b7-a7f8b106ec1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:29.412923 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4833ce3-170a-40ba-96b7-a7f8b106ec1a None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:29.413448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4833ce3-170a-40ba-96b7-a7f8b106ec1a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:29.413861 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4833ce3-170a-40ba-96b7-a7f8b106ec1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:29.429292 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4833ce3-170a-40ba-96b7-a7f8b106ec1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:29.435614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-f4833ce3-170a-40ba-96b7-a7f8b106ec1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:18:29.435614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:29.435614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:29.435614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:29.435614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:29.435614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:29.435614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:29.435614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:29.435614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:29.435614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:29.435614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:29.435614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:29.435614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:29.435614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:29.435614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:29.435614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:29.436558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:29.436558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:29.436558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:29.436558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:29.436558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:29.436558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:29.436558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:29.436558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:29.436558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:29.436558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:29.436558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:29.436558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:29.436558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:29.436558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:29.436558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:29.436558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:29.437341 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:29.437341 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:29.437341 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:29.437341 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:29.437341 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:29.437341 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:29.437341 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:29.437341 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:29.437341 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:29.437341 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:29.437341 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:18:29.437341 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:29.440231 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 178/370] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:18:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:29.441345 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4833ce3-170a-40ba-96b7-a7f8b106ec1a None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:29.504400 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e81750-b3d1-4abd-b72f-4277d5110537 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:29.532225 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:29.545416 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cad504-8422-42c0-9cb3-93e18282f91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:29.546919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cad504-8422-42c0-9cb3-93e18282f91f None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:29.547380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cad504-8422-42c0-9cb3-93e18282f91f None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:29.547804 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cad504-8422-42c0-9cb3-93e18282f91f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:29.562836 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4833ce3-170a-40ba-96b7-a7f8b106ec1a None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:29.605570 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e7e71-ff7a-4797-babf-0b48743355d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:29.606120 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e7e71-ff7a-4797-babf-0b48743355d8 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:29.606399 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e7e71-ff7a-4797-babf-0b48743355d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:29.606669 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e7e71-ff7a-4797-babf-0b48743355d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:29.607811 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e7e71-ff7a-4797-babf-0b48743355d8 None admin] RBAC: Adding query filter params (group.id=06e2e17186494298914cca80d561ca8d, role.id=5cf61f379b4d49cb9e19605796d13f62, scope.project.id=85526afc0e3249f2af1dd595350c99ca) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:29.608622 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e7e71-ff7a-4797-babf-0b48743355d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:29.610254 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e7e71-ff7a-4797-babf-0b48743355d8 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:29.619351 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 179/371] 10.222.0.55 () {56 vars in 1376 bytes} [Tue Oct 4 16:18:29 2022] GET /identity/v3/role_assignments?group.id=06e2e17186494298914cca80d561ca8d&scope.project.id=85526afc0e3249f2af1dd595350c99ca&role.id=5cf61f379b4d49cb9e19605796d13f62 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:29.625262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e7e71-ff7a-4797-babf-0b48743355d8 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:29.648521 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cad504-8422-42c0-9cb3-93e18282f91f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:29.650301 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cad504-8422-42c0-9cb3-93e18282f91f None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:29.689453 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:29.819057 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e7e71-ff7a-4797-babf-0b48743355d8 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:29.857363 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 193/372] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:18:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:18:29.868382 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cad504-8422-42c0-9cb3-93e18282f91f None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:29.895820 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383e05f-f32a-4424-882b-25c0c9ef4c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:29.896909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383e05f-f32a-4424-882b-25c0c9ef4c76 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:29.897311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383e05f-f32a-4424-882b-25c0c9ef4c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:29.897805 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383e05f-f32a-4424-882b-25c0c9ef4c76 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:29.899681 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383e05f-f32a-4424-882b-25c0c9ef4c76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:29.899915 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383e05f-f32a-4424-882b-25c0c9ef4c76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:29.901750 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383e05f-f32a-4424-882b-25c0c9ef4c76 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:29.915394 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:29.923469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 180/373] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:29.930766 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383e05f-f32a-4424-882b-25c0c9ef4c76 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:30.059456 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cad504-8422-42c0-9cb3-93e18282f91f None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:30.079370 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383e05f-f32a-4424-882b-25c0c9ef4c76 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:30.092043 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:30.131206 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03d0bd-35fb-4fa1-81e5-ad8f971f3a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:30.131764 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03d0bd-35fb-4fa1-81e5-ad8f971f3a37 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:30.132040 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03d0bd-35fb-4fa1-81e5-ad8f971f3a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:30.132305 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03d0bd-35fb-4fa1-81e5-ad8f971f3a37 None admin] PATH_INFO: `/v3/projects/85526afc0e3249f2af1dd595350c99ca` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:30.134135 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03d0bd-35fb-4fa1-81e5-ad8f971f3a37 None admin] RBAC: Authorizing `identity:get_project(project_id=85526afc0e3249f2af1dd595350c99ca)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:30.135618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03d0bd-35fb-4fa1-81e5-ad8f971f3a37 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:30.138885 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 194/374] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:29 2022] GET /identity/v3/projects/85526afc0e3249f2af1dd595350c99ca => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:30.145773 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03d0bd-35fb-4fa1-81e5-ad8f971f3a37 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:30.153078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43724746-367e-492b-8477-3bb7ba5a7c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:30.153715 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43724746-367e-492b-8477-3bb7ba5a7c69 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:30.153990 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43724746-367e-492b-8477-3bb7ba5a7c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:30.154259 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43724746-367e-492b-8477-3bb7ba5a7c69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:30.301249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:30.309125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43724746-367e-492b-8477-3bb7ba5a7c69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:30.310917 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43724746-367e-492b-8477-3bb7ba5a7c69 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:30.346755 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03d0bd-35fb-4fa1-81e5-ad8f971f3a37 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:30.408289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf15730-0c95-4776-ae86-7a99e83764fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:30.408856 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf15730-0c95-4776-ae86-7a99e83764fa None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:30.409135 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf15730-0c95-4776-ae86-7a99e83764fa None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:30.409408 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf15730-0c95-4776-ae86-7a99e83764fa None admin] PATH_INFO: `/v3/groups/06e2e17186494298914cca80d561ca8d` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:30.411331 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf15730-0c95-4776-ae86-7a99e83764fa None admin] RBAC: Authorizing `identity:get_group(group_id=06e2e17186494298914cca80d561ca8d)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:30.412795 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf15730-0c95-4776-ae86-7a99e83764fa None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:30.414724 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 195/375] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Oct 4 16:18:30 2022] GET /identity/v3/groups/06e2e17186494298914cca80d561ca8d => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:30.420859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf15730-0c95-4776-ae86-7a99e83764fa None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:30.442798 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 181/376] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:18:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:18:30.449073 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43724746-367e-492b-8477-3bb7ba5a7c69 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:30.512785 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:30.554256 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:30.558877 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43724746-367e-492b-8477-3bb7ba5a7c69 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:30.596027 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580ac01-f488-4817-86f3-2dcc2aac3a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:30.596704 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580ac01-f488-4817-86f3-2dcc2aac3a47 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:30.597030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580ac01-f488-4817-86f3-2dcc2aac3a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:30.597237 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580ac01-f488-4817-86f3-2dcc2aac3a47 None admin] PATH_INFO: `/v3/projects/d8da776c843c485a9ba105a4675b7ac9` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:30.598470 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580ac01-f488-4817-86f3-2dcc2aac3a47 None admin] RBAC: Authorizing `identity:get_project(project_id=d8da776c843c485a9ba105a4675b7ac9)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:30.600016 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580ac01-f488-4817-86f3-2dcc2aac3a47 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:30.602264 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 182/377] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:30 2022] GET /identity/v3/projects/d8da776c843c485a9ba105a4675b7ac9 => generated 344 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:30.612102 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580ac01-f488-4817-86f3-2dcc2aac3a47 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:30.648080 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf15730-0c95-4776-ae86-7a99e83764fa None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:30.698972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751d5d8-d681-4a6e-bb99-23f7e5b0cb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:30.700576 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751d5d8-d681-4a6e-bb99-23f7e5b0cb43 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:30.701485 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751d5d8-d681-4a6e-bb99-23f7e5b0cb43 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:30.702221 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751d5d8-d681-4a6e-bb99-23f7e5b0cb43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:30.704104 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751d5d8-d681-4a6e-bb99-23f7e5b0cb43 None admin] RBAC: Adding query filter params (group.id=06e2e17186494298914cca80d561ca8d, role.id=2497938af8354a00a7e4ec59ad8b9582, scope.project.id=85526afc0e3249f2af1dd595350c99ca) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:30.704939 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751d5d8-d681-4a6e-bb99-23f7e5b0cb43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:30.707942 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751d5d8-d681-4a6e-bb99-23f7e5b0cb43 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:30.716854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 196/378] 10.222.0.55 () {56 vars in 1376 bytes} [Tue Oct 4 16:18:30 2022] GET /identity/v3/role_assignments?group.id=06e2e17186494298914cca80d561ca8d&scope.project.id=85526afc0e3249f2af1dd595350c99ca&role.id=2497938af8354a00a7e4ec59ad8b9582 => generated 260 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:30.774818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580ac01-f488-4817-86f3-2dcc2aac3a47 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:30.815330 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca9189-f2ee-4e6d-8ec4-e93d851f815e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:30.815984 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca9189-f2ee-4e6d-8ec4-e93d851f815e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:30.816254 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca9189-f2ee-4e6d-8ec4-e93d851f815e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:30.816525 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca9189-f2ee-4e6d-8ec4-e93d851f815e None admin] PATH_INFO: `/v3/groups/b60d9aad19f14e4c9801b1b9be6a584f` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:30.822645 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6425157-518b-46e7-9afc-ec2e157be81d None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:30.823269 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6425157-518b-46e7-9afc-ec2e157be81d None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:30.823740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6425157-518b-46e7-9afc-ec2e157be81d None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:30.824722 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca9189-f2ee-4e6d-8ec4-e93d851f815e None admin] RBAC: Authorizing `identity:get_group(group_id=b60d9aad19f14e4c9801b1b9be6a584f)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:30.825943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 197/379] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:30.828079 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca9189-f2ee-4e6d-8ec4-e93d851f815e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:30.828273 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 183/380] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Oct 4 16:18:30 2022] GET /identity/v3/groups/b60d9aad19f14e4c9801b1b9be6a584f => generated 229 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:30.834602 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6425157-518b-46e7-9afc-ec2e157be81d None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:30.853485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277cd8e-a447-4ab3-a5d9-119ae57b8f86 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:30.853834 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277cd8e-a447-4ab3-a5d9-119ae57b8f86 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:30.854173 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277cd8e-a447-4ab3-a5d9-119ae57b8f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:30.885017 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-1277cd8e-a447-4ab3-a5d9-119ae57b8f86 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:30.887330 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-1277cd8e-a447-4ab3-a5d9-119ae57b8f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:30.937750 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:30.970851 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6425157-518b-46e7-9afc-ec2e157be81d None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:30.990378 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:31.014521 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 184/381] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 16:18:31.017747 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6cfdc-d819-4105-9358-ca9c952159ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:31.018564 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6cfdc-d819-4105-9358-ca9c952159ac None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:31.019011 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6cfdc-d819-4105-9358-ca9c952159ac None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:31.019403 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6cfdc-d819-4105-9358-ca9c952159ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:31.020326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6cfdc-d819-4105-9358-ca9c952159ac None admin] RBAC: Adding query filter params (group.id=b60d9aad19f14e4c9801b1b9be6a584f, role.id=066f46534195417295e63a5316632eae, scope.project.id=d8da776c843c485a9ba105a4675b7ac9) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:31.020767 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6cfdc-d819-4105-9358-ca9c952159ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:31.022343 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6cfdc-d819-4105-9358-ca9c952159ac None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:31.030135 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 198/382] 10.222.0.55 () {56 vars in 1376 bytes} [Tue Oct 4 16:18:30 2022] GET /identity/v3/role_assignments?group.id=b60d9aad19f14e4c9801b1b9be6a584f&scope.project.id=d8da776c843c485a9ba105a4675b7ac9&role.id=066f46534195417295e63a5316632eae => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:31.296439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277cd8e-a447-4ab3-a5d9-119ae57b8f86 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:31.431751 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277cd8e-a447-4ab3-a5d9-119ae57b8f86 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:31.468375 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804460c5-596a-4229-b19b-f99299709261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:31.469715 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804460c5-596a-4229-b19b-f99299709261 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:31.470139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804460c5-596a-4229-b19b-f99299709261 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:31.470643 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804460c5-596a-4229-b19b-f99299709261 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:31.482697 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804460c5-596a-4229-b19b-f99299709261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:31.487781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-804460c5-596a-4229-b19b-f99299709261 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:18:31.487781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:31.487781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:31.487781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:31.487781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:31.487781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:31.487781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:31.487781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:31.487781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:31.487781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:31.487781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:31.487781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:31.487781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:31.487781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:31.487781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:31.487781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:31.488914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:31.488914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:31.488914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:31.488914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:31.488914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:31.488914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:31.488914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:31.488914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:31.488914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:31.488914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:31.488914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:31.488914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:31.488914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:31.488914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:31.488914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:31.488914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:31.489883 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:31.489883 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:31.489883 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:31.489883 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:31.489883 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:31.489883 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:31.489883 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:31.489883 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:31.489883 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:31.489883 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:31.489883 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:18:31.489883 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:31.492149 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 185/383] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:31.498168 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6cfdc-d819-4105-9358-ca9c952159ac None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:31.614566 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6cfdc-d819-4105-9358-ca9c952159ac None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:31.655313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd622c2-2fdf-4fbb-aaca-005d0bb33660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:31.655980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd622c2-2fdf-4fbb-aaca-005d0bb33660 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:31.656191 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd622c2-2fdf-4fbb-aaca-005d0bb33660 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:31.658910 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd622c2-2fdf-4fbb-aaca-005d0bb33660 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:31.658910 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd622c2-2fdf-4fbb-aaca-005d0bb33660 None admin] RBAC: Adding query filter params (name=member) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:31.658910 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd622c2-2fdf-4fbb-aaca-005d0bb33660 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:31.658910 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd622c2-2fdf-4fbb-aaca-005d0bb33660 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:31.670948 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 199/384] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:18:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:31.676391 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804460c5-596a-4229-b19b-f99299709261 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:31.708326 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:31.800254 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804460c5-596a-4229-b19b-f99299709261 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:31.840258 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4446e-9705-4fdc-a195-7505024c9c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:31.840816 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4446e-9705-4fdc-a195-7505024c9c33 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:31.841087 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4446e-9705-4fdc-a195-7505024c9c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:31.841350 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4446e-9705-4fdc-a195-7505024c9c33 None admin] PATH_INFO: `/v3/groups/06e2e17186494298914cca80d561ca8d` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:31.842535 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4446e-9705-4fdc-a195-7505024c9c33 None admin] RBAC: Authorizing `identity:get_group(group_id=06e2e17186494298914cca80d561ca8d)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:31.844024 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4446e-9705-4fdc-a195-7505024c9c33 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:31.845908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 186/385] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Oct 4 16:18:31 2022] GET /identity/v3/groups/06e2e17186494298914cca80d561ca8d => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:31.851582 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd622c2-2fdf-4fbb-aaca-005d0bb33660 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:31.909942 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:31.980246 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd622c2-2fdf-4fbb-aaca-005d0bb33660 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:32.022267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea40f46-b664-4565-8394-a88669967ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:32.022919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea40f46-b664-4565-8394-a88669967ca2 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:32.023223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea40f46-b664-4565-8394-a88669967ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:32.023489 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea40f46-b664-4565-8394-a88669967ca2 None admin] PATH_INFO: `/v3/projects/c68abb6013ea44fb9fad2c8141d11c05` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:32.024715 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea40f46-b664-4565-8394-a88669967ca2 None admin] RBAC: Authorizing `identity:get_project(project_id=c68abb6013ea44fb9fad2c8141d11c05)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:32.026208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea40f46-b664-4565-8394-a88669967ca2 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:32.028395 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 200/386] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:31 2022] GET /identity/v3/projects/c68abb6013ea44fb9fad2c8141d11c05 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:32.034243 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4446e-9705-4fdc-a195-7505024c9c33 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:32.141031 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:32.157093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4446e-9705-4fdc-a195-7505024c9c33 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:32.198189 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cd6a4-665f-4643-9b2b-0c7c48f94eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:32.202267 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cd6a4-665f-4643-9b2b-0c7c48f94eef None admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:32.202743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cd6a4-665f-4643-9b2b-0c7c48f94eef None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:32.203196 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cd6a4-665f-4643-9b2b-0c7c48f94eef None admin] PATH_INFO: `/v3/projects/c68abb6013ea44fb9fad2c8141d11c05/groups/06e2e17186494298914cca80d561ca8d/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:32.205544 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cd6a4-665f-4643-9b2b-0c7c48f94eef None admin] RBAC: Authorizing `identity:create_grant(project_id=c68abb6013ea44fb9fad2c8141d11c05, group_id=06e2e17186494298914cca80d561ca8d, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:32.207336 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cd6a4-665f-4643-9b2b-0c7c48f94eef None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:32.227339 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 187/387] 10.222.0.55 () {58 vars in 1442 bytes} [Tue Oct 4 16:18:32 2022] PUT /identity/v3/projects/c68abb6013ea44fb9fad2c8141d11c05/groups/06e2e17186494298914cca80d561ca8d/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:18:32.270906 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab99582-fcb8-41f0-87b8-d34eca2344f6 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:32.271223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab99582-fcb8-41f0-87b8-d34eca2344f6 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:32.271503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab99582-fcb8-41f0-87b8-d34eca2344f6 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:32.273416 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 201/388] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:32.279852 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b14313-3d27-4c79-bc0e-476bedceef67 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:32.280380 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b14313-3d27-4c79-bc0e-476bedceef67 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:32.280801 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b14313-3d27-4c79-bc0e-476bedceef67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:32.306962 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-87b14313-3d27-4c79-bc0e-476bedceef67 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:32.308789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-87b14313-3d27-4c79-bc0e-476bedceef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:32.409756 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63107686-ff00-4ef6-bdb4-fe12e680072e None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:32.409968 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63107686-ff00-4ef6-bdb4-fe12e680072e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:32.410224 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63107686-ff00-4ef6-bdb4-fe12e680072e None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:32.411871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 202/389] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:32.412433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 188/390] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:32.417918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af7458-b86a-450a-b8e4-9932ff5785fd None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:32.418443 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af7458-b86a-450a-b8e4-9932ff5785fd None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:32.418912 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af7458-b86a-450a-b8e4-9932ff5785fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:32.441313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-96af7458-b86a-450a-b8e4-9932ff5785fd None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:32.442885 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-96af7458-b86a-450a-b8e4-9932ff5785fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:32.525121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 203/391] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 16:18:32.799388 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b14313-3d27-4c79-bc0e-476bedceef67 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:32.819600 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af7458-b86a-450a-b8e4-9932ff5785fd None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:32.895360 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:32.940808 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:32.989846 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b14313-3d27-4c79-bc0e-476bedceef67 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:32.990249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af7458-b86a-450a-b8e4-9932ff5785fd None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:33.049753 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91ccf9-c8d1-4313-8179-cf274d78ab95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:33.050759 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91ccf9-c8d1-4313-8179-cf274d78ab95 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:33.051287 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91ccf9-c8d1-4313-8179-cf274d78ab95 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:33.051769 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91ccf9-c8d1-4313-8179-cf274d78ab95 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:33.055738 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97363be-9f00-4dbc-a5f5-8c7862e5cfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:33.056410 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97363be-9f00-4dbc-a5f5-8c7862e5cfa3 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:33.056689 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97363be-9f00-4dbc-a5f5-8c7862e5cfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:33.056962 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97363be-9f00-4dbc-a5f5-8c7862e5cfa3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:33.069898 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91ccf9-c8d1-4313-8179-cf274d78ab95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:33.075420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-7d91ccf9-c8d1-4313-8179-cf274d78ab95 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 16:18:33.075420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:33.075420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:33.075420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:33.075420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:33.075420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:33.075420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:33.075420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:33.075420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:33.075420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:33.075420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:33.075420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:33.075420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:33.075420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:33.075420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:33.075420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:33.076289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:33.076289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:33.076289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:33.076289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:33.076289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:33.076289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:33.076289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:33.076289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:33.076289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:33.076289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:33.076289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:33.076289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:33.076289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:33.076289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:33.076289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:33.076289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:33.077067 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:33.077067 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:33.077067 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:33.077067 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:33.077067 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:33.077067 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:33.077067 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:33.077067 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:33.077067 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:33.077067 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:33.077067 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 16:18:33.077067 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:33.079696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 189/392] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Oct 4 16:18:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:33.092510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91ccf9-c8d1-4313-8179-cf274d78ab95 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:33.092950 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97363be-9f00-4dbc-a5f5-8c7862e5cfa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:33.101101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-d97363be-9f00-4dbc-a5f5-8c7862e5cfa3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:18:33.101101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:33.101101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:33.101101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:33.101101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:33.101101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:33.101101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:33.101101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:33.101101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:33.101101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:33.101101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:33.101101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:33.101101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:33.101101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:33.101101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:33.101101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:33.102007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:33.102007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:33.102007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:33.102007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:33.102007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:33.102007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:33.102007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:33.102007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:33.102007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:33.102007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:33.102007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:33.102007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:33.102007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:33.102007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:33.102007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:33.102007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:33.102811 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:33.102811 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:33.102811 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:33.102811 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:33.102811 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:33.102811 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:33.102811 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:33.102811 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:33.102811 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:33.102811 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:33.102811 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:18:33.102811 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:33.103476 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 204/393] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:33.109180 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97363be-9f00-4dbc-a5f5-8c7862e5cfa3 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:33.245258 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91ccf9-c8d1-4313-8179-cf274d78ab95 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:33.304692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:33.312275 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97363be-9f00-4dbc-a5f5-8c7862e5cfa3 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:33.317267 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d151a-f42b-44d3-8247-c161851ac002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:33.317901 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d151a-f42b-44d3-8247-c161851ac002 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:33.318178 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d151a-f42b-44d3-8247-c161851ac002 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:33.318443 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d151a-f42b-44d3-8247-c161851ac002 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:33.319166 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d151a-f42b-44d3-8247-c161851ac002 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:33.319467 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d151a-f42b-44d3-8247-c161851ac002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:33.320871 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d151a-f42b-44d3-8247-c161851ac002 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:33.331656 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 190/394] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:18:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:33.339852 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d151a-f42b-44d3-8247-c161851ac002 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:33.350864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:33.366817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef2483-afa3-4646-9730-24b9a27e3b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:33.367482 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef2483-afa3-4646-9730-24b9a27e3b68 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:33.368345 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef2483-afa3-4646-9730-24b9a27e3b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:33.368345 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef2483-afa3-4646-9730-24b9a27e3b68 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:33.368779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef2483-afa3-4646-9730-24b9a27e3b68 None admin] RBAC: Adding query filter params (name=member) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:33.369007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef2483-afa3-4646-9730-24b9a27e3b68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:33.370493 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef2483-afa3-4646-9730-24b9a27e3b68 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:33.380810 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 205/395] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:18:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:33.386864 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef2483-afa3-4646-9730-24b9a27e3b68 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:33.498819 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef2483-afa3-4646-9730-24b9a27e3b68 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:33.535831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710918f-1051-421e-a72f-0048fff4fc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:33.536485 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710918f-1051-421e-a72f-0048fff4fc9b None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:33.536762 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710918f-1051-421e-a72f-0048fff4fc9b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:33.537031 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710918f-1051-421e-a72f-0048fff4fc9b None admin] PATH_INFO: `/v3/groups/06e2e17186494298914cca80d561ca8d` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:33.538305 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710918f-1051-421e-a72f-0048fff4fc9b None admin] RBAC: Authorizing `identity:get_group(group_id=06e2e17186494298914cca80d561ca8d)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:33.539902 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710918f-1051-421e-a72f-0048fff4fc9b None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:33.541841 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 206/396] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Oct 4 16:18:33 2022] GET /identity/v3/groups/06e2e17186494298914cca80d561ca8d => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:33.547664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710918f-1051-421e-a72f-0048fff4fc9b None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:33.583413 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:33.653171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d151a-f42b-44d3-8247-c161851ac002 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:33.659437 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710918f-1051-421e-a72f-0048fff4fc9b None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:33.715245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f27be6-d804-4039-8694-ed3183cb00ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:33.715940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f27be6-d804-4039-8694-ed3183cb00ad None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:33.716218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f27be6-d804-4039-8694-ed3183cb00ad None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:33.716487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f27be6-d804-4039-8694-ed3183cb00ad None admin] PATH_INFO: `/v3/projects/85526afc0e3249f2af1dd595350c99ca` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:33.717633 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f27be6-d804-4039-8694-ed3183cb00ad None admin] RBAC: Authorizing `identity:get_project(project_id=85526afc0e3249f2af1dd595350c99ca)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:33.719113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f27be6-d804-4039-8694-ed3183cb00ad None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:33.720717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fb945-9314-4024-9722-9f85b622ef8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:33.721169 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 207/397] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:33 2022] GET /identity/v3/projects/85526afc0e3249f2af1dd595350c99ca => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:33.721484 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fb945-9314-4024-9722-9f85b622ef8f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:33.721767 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fb945-9314-4024-9722-9f85b622ef8f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:33.722039 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fb945-9314-4024-9722-9f85b622ef8f None admin] PATH_INFO: `/v3/groups/06e2e17186494298914cca80d561ca8d` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:33.724162 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17fb945-9314-4024-9722-9f85b622ef8f None admin] RBAC: Authorizing `identity:get_group(group_id=06e2e17186494298914cca80d561ca8d)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:33.725602 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17fb945-9314-4024-9722-9f85b622ef8f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:33.731211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 191/398] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Oct 4 16:18:33 2022] GET /identity/v3/groups/06e2e17186494298914cca80d561ca8d => generated 226 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:33.732563 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fb945-9314-4024-9722-9f85b622ef8f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:33.732940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f27be6-d804-4039-8694-ed3183cb00ad None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:33.848060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f27be6-d804-4039-8694-ed3183cb00ad None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:33.855524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:33.892332 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0c73c-cf5e-464d-844f-a7e6e13aad03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:33.893572 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0c73c-cf5e-464d-844f-a7e6e13aad03 None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:33.893917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0c73c-cf5e-464d-844f-a7e6e13aad03 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:33.894257 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0c73c-cf5e-464d-844f-a7e6e13aad03 None admin] PATH_INFO: `/v3/projects/85526afc0e3249f2af1dd595350c99ca/groups/06e2e17186494298914cca80d561ca8d/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:33.896280 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0c73c-cf5e-464d-844f-a7e6e13aad03 None admin] RBAC: Authorizing `identity:create_grant(project_id=85526afc0e3249f2af1dd595350c99ca, group_id=06e2e17186494298914cca80d561ca8d, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:33.897815 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0c73c-cf5e-464d-844f-a7e6e13aad03 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:33.919255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 208/399] 10.222.0.55 () {58 vars in 1442 bytes} [Tue Oct 4 16:18:33 2022] PUT /identity/v3/projects/85526afc0e3249f2af1dd595350c99ca/groups/06e2e17186494298914cca80d561ca8d/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:18:33.951413 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:33.979566 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114e2dc-6dab-472a-a414-8ddf54d26c93 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:33.979996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114e2dc-6dab-472a-a414-8ddf54d26c93 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:33.980363 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114e2dc-6dab-472a-a414-8ddf54d26c93 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:33.981892 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 209/400] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:18:33.985097 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fb945-9314-4024-9722-9f85b622ef8f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:33.993461 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ebea3-17ad-4ee2-9990-025b5651c70f None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:33.993718 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ebea3-17ad-4ee2-9990-025b5651c70f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:33.993991 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ebea3-17ad-4ee2-9990-025b5651c70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:34.026552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-7c3ebea3-17ad-4ee2-9990-025b5651c70f None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:34.027876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-7c3ebea3-17ad-4ee2-9990-025b5651c70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:34.066926 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09503aa-59a8-4b09-b8eb-6b9ad1b270d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:34.067623 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09503aa-59a8-4b09-b8eb-6b9ad1b270d7 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:34.067901 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09503aa-59a8-4b09-b8eb-6b9ad1b270d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:34.068165 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09503aa-59a8-4b09-b8eb-6b9ad1b270d7 None admin] PATH_INFO: `/v3/projects/c68abb6013ea44fb9fad2c8141d11c05` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:34.070332 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09503aa-59a8-4b09-b8eb-6b9ad1b270d7 None admin] RBAC: Authorizing `identity:get_project(project_id=c68abb6013ea44fb9fad2c8141d11c05)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:34.075955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09503aa-59a8-4b09-b8eb-6b9ad1b270d7 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:34.078307 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 192/401] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:33 2022] GET /identity/v3/projects/c68abb6013ea44fb9fad2c8141d11c05 => generated 298 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:34.079542 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e0e87-902a-47d1-ac70-6a710703061f None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:34.079815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e0e87-902a-47d1-ac70-6a710703061f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:34.080090 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e0e87-902a-47d1-ac70-6a710703061f None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:34.081504 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 193/402] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:34.087498 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e0e87-902a-47d1-ac70-6a710703061f None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:34.153318 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 210/403] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:34.156551 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4e63e-60ee-448c-9ea8-aec6e8198eb3 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:34.156840 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4e63e-60ee-448c-9ea8-aec6e8198eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:34.157115 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4e63e-60ee-448c-9ea8-aec6e8198eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:34.179982 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-acf4e63e-60ee-448c-9ea8-aec6e8198eb3 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:34.181273 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-acf4e63e-60ee-448c-9ea8-aec6e8198eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:34.215236 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e0e87-902a-47d1-ac70-6a710703061f None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:34.253603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e9e01-10cc-49dd-be07-56d6cd101e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:34.254574 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e9e01-10cc-49dd-be07-56d6cd101e65 None admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:34.255094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e9e01-10cc-49dd-be07-56d6cd101e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:34.255589 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e9e01-10cc-49dd-be07-56d6cd101e65 None admin] PATH_INFO: `/v3/projects/c68abb6013ea44fb9fad2c8141d11c05/groups/06e2e17186494298914cca80d561ca8d/roles/2497938af8354a00a7e4ec59ad8b9582` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:34.257934 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e9e01-10cc-49dd-be07-56d6cd101e65 None admin] RBAC: Authorizing `identity:create_grant(project_id=c68abb6013ea44fb9fad2c8141d11c05, group_id=06e2e17186494298914cca80d561ca8d, role_id=2497938af8354a00a7e4ec59ad8b9582)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:34.258501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 211/404] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:34.266908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e9e01-10cc-49dd-be07-56d6cd101e65 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:34.281726 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:34.293783 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 194/405] 10.222.0.55 () {58 vars in 1442 bytes} [Tue Oct 4 16:18:34 2022] PUT /identity/v3/projects/c68abb6013ea44fb9fad2c8141d11c05/groups/06e2e17186494298914cca80d561ca8d/roles/2497938af8354a00a7e4ec59ad8b9582 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:18:34.447385 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4e63e-60ee-448c-9ea8-aec6e8198eb3 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:34.470179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:34.574667 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4e63e-60ee-448c-9ea8-aec6e8198eb3 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:34.610474 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6537d0-653a-4c0f-ac40-3c56ef10ec3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:34.611384 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6537d0-653a-4c0f-ac40-3c56ef10ec3e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:34.611796 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6537d0-653a-4c0f-ac40-3c56ef10ec3e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:34.612198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6537d0-653a-4c0f-ac40-3c56ef10ec3e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:34.624665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6537d0-653a-4c0f-ac40-3c56ef10ec3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:34.630066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-5f6537d0-653a-4c0f-ac40-3c56ef10ec3e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 16:18:34.630066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:34.630066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:34.630066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:34.630066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:34.630066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:34.630066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:34.630066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:34.630066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:34.630066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:34.630066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:34.630066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:34.630066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:34.630066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:34.630066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:34.630066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:34.631146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:34.631146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:34.631146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:34.631146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:34.631146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:34.631146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:34.631146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:34.631146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:34.631146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:34.631146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:34.631146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:34.631146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:34.631146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:34.631146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:34.631146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:34.631146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:34.632127 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:34.632127 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:34.632127 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:34.632127 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:34.632127 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:34.632127 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:34.632127 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:34.632127 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:34.632127 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:34.632127 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:34.632127 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 16:18:34.632127 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:34.634488 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 212/406] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Oct 4 16:18:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:34.644138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e9e01-10cc-49dd-be07-56d6cd101e65 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:34.660849 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6537d0-653a-4c0f-ac40-3c56ef10ec3e None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:34.829209 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e9e01-10cc-49dd-be07-56d6cd101e65 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:34.829805 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:34.871325 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6537d0-653a-4c0f-ac40-3c56ef10ec3e None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:34.907976 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ca6f6-d0bc-47e1-9ed8-4dae8dbc24fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:34.909734 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ca6f6-d0bc-47e1-9ed8-4dae8dbc24fa None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:34.910924 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ca6f6-d0bc-47e1-9ed8-4dae8dbc24fa None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:34.911558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ca6f6-d0bc-47e1-9ed8-4dae8dbc24fa None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:34.913460 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ca6f6-d0bc-47e1-9ed8-4dae8dbc24fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:34.913919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ca6f6-d0bc-47e1-9ed8-4dae8dbc24fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:34.915646 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ca6f6-d0bc-47e1-9ed8-4dae8dbc24fa None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:34.932399 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 195/407] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:18:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:34.938311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ca6f6-d0bc-47e1-9ed8-4dae8dbc24fa None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:34.953076 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322e6a8-106c-41fc-9ad0-773a693ce3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:34.953992 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322e6a8-106c-41fc-9ad0-773a693ce3e3 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:34.954423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322e6a8-106c-41fc-9ad0-773a693ce3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:34.954843 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322e6a8-106c-41fc-9ad0-773a693ce3e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:34.978400 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322e6a8-106c-41fc-9ad0-773a693ce3e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:34.986944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-e322e6a8-106c-41fc-9ad0-773a693ce3e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:18:34.986944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:34.986944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:34.986944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:34.986944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:34.986944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:34.986944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:34.986944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:34.986944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:34.986944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:34.986944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:34.986944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:34.986944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:34.986944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:34.986944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:34.986944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:34.988055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:34.988055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:34.988055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:34.988055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:34.988055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:34.988055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:34.988055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:34.988055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:34.988055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:34.988055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:34.988055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:34.988055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:34.988055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:34.988055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:34.988055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:34.988055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:34.989068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:34.989068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:34.989068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:34.989068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:34.989068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:34.989068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:34.989068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:34.989068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:34.989068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:34.989068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:34.989068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:18:34.989068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:34.992286 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 213/408] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:18:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:35.000680 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322e6a8-106c-41fc-9ad0-773a693ce3e3 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:35.065631 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:35.110176 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322e6a8-106c-41fc-9ad0-773a693ce3e3 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:35.144389 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ca6f6-d0bc-47e1-9ed8-4dae8dbc24fa None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:35.144844 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78d66f-deb1-48d5-a815-2cb887d7eb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:35.145590 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78d66f-deb1-48d5-a815-2cb887d7eb43 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:35.145963 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78d66f-deb1-48d5-a815-2cb887d7eb43 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:35.146332 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78d66f-deb1-48d5-a815-2cb887d7eb43 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:35.147149 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78d66f-deb1-48d5-a815-2cb887d7eb43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:35.147589 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78d66f-deb1-48d5-a815-2cb887d7eb43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:35.149068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78d66f-deb1-48d5-a815-2cb887d7eb43 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:35.157979 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 214/409] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:35.158274 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:35.163758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9c9ec-c7c7-4349-9c0a-7727433135fb None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:35.164133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9c9ec-c7c7-4349-9c0a-7727433135fb None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:35.164476 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9c9ec-c7c7-4349-9c0a-7727433135fb None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:35.166032 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 215/410] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:35.166604 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9c9ec-c7c7-4349-9c0a-7727433135fb None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:35.185120 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794b9c0-612f-4848-a464-268704a854ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:35.185763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794b9c0-612f-4848-a464-268704a854ff None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:35.186088 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794b9c0-612f-4848-a464-268704a854ff None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:35.186367 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794b9c0-612f-4848-a464-268704a854ff None admin] PATH_INFO: `/v3/groups/06e2e17186494298914cca80d561ca8d` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:35.187513 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794b9c0-612f-4848-a464-268704a854ff None admin] RBAC: Authorizing `identity:get_group(group_id=06e2e17186494298914cca80d561ca8d)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:35.191021 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794b9c0-612f-4848-a464-268704a854ff None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:35.193015 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 196/411] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Oct 4 16:18:34 2022] GET /identity/v3/groups/06e2e17186494298914cca80d561ca8d => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:35.195484 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05dfcd-5043-4781-a723-c7781252e789 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:35.195766 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05dfcd-5043-4781-a723-c7781252e789 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:35.196037 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05dfcd-5043-4781-a723-c7781252e789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:35.221445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-bb05dfcd-5043-4781-a723-c7781252e789 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:35.222662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-bb05dfcd-5043-4781-a723-c7781252e789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:35.278906 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9c9ec-c7c7-4349-9c0a-7727433135fb None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:35.301293 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 197/412] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:35.302237 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05dfcd-5043-4781-a723-c7781252e789 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:35.313521 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba008d-8b91-439d-8f8b-9a25b8a214c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:35.314256 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba008d-8b91-439d-8f8b-9a25b8a214c5 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:35.314608 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba008d-8b91-439d-8f8b-9a25b8a214c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:35.314954 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba008d-8b91-439d-8f8b-9a25b8a214c5 None admin] PATH_INFO: `/v3/groups/b60d9aad19f14e4c9801b1b9be6a584f` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:35.316177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba008d-8b91-439d-8f8b-9a25b8a214c5 None admin] RBAC: Authorizing `identity:get_group(group_id=b60d9aad19f14e4c9801b1b9be6a584f)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:35.317697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba008d-8b91-439d-8f8b-9a25b8a214c5 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:35.319397 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 216/413] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Oct 4 16:18:35 2022] GET /identity/v3/groups/b60d9aad19f14e4c9801b1b9be6a584f => generated 229 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:35.324938 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba008d-8b91-439d-8f8b-9a25b8a214c5 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:35.363376 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:35.408229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05dfcd-5043-4781-a723-c7781252e789 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:35.411334 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:35.445671 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ae49a-241b-44f1-a82b-580c13a4637e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:35.446316 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ae49a-241b-44f1-a82b-580c13a4637e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:35.446586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ae49a-241b-44f1-a82b-580c13a4637e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:35.446855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ae49a-241b-44f1-a82b-580c13a4637e None admin] PATH_INFO: `/v3/projects/85526afc0e3249f2af1dd595350c99ca` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:35.448875 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ae49a-241b-44f1-a82b-580c13a4637e None admin] RBAC: Authorizing `identity:get_project(project_id=85526afc0e3249f2af1dd595350c99ca)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:35.451952 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ae49a-241b-44f1-a82b-580c13a4637e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:35.454460 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 198/414] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:35 2022] GET /identity/v3/projects/85526afc0e3249f2af1dd595350c99ca => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:35.460905 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ae49a-241b-44f1-a82b-580c13a4637e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:35.482121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba008d-8b91-439d-8f8b-9a25b8a214c5 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:35.531493 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488aaf3f-d43c-4d27-8421-a910daf7ccfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:35.532550 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488aaf3f-d43c-4d27-8421-a910daf7ccfd None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:35.533001 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488aaf3f-d43c-4d27-8421-a910daf7ccfd None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:35.533446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488aaf3f-d43c-4d27-8421-a910daf7ccfd None admin] PATH_INFO: `/v3/projects/d8da776c843c485a9ba105a4675b7ac9` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:35.535134 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488aaf3f-d43c-4d27-8421-a910daf7ccfd None admin] RBAC: Authorizing `identity:get_project(project_id=d8da776c843c485a9ba105a4675b7ac9)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:35.537625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488aaf3f-d43c-4d27-8421-a910daf7ccfd None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:35.539684 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 217/415] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:35 2022] GET /identity/v3/projects/d8da776c843c485a9ba105a4675b7ac9 => generated 344 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:35.548754 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488aaf3f-d43c-4d27-8421-a910daf7ccfd None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:35.675249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ae49a-241b-44f1-a82b-580c13a4637e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:35.688784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488aaf3f-d43c-4d27-8421-a910daf7ccfd None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:35.701491 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:35.711887 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0e5e7-d1c0-423f-8e44-20674bfdea36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:35.712632 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0e5e7-d1c0-423f-8e44-20674bfdea36 None admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:35.712988 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0e5e7-d1c0-423f-8e44-20674bfdea36 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:35.713320 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0e5e7-d1c0-423f-8e44-20674bfdea36 None admin] PATH_INFO: `/v3/projects/85526afc0e3249f2af1dd595350c99ca/groups/06e2e17186494298914cca80d561ca8d/roles/2497938af8354a00a7e4ec59ad8b9582` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:35.715622 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0e5e7-d1c0-423f-8e44-20674bfdea36 None admin] RBAC: Authorizing `identity:create_grant(project_id=85526afc0e3249f2af1dd595350c99ca, group_id=06e2e17186494298914cca80d561ca8d, role_id=2497938af8354a00a7e4ec59ad8b9582)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:35.717149 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0e5e7-d1c0-423f-8e44-20674bfdea36 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:35.728164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb9e60-b4fb-4ec6-a7bb-0130a639bea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:35.728882 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb9e60-b4fb-4ec6-a7bb-0130a639bea1 None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:35.729155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb9e60-b4fb-4ec6-a7bb-0130a639bea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:35.729423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb9e60-b4fb-4ec6-a7bb-0130a639bea1 None admin] PATH_INFO: `/v3/projects/d8da776c843c485a9ba105a4675b7ac9/groups/b60d9aad19f14e4c9801b1b9be6a584f/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:35.731670 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb9e60-b4fb-4ec6-a7bb-0130a639bea1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8da776c843c485a9ba105a4675b7ac9, group_id=b60d9aad19f14e4c9801b1b9be6a584f, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:35.732041 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 199/416] 10.222.0.55 () {58 vars in 1442 bytes} [Tue Oct 4 16:18:35 2022] PUT /identity/v3/projects/85526afc0e3249f2af1dd595350c99ca/groups/06e2e17186494298914cca80d561ca8d/roles/2497938af8354a00a7e4ec59ad8b9582 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:18:35.732920 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0e5e7-d1c0-423f-8e44-20674bfdea36 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:35.733247 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb9e60-b4fb-4ec6-a7bb-0130a639bea1 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:35.735926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:35.751619 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 218/417] 10.222.0.55 () {58 vars in 1442 bytes} [Tue Oct 4 16:18:35 2022] PUT /identity/v3/projects/d8da776c843c485a9ba105a4675b7ac9/groups/b60d9aad19f14e4c9801b1b9be6a584f/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:18:35.857545 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0e5e7-d1c0-423f-8e44-20674bfdea36 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:35.896927 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e95956-03e9-49d1-b334-24445c864a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:35.897851 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e95956-03e9-49d1-b334-24445c864a79 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:35.898268 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e95956-03e9-49d1-b334-24445c864a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:35.898673 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e95956-03e9-49d1-b334-24445c864a79 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:35.911805 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e95956-03e9-49d1-b334-24445c864a79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:35.917818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-e1e95956-03e9-49d1-b334-24445c864a79 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:18:35.917818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:35.917818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:35.917818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:35.917818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:35.917818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:35.917818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:35.917818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:35.917818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:35.917818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:35.917818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:35.917818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:35.917818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:35.917818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:35.917818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:35.917818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:35.918934 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:35.918934 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:35.918934 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:35.918934 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:35.918934 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:35.918934 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:35.918934 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:35.918934 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:35.918934 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:35.918934 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:35.918934 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:35.918934 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:35.918934 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:35.918934 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:35.918934 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:35.918934 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:35.920318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:35.920318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:35.920318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:35.920318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:35.920318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:35.920318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:35.920318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:35.920318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:35.920318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:35.920318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:35.920318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:18:35.920318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:35.922386 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 200/418] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:35.932284 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb9e60-b4fb-4ec6-a7bb-0130a639bea1 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:36.070814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb9e60-b4fb-4ec6-a7bb-0130a639bea1 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:36.110640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9bc9e-a7b5-4e45-970f-d67c8f8f0a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:36.111298 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9bc9e-a7b5-4e45-970f-d67c8f8f0a42 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:36.111581 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9bc9e-a7b5-4e45-970f-d67c8f8f0a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:36.111855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9bc9e-a7b5-4e45-970f-d67c8f8f0a42 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:36.112537 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9bc9e-a7b5-4e45-970f-d67c8f8f0a42 None admin] RBAC: Adding query filter params (name=member) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:36.112841 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9bc9e-a7b5-4e45-970f-d67c8f8f0a42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:36.114226 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9bc9e-a7b5-4e45-970f-d67c8f8f0a42 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:36.123853 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 219/419] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:18:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:36.129194 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e95956-03e9-49d1-b334-24445c864a79 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:36.177007 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:36.232479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e95956-03e9-49d1-b334-24445c864a79 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:36.271004 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58347662-ad8b-4b05-a75c-31a9ca5f2f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:36.271748 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58347662-ad8b-4b05-a75c-31a9ca5f2f72 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:36.272029 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58347662-ad8b-4b05-a75c-31a9ca5f2f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:36.272301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58347662-ad8b-4b05-a75c-31a9ca5f2f72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:36.364530 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58347662-ad8b-4b05-a75c-31a9ca5f2f72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:36.366017 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58347662-ad8b-4b05-a75c-31a9ca5f2f72 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:36.428121 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:36.492137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 201/420] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:18:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:18:36.497913 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9bc9e-a7b5-4e45-970f-d67c8f8f0a42 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:36.563662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:36.600075 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ccec4-0e37-4d6d-95fb-d79e0f4ea05e None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:36.600636 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ccec4-0e37-4d6d-95fb-d79e0f4ea05e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:36.601072 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ccec4-0e37-4d6d-95fb-d79e0f4ea05e None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:36.602589 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 202/421] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:36.607869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b715fce-4db2-45ef-b313-cd48ce56c59a None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:36.608150 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b715fce-4db2-45ef-b313-cd48ce56c59a None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:36.608420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b715fce-4db2-45ef-b313-cd48ce56c59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:36.609657 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9bc9e-a7b5-4e45-970f-d67c8f8f0a42 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:36.641697 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-3b715fce-4db2-45ef-b313-cd48ce56c59a None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:36.644339 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-3b715fce-4db2-45ef-b313-cd48ce56c59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:36.668118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89813d-3ad9-4093-bf29-ebfa6d4681f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:36.668769 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89813d-3ad9-4093-bf29-ebfa6d4681f7 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:36.669060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89813d-3ad9-4093-bf29-ebfa6d4681f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:36.669324 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89813d-3ad9-4093-bf29-ebfa6d4681f7 None admin] PATH_INFO: `/v3/projects/c68abb6013ea44fb9fad2c8141d11c05` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:36.670841 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89813d-3ad9-4093-bf29-ebfa6d4681f7 None admin] RBAC: Authorizing `identity:get_project(project_id=c68abb6013ea44fb9fad2c8141d11c05)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:36.672488 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89813d-3ad9-4093-bf29-ebfa6d4681f7 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:36.674509 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 220/422] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:36 2022] GET /identity/v3/projects/c68abb6013ea44fb9fad2c8141d11c05 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:36.681622 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89813d-3ad9-4093-bf29-ebfa6d4681f7 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:36.782105 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 203/423] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 16:18:36.832956 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89813d-3ad9-4093-bf29-ebfa6d4681f7 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:36.857510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:36.874965 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590267d6-b83a-4345-8fe0-ada0b14ec734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:36.875992 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590267d6-b83a-4345-8fe0-ada0b14ec734 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:36.876463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590267d6-b83a-4345-8fe0-ada0b14ec734 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:36.876925 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590267d6-b83a-4345-8fe0-ada0b14ec734 None admin] PATH_INFO: `/v3/groups/06e2e17186494298914cca80d561ca8d` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:36.878293 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590267d6-b83a-4345-8fe0-ada0b14ec734 None admin] RBAC: Authorizing `identity:get_group(group_id=06e2e17186494298914cca80d561ca8d)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:36.879961 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590267d6-b83a-4345-8fe0-ada0b14ec734 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:36.881774 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 221/424] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Oct 4 16:18:36 2022] GET /identity/v3/groups/06e2e17186494298914cca80d561ca8d => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:36.888148 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b715fce-4db2-45ef-b313-cd48ce56c59a None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:37.001817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:37.033734 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b715fce-4db2-45ef-b313-cd48ce56c59a None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:37.089263 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f5cee-5d8a-4b8f-97fb-d55ae06b48a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:37.090357 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f5cee-5d8a-4b8f-97fb-d55ae06b48a3 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:37.090829 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f5cee-5d8a-4b8f-97fb-d55ae06b48a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:37.091315 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f5cee-5d8a-4b8f-97fb-d55ae06b48a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:37.092280 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f5cee-5d8a-4b8f-97fb-d55ae06b48a3 None admin] RBAC: Adding query filter params (group.id=06e2e17186494298914cca80d561ca8d, role.id=5cf61f379b4d49cb9e19605796d13f62, scope.project.id=c68abb6013ea44fb9fad2c8141d11c05) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:37.092811 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f5cee-5d8a-4b8f-97fb-d55ae06b48a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:37.094443 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f5cee-5d8a-4b8f-97fb-d55ae06b48a3 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:37.103881 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 204/425] 10.222.0.55 () {56 vars in 1376 bytes} [Tue Oct 4 16:18:36 2022] GET /identity/v3/role_assignments?group.id=06e2e17186494298914cca80d561ca8d&scope.project.id=c68abb6013ea44fb9fad2c8141d11c05&role.id=5cf61f379b4d49cb9e19605796d13f62 => generated 611 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:37.185509 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31237f2e-90e9-4a07-8157-3447a5d94ea9 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:37.186040 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31237f2e-90e9-4a07-8157-3447a5d94ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:37.186040 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31237f2e-90e9-4a07-8157-3447a5d94ea9 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:37.187757 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 222/426] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:37.193390 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a639c-d48b-44ff-9af2-1c6af07b605f None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:37.193836 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a639c-d48b-44ff-9af2-1c6af07b605f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:37.193908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a639c-d48b-44ff-9af2-1c6af07b605f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:37.213279 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-004a639c-d48b-44ff-9af2-1c6af07b605f None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:37.214593 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-004a639c-d48b-44ff-9af2-1c6af07b605f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:37.220563 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31237f2e-90e9-4a07-8157-3447a5d94ea9 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:37.335050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31237f2e-90e9-4a07-8157-3447a5d94ea9 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:37.337677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 205/427] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:37.372750 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b709d53-784f-4d7b-a850-b21c74f61c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:37.373784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b709d53-784f-4d7b-a850-b21c74f61c4c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:37.374283 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b709d53-784f-4d7b-a850-b21c74f61c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:37.374767 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b709d53-784f-4d7b-a850-b21c74f61c4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:37.387925 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b709d53-784f-4d7b-a850-b21c74f61c4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:37.393829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-7b709d53-784f-4d7b-a850-b21c74f61c4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:18:37.393829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:37.393829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:37.393829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:37.393829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:37.393829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:37.393829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:37.393829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:37.393829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:37.393829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:37.393829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:37.393829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:37.393829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:37.393829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:37.393829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:37.393829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:37.394766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:37.394766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:37.394766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:37.394766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:37.394766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:37.394766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:37.394766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:37.394766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:37.394766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:37.394766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:37.394766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:37.394766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:37.394766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:37.394766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:37.394766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:37.394766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:37.395596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:37.395596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:37.395596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:37.395596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:37.395596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:37.395596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:37.395596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:37.395596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:37.395596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:37.395596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:37.395596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 16:18:37.395596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:37.398327 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 223/428] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:18:37.404716 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a639c-d48b-44ff-9af2-1c6af07b605f None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:37.483196 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:37.519596 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a639c-d48b-44ff-9af2-1c6af07b605f None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:37.555563 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013b727-7492-483a-bcb6-42362b920a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:37.556174 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013b727-7492-483a-bcb6-42362b920a5e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:37.556456 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013b727-7492-483a-bcb6-42362b920a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:37.556722 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013b727-7492-483a-bcb6-42362b920a5e None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:37.557392 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a013b727-7492-483a-bcb6-42362b920a5e None admin] RBAC: Adding query filter params (name=member) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:37.557689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a013b727-7492-483a-bcb6-42362b920a5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:37.559282 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a013b727-7492-483a-bcb6-42362b920a5e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:37.570410 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 206/429] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:18:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:37.576256 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b709d53-784f-4d7b-a850-b21c74f61c4c None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:37.635766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:37.669058 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013b727-7492-483a-bcb6-42362b920a5e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:37.705745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b709d53-784f-4d7b-a850-b21c74f61c4c None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:37.759159 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b54891-83f5-4e4b-a0bb-f9c5e26bb03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:37.759792 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b54891-83f5-4e4b-a0bb-f9c5e26bb03b None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:37.760062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b54891-83f5-4e4b-a0bb-f9c5e26bb03b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:37.760470 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b54891-83f5-4e4b-a0bb-f9c5e26bb03b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:37.819876 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013b727-7492-483a-bcb6-42362b920a5e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:37.837300 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b54891-83f5-4e4b-a0bb-f9c5e26bb03b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:37.838893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b54891-83f5-4e4b-a0bb-f9c5e26bb03b None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:37.854548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:37.860029 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176013b-231d-40c7-bf2f-aeb69d941e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:37.860694 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176013b-231d-40c7-bf2f-aeb69d941e7a None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:37.860951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176013b-231d-40c7-bf2f-aeb69d941e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:37.861223 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176013b-231d-40c7-bf2f-aeb69d941e7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:37.876115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176013b-231d-40c7-bf2f-aeb69d941e7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:37.881630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-b176013b-231d-40c7-bf2f-aeb69d941e7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 16:18:37.881630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:37.881630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:37.881630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:37.881630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:37.881630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:37.881630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:37.881630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:37.881630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:37.881630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:37.881630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:37.881630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:37.881630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:37.881630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:37.881630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:37.881630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:37.882548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:37.882548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:37.882548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:37.882548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:37.882548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:37.882548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:37.882548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:37.882548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:37.882548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:37.882548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:37.882548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:37.882548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:37.882548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:37.882548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:37.882548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:37.882548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:37.883427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:37.883427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:37.883427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:37.883427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:37.883427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:37.883427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:37.883427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:37.883427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:37.883427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:37.883427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:37.883427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 16:18:37.883427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:37.884511 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 207/430] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Oct 4 16:18:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:18:37.891454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176013b-231d-40c7-bf2f-aeb69d941e7a None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:37.896252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:37.964316 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 224/431] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:18:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:18:37.970528 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b54891-83f5-4e4b-a0bb-f9c5e26bb03b None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:38.046844 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176013b-231d-40c7-bf2f-aeb69d941e7a None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:38.086465 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56571662-93f2-4b29-8354-24d6690832bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:38.087144 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56571662-93f2-4b29-8354-24d6690832bf None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:38.087452 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56571662-93f2-4b29-8354-24d6690832bf None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:38.087706 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56571662-93f2-4b29-8354-24d6690832bf None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:38.088381 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56571662-93f2-4b29-8354-24d6690832bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:38.088681 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56571662-93f2-4b29-8354-24d6690832bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:38.090326 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56571662-93f2-4b29-8354-24d6690832bf None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:38.100343 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 208/432] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:18:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:38.106216 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56571662-93f2-4b29-8354-24d6690832bf None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:38.110899 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b54891-83f5-4e4b-a0bb-f9c5e26bb03b None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:38.150426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64576fe-ac93-4854-a55f-a3d6f1350b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:38.151327 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64576fe-ac93-4854-a55f-a3d6f1350b89 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:38.151844 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64576fe-ac93-4854-a55f-a3d6f1350b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:38.152337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64576fe-ac93-4854-a55f-a3d6f1350b89 None admin] PATH_INFO: `/v3/projects/85526afc0e3249f2af1dd595350c99ca` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:38.153709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64576fe-ac93-4854-a55f-a3d6f1350b89 None admin] RBAC: Authorizing `identity:get_project(project_id=85526afc0e3249f2af1dd595350c99ca)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:38.156103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64576fe-ac93-4854-a55f-a3d6f1350b89 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:38.158333 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 225/433] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:37 2022] GET /identity/v3/projects/85526afc0e3249f2af1dd595350c99ca => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:38.164288 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64576fe-ac93-4854-a55f-a3d6f1350b89 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:38.168145 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:38.191313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:38.222827 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56571662-93f2-4b29-8354-24d6690832bf None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:38.269237 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7332a0d-ee3c-42c7-8212-5e066ba339d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:38.271350 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7332a0d-ee3c-42c7-8212-5e066ba339d5 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:38.271809 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7332a0d-ee3c-42c7-8212-5e066ba339d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:38.272284 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7332a0d-ee3c-42c7-8212-5e066ba339d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:38.295835 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64576fe-ac93-4854-a55f-a3d6f1350b89 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:38.341945 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e8bc0-5cee-4e63-a9c8-12774f4d0682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:38.343022 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e8bc0-5cee-4e63-a9c8-12774f4d0682 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:38.343300 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e8bc0-5cee-4e63-a9c8-12774f4d0682 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:38.343574 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e8bc0-5cee-4e63-a9c8-12774f4d0682 None admin] PATH_INFO: `/v3/groups/06e2e17186494298914cca80d561ca8d` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:38.344960 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e8bc0-5cee-4e63-a9c8-12774f4d0682 None admin] RBAC: Authorizing `identity:get_group(group_id=06e2e17186494298914cca80d561ca8d)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:38.347361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e8bc0-5cee-4e63-a9c8-12774f4d0682 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:38.349275 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 226/434] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Oct 4 16:18:38 2022] GET /identity/v3/groups/06e2e17186494298914cca80d561ca8d => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:38.353255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7332a0d-ee3c-42c7-8212-5e066ba339d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:38.354620 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e8bc0-5cee-4e63-a9c8-12774f4d0682 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:38.355114 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7332a0d-ee3c-42c7-8212-5e066ba339d5 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:38.414136 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:38.471764 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 209/435] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:18:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:18:38.472848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7332a0d-ee3c-42c7-8212-5e066ba339d5 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:38.482775 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:38.499537 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e8bc0-5cee-4e63-a9c8-12774f4d0682 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:38.545259 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dfc2db-cb81-40b3-87d5-8247e99ef829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:38.546036 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfc2db-cb81-40b3-87d5-8247e99ef829 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:38.546315 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfc2db-cb81-40b3-87d5-8247e99ef829 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:38.547088 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfc2db-cb81-40b3-87d5-8247e99ef829 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:38.547825 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dfc2db-cb81-40b3-87d5-8247e99ef829 None admin] RBAC: Adding query filter params (group.id=06e2e17186494298914cca80d561ca8d, role.id=5cf61f379b4d49cb9e19605796d13f62, scope.project.id=85526afc0e3249f2af1dd595350c99ca) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:38.548276 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dfc2db-cb81-40b3-87d5-8247e99ef829 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:38.549743 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dfc2db-cb81-40b3-87d5-8247e99ef829 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:38.555798 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 227/436] 10.222.0.55 () {56 vars in 1376 bytes} [Tue Oct 4 16:18:38 2022] GET /identity/v3/role_assignments?group.id=06e2e17186494298914cca80d561ca8d&scope.project.id=85526afc0e3249f2af1dd595350c99ca&role.id=5cf61f379b4d49cb9e19605796d13f62 => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:38.556858 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe3974-d1fc-42e2-9483-378a0973b71b None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:38.557139 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe3974-d1fc-42e2-9483-378a0973b71b None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:38.557406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe3974-d1fc-42e2-9483-378a0973b71b None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:38.558814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 228/437] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:38.564493 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4c7ee-ac15-4d6c-a69f-8cc3b50b0616 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:38.564843 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4c7ee-ac15-4d6c-a69f-8cc3b50b0616 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:38.565052 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4c7ee-ac15-4d6c-a69f-8cc3b50b0616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:38.587513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-a8c4c7ee-ac15-4d6c-a69f-8cc3b50b0616 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:38.588760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-a8c4c7ee-ac15-4d6c-a69f-8cc3b50b0616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:38.594962 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7332a0d-ee3c-42c7-8212-5e066ba339d5 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:38.639991 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8ebf7-f161-421f-ba28-f907ea83c02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:38.640654 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8ebf7-f161-421f-ba28-f907ea83c02d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:38.640922 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8ebf7-f161-421f-ba28-f907ea83c02d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:38.641186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8ebf7-f161-421f-ba28-f907ea83c02d None admin] PATH_INFO: `/v3/projects/c68abb6013ea44fb9fad2c8141d11c05` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:38.642418 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8ebf7-f161-421f-ba28-f907ea83c02d None admin] RBAC: Authorizing `identity:get_project(project_id=c68abb6013ea44fb9fad2c8141d11c05)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:38.643934 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8ebf7-f161-421f-ba28-f907ea83c02d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:38.645833 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 210/438] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:38 2022] GET /identity/v3/projects/c68abb6013ea44fb9fad2c8141d11c05 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:38.647079 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a859b-d812-4232-ac5a-6e0120adb213 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:38.647364 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a859b-d812-4232-ac5a-6e0120adb213 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:38.647637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a859b-d812-4232-ac5a-6e0120adb213 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:38.648983 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 211/439] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:38.654026 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a859b-d812-4232-ac5a-6e0120adb213 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:38.668502 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 229/440] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 16:18:38.670471 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275f2dc-397c-4009-a667-cd5efe21f1e9 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:38.670745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275f2dc-397c-4009-a667-cd5efe21f1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:38.671036 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275f2dc-397c-4009-a667-cd5efe21f1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:38.699522 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-6275f2dc-397c-4009-a667-cd5efe21f1e9 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:38.700775 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:38.702167 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-6275f2dc-397c-4009-a667-cd5efe21f1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:38.789921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 230/441] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:38.802884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a859b-d812-4232-ac5a-6e0120adb213 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:38.838902 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acf46b-e4fc-4b3a-a125-6f432818ea21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:38.839643 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acf46b-e4fc-4b3a-a125-6f432818ea21 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:38.839920 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acf46b-e4fc-4b3a-a125-6f432818ea21 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:38.840176 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acf46b-e4fc-4b3a-a125-6f432818ea21 None admin] PATH_INFO: `/v3/groups/06e2e17186494298914cca80d561ca8d` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:38.841310 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acf46b-e4fc-4b3a-a125-6f432818ea21 None admin] RBAC: Authorizing `identity:get_group(group_id=06e2e17186494298914cca80d561ca8d)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:38.842764 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acf46b-e4fc-4b3a-a125-6f432818ea21 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:38.844552 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 212/442] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Oct 4 16:18:38 2022] GET /identity/v3/groups/06e2e17186494298914cca80d561ca8d => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:38.850453 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275f2dc-397c-4009-a667-cd5efe21f1e9 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:38.867096 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:38.955501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275f2dc-397c-4009-a667-cd5efe21f1e9 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:38.955690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acf46b-e4fc-4b3a-a125-6f432818ea21 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:38.994795 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e3461-976c-4739-a253-e61f3bfad450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:38.996208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e3461-976c-4739-a253-e61f3bfad450 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:38.996490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e3461-976c-4739-a253-e61f3bfad450 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:38.996764 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e3461-976c-4739-a253-e61f3bfad450 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:38.997542 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e3461-976c-4739-a253-e61f3bfad450 None admin] RBAC: Adding query filter params (group.id=06e2e17186494298914cca80d561ca8d, role.id=2497938af8354a00a7e4ec59ad8b9582, scope.project.id=c68abb6013ea44fb9fad2c8141d11c05) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:38.997854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e3461-976c-4739-a253-e61f3bfad450 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:38.999317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e3461-976c-4739-a253-e61f3bfad450 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:39.015269 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 231/443] 10.222.0.55 () {56 vars in 1376 bytes} [Tue Oct 4 16:18:38 2022] GET /identity/v3/role_assignments?group.id=06e2e17186494298914cca80d561ca8d&scope.project.id=c68abb6013ea44fb9fad2c8141d11c05&role.id=2497938af8354a00a7e4ec59ad8b9582 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:39.067348 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:39.074890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e3461-976c-4739-a253-e61f3bfad450 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:39.080678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acf46b-e4fc-4b3a-a125-6f432818ea21 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:39.118764 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3b999-19ed-4c03-820a-4c313de7523d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:39.119454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3b999-19ed-4c03-820a-4c313de7523d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:39.119732 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3b999-19ed-4c03-820a-4c313de7523d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:39.120000 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3b999-19ed-4c03-820a-4c313de7523d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:39.133356 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3b999-19ed-4c03-820a-4c313de7523d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:39.138975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-e6b3b999-19ed-4c03-820a-4c313de7523d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 16:18:39.138975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:39.138975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:39.138975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:39.138975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:39.138975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:39.138975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:39.138975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:39.138975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:39.138975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:39.138975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:39.138975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:39.138975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:39.138975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:39.138975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:39.138975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:39.140227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:39.140227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:39.140227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:39.140227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:39.140227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:39.140227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:39.140227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:39.140227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:39.140227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:39.140227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:39.140227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:39.140227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:39.140227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:39.140227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:39.140227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:39.140227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:39.141025 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:39.141025 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:39.141025 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:39.141025 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:39.141025 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:39.141025 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:39.141025 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:39.141025 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:39.141025 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:39.141025 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:39.141025 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 16:18:39.141025 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:39.141025 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 213/444] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Oct 4 16:18:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:39.147115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3b999-19ed-4c03-820a-4c313de7523d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:39.171405 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:39.196856 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e3461-976c-4739-a253-e61f3bfad450 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:39.237829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738ddf6-7921-45c4-ad8b-88543179459a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:39.238812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738ddf6-7921-45c4-ad8b-88543179459a None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:39.239125 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738ddf6-7921-45c4-ad8b-88543179459a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:39.239405 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738ddf6-7921-45c4-ad8b-88543179459a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:39.250812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738ddf6-7921-45c4-ad8b-88543179459a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:39.256222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-2738ddf6-7921-45c4-ad8b-88543179459a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:18:39.256222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:39.256222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:39.256222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:39.256222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:39.256222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:39.256222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:39.256222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:39.256222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:39.256222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:39.256222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:39.256222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:39.256222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:39.256222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:39.256222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:39.256222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:39.257380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:39.257380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:39.257380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:39.257380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:39.257380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:39.257380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:39.257380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:39.257380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:39.257380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:39.257380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:39.257380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:39.257380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:39.257380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:39.257380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:39.257380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:39.257380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:39.258688 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:39.258688 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:39.258688 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:39.258688 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:39.258688 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:39.258688 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:39.258688 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:39.258688 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:39.258688 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:39.258688 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:39.258688 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:18:39.258688 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:39.258688 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 232/445] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:18:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:39.263597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738ddf6-7921-45c4-ad8b-88543179459a None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:39.265935 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3b999-19ed-4c03-820a-4c313de7523d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:39.312830 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab165c7-9dd2-4995-a662-cf71e25ff974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:39.313451 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab165c7-9dd2-4995-a662-cf71e25ff974 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:39.313729 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab165c7-9dd2-4995-a662-cf71e25ff974 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:39.313996 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab165c7-9dd2-4995-a662-cf71e25ff974 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:39.314724 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab165c7-9dd2-4995-a662-cf71e25ff974 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:39.314963 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab165c7-9dd2-4995-a662-cf71e25ff974 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:39.316382 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab165c7-9dd2-4995-a662-cf71e25ff974 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:39.324925 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 214/446] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:18:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:39.330785 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab165c7-9dd2-4995-a662-cf71e25ff974 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:39.352988 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:39.384759 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738ddf6-7921-45c4-ad8b-88543179459a None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:39.422084 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3380d49-4ca4-41c1-9158-11d62ec7fd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:39.422698 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3380d49-4ca4-41c1-9158-11d62ec7fd74 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:39.422997 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3380d49-4ca4-41c1-9158-11d62ec7fd74 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:39.423281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3380d49-4ca4-41c1-9158-11d62ec7fd74 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:39.423957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3380d49-4ca4-41c1-9158-11d62ec7fd74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:39.424257 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3380d49-4ca4-41c1-9158-11d62ec7fd74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:39.428610 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3380d49-4ca4-41c1-9158-11d62ec7fd74 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:39.429326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:39.437066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 233/447] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:39.443957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3380d49-4ca4-41c1-9158-11d62ec7fd74 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:39.463810 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab165c7-9dd2-4995-a662-cf71e25ff974 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:39.503794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab181a-0a42-4733-9fb1-4f28ad2a30ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:39.504718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab181a-0a42-4733-9fb1-4f28ad2a30ee None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:39.504988 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab181a-0a42-4733-9fb1-4f28ad2a30ee None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:39.505258 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab181a-0a42-4733-9fb1-4f28ad2a30ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:39.557698 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3380d49-4ca4-41c1-9158-11d62ec7fd74 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:39.586639 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab181a-0a42-4733-9fb1-4f28ad2a30ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:39.588164 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab181a-0a42-4733-9fb1-4f28ad2a30ee None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:39.591665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baaf6c8-d70f-46a7-b238-9de87f008301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:39.592276 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaf6c8-d70f-46a7-b238-9de87f008301 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:39.592555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaf6c8-d70f-46a7-b238-9de87f008301 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:39.592828 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaf6c8-d70f-46a7-b238-9de87f008301 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:39.601968 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:39.655487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:39.659692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baaf6c8-d70f-46a7-b238-9de87f008301 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:39.662476 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baaf6c8-d70f-46a7-b238-9de87f008301 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:39.691365 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 215/448] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:18:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:18:39.697167 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab181a-0a42-4733-9fb1-4f28ad2a30ee None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:39.760635 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 234/449] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:18:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:18:39.766169 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baaf6c8-d70f-46a7-b238-9de87f008301 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:39.791829 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab181a-0a42-4733-9fb1-4f28ad2a30ee None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:39.804861 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:39.826330 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c28e2c-732d-4573-9dca-16eb0c5c9ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:39.826973 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c28e2c-732d-4573-9dca-16eb0c5c9ebe None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:39.827281 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c28e2c-732d-4573-9dca-16eb0c5c9ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:39.827554 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c28e2c-732d-4573-9dca-16eb0c5c9ebe None admin] PATH_INFO: `/v3/projects/85526afc0e3249f2af1dd595350c99ca` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:39.828705 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c28e2c-732d-4573-9dca-16eb0c5c9ebe None admin] RBAC: Authorizing `identity:get_project(project_id=85526afc0e3249f2af1dd595350c99ca)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:39.830158 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c28e2c-732d-4573-9dca-16eb0c5c9ebe None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:39.831823 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 216/450] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:39 2022] GET /identity/v3/projects/85526afc0e3249f2af1dd595350c99ca => generated 302 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:39.837273 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c28e2c-732d-4573-9dca-16eb0c5c9ebe None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:39.857684 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:39.861658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baaf6c8-d70f-46a7-b238-9de87f008301 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:39.895710 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f53b10-7d63-441a-a353-a05a538fa59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:39.896335 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f53b10-7d63-441a-a353-a05a538fa59d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:39.896610 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f53b10-7d63-441a-a353-a05a538fa59d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:39.896882 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f53b10-7d63-441a-a353-a05a538fa59d None admin] PATH_INFO: `/v3/projects/d8da776c843c485a9ba105a4675b7ac9` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:39.898030 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f53b10-7d63-441a-a353-a05a538fa59d None admin] RBAC: Authorizing `identity:get_project(project_id=d8da776c843c485a9ba105a4675b7ac9)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:39.899523 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f53b10-7d63-441a-a353-a05a538fa59d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:39.901143 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 235/451] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:18:39 2022] GET /identity/v3/projects/d8da776c843c485a9ba105a4675b7ac9 => generated 344 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:39.906676 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f53b10-7d63-441a-a353-a05a538fa59d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:39.934748 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c28e2c-732d-4573-9dca-16eb0c5c9ebe None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:39.967754 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e853d9a-2f1f-4bac-8b45-4a0fcf8afbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:39.968389 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e853d9a-2f1f-4bac-8b45-4a0fcf8afbf9 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:39.968662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e853d9a-2f1f-4bac-8b45-4a0fcf8afbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:39.968952 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e853d9a-2f1f-4bac-8b45-4a0fcf8afbf9 None admin] PATH_INFO: `/v3/groups/06e2e17186494298914cca80d561ca8d` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:39.970085 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e853d9a-2f1f-4bac-8b45-4a0fcf8afbf9 None admin] RBAC: Authorizing `identity:get_group(group_id=06e2e17186494298914cca80d561ca8d)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:39.971560 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e853d9a-2f1f-4bac-8b45-4a0fcf8afbf9 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:39.973148 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 217/452] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Oct 4 16:18:39 2022] GET /identity/v3/groups/06e2e17186494298914cca80d561ca8d => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:39.978960 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e853d9a-2f1f-4bac-8b45-4a0fcf8afbf9 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:40.007102 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f53b10-7d63-441a-a353-a05a538fa59d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:40.027899 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:40.040642 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e27f5-b2c5-4183-8cff-66002163ad70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:40.041346 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e27f5-b2c5-4183-8cff-66002163ad70 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:40.041677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e27f5-b2c5-4183-8cff-66002163ad70 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:40.041942 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e27f5-b2c5-4183-8cff-66002163ad70 None admin] PATH_INFO: `/v3/groups/b60d9aad19f14e4c9801b1b9be6a584f` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:40.043345 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e27f5-b2c5-4183-8cff-66002163ad70 None admin] RBAC: Authorizing `identity:get_group(group_id=b60d9aad19f14e4c9801b1b9be6a584f)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:40.045216 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e27f5-b2c5-4183-8cff-66002163ad70 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:40.046816 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 236/453] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Oct 4 16:18:39 2022] GET /identity/v3/groups/b60d9aad19f14e4c9801b1b9be6a584f => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:40.052649 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e27f5-b2c5-4183-8cff-66002163ad70 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:40.080760 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e853d9a-2f1f-4bac-8b45-4a0fcf8afbf9 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:40.085403 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:40.114578 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d121c-1dd4-49db-9c3a-f57bd073e867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:40.115220 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d121c-1dd4-49db-9c3a-f57bd073e867 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:40.115498 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d121c-1dd4-49db-9c3a-f57bd073e867 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:40.115766 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d121c-1dd4-49db-9c3a-f57bd073e867 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:40.116494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d121c-1dd4-49db-9c3a-f57bd073e867 None admin] RBAC: Adding query filter params (group.id=06e2e17186494298914cca80d561ca8d, role.id=2497938af8354a00a7e4ec59ad8b9582, scope.project.id=85526afc0e3249f2af1dd595350c99ca) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:40.116803 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d121c-1dd4-49db-9c3a-f57bd073e867 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:40.118271 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d121c-1dd4-49db-9c3a-f57bd073e867 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:40.124139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 218/454] 10.222.0.55 () {56 vars in 1376 bytes} [Tue Oct 4 16:18:39 2022] GET /identity/v3/role_assignments?group.id=06e2e17186494298914cca80d561ca8d&scope.project.id=85526afc0e3249f2af1dd595350c99ca&role.id=2497938af8354a00a7e4ec59ad8b9582 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:40.153681 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e27f5-b2c5-4183-8cff-66002163ad70 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:40.191946 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5dbe13-c3eb-4204-9355-50f540144299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:40.192574 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5dbe13-c3eb-4204-9355-50f540144299 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:40.192839 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5dbe13-c3eb-4204-9355-50f540144299 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:40.193097 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5dbe13-c3eb-4204-9355-50f540144299 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:40.193860 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5dbe13-c3eb-4204-9355-50f540144299 None admin] RBAC: Adding query filter params (group.id=b60d9aad19f14e4c9801b1b9be6a584f, role.id=066f46534195417295e63a5316632eae, scope.project.id=d8da776c843c485a9ba105a4675b7ac9) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:40.194163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5dbe13-c3eb-4204-9355-50f540144299 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:40.195654 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5dbe13-c3eb-4204-9355-50f540144299 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:40.202426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 237/455] 10.222.0.55 () {56 vars in 1376 bytes} [Tue Oct 4 16:18:40 2022] GET /identity/v3/role_assignments?group.id=b60d9aad19f14e4c9801b1b9be6a584f&scope.project.id=d8da776c843c485a9ba105a4675b7ac9&role.id=066f46534195417295e63a5316632eae => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:42.829566 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da3245-9e4f-47fc-a24d-c13f7c188769 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:42.830060 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da3245-9e4f-47fc-a24d-c13f7c188769 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:42.830060 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da3245-9e4f-47fc-a24d-c13f7c188769 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:42.831627 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 219/456] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:42.837216 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49eb2f-1cd3-43d5-8db2-fca2b842a19c None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:42.837982 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49eb2f-1cd3-43d5-8db2-fca2b842a19c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:42.838465 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49eb2f-1cd3-43d5-8db2-fca2b842a19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:42.863121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-6a49eb2f-1cd3-43d5-8db2-fca2b842a19c None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:42.864631 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-6a49eb2f-1cd3-43d5-8db2-fca2b842a19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:42.957183 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 238/457] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 04 16:18:43.021197 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fbc27-0d28-476e-9c1c-4fb05f1271c3 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:43.021869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fbc27-0d28-476e-9c1c-4fb05f1271c3 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:43.022353 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fbc27-0d28-476e-9c1c-4fb05f1271c3 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:43.023940 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 220/458] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:43.029809 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693c32a-034f-4091-b954-5ac88fba3053 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:43.030340 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693c32a-034f-4091-b954-5ac88fba3053 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:43.030906 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693c32a-034f-4091-b954-5ac88fba3053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:43.053693 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-8693c32a-034f-4091-b954-5ac88fba3053 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:43.063378 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8693c32a-034f-4091-b954-5ac88fba3053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:43.092618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:43.157612 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 239/459] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:43.311745 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fbc27-0d28-476e-9c1c-4fb05f1271c3 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:43.450378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fbc27-0d28-476e-9c1c-4fb05f1271c3 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:43.472299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:43.498382 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa937484-eff8-42d0-b1dc-d873eec80d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:43.499079 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa937484-eff8-42d0-b1dc-d873eec80d21 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:43.499361 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa937484-eff8-42d0-b1dc-d873eec80d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:43.499632 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa937484-eff8-42d0-b1dc-d873eec80d21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:43.515744 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa937484-eff8-42d0-b1dc-d873eec80d21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:43.517357 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa937484-eff8-42d0-b1dc-d873eec80d21 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:43.537865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-fa937484-eff8-42d0-b1dc-d873eec80d21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:43.537865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:43.537865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:43.537865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:43.537865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:43.537865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:43.537865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:43.537865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:43.537865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:43.537865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:43.537865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:43.537865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:43.537865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:18:43.537865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:18:43.537865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:18:43.537865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:18:43.538835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:43.538835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:43.538835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:43.538835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:43.538835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:43.538835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:43.538835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:43.538835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:43.538835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:43.538835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:43.538835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:43.538835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:43.538835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:43.538835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:43.538835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:43.538835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:43.538835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:18:43.539711 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:18:43.539711 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:43.539711 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:43.539711 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 221/460] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:43.548129 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693c32a-034f-4091-b954-5ac88fba3053 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:43.619249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc21bba-c103-49b2-ab86-0930879ba861 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:43.620319 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc21bba-c103-49b2-ab86-0930879ba861 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:43.620865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc21bba-c103-49b2-ab86-0930879ba861 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:43.623370 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 222/461] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:43.630024 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7b1ad-a412-47b0-896f-5b35f3536dfa None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:43.630607 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7b1ad-a412-47b0-896f-5b35f3536dfa None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:43.631104 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7b1ad-a412-47b0-896f-5b35f3536dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:43.651931 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-6ee7b1ad-a412-47b0-896f-5b35f3536dfa None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:43.654098 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-6ee7b1ad-a412-47b0-896f-5b35f3536dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:43.694746 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693c32a-034f-4091-b954-5ac88fba3053 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:43.729361 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 223/462] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 16:18:43.730599 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7b1ad-a412-47b0-896f-5b35f3536dfa None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:43.740700 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62b293-ebf0-4ae8-9ffc-fa493a741bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:43.741417 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62b293-ebf0-4ae8-9ffc-fa493a741bdd None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:43.741847 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62b293-ebf0-4ae8-9ffc-fa493a741bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:43.742265 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62b293-ebf0-4ae8-9ffc-fa493a741bdd None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:43.743105 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62b293-ebf0-4ae8-9ffc-fa493a741bdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:43.743615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62b293-ebf0-4ae8-9ffc-fa493a741bdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:43.745217 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62b293-ebf0-4ae8-9ffc-fa493a741bdd None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:43.768099 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 240/463] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:43.769678 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332649de-3f62-44b6-9f60-4d5000ed18a2 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:43.770097 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332649de-3f62-44b6-9f60-4d5000ed18a2 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:43.770506 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332649de-3f62-44b6-9f60-4d5000ed18a2 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:43.771978 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 241/464] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:43.777611 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadf1a5-b761-4409-821a-adbe3fd4eed6 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:43.778109 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadf1a5-b761-4409-821a-adbe3fd4eed6 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:43.778529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadf1a5-b761-4409-821a-adbe3fd4eed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:43.798606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-8dadf1a5-b761-4409-821a-adbe3fd4eed6 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:43.799930 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8dadf1a5-b761-4409-821a-adbe3fd4eed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:43.814165 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:43.845661 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:43.854360 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7b1ad-a412-47b0-896f-5b35f3536dfa None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:43.875076 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 242/465] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:43.876522 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dadf1a5-b761-4409-821a-adbe3fd4eed6 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:43.913396 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2ace8-5853-4bfe-ae59-8d3d08e15e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:43.914380 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2ace8-5853-4bfe-ae59-8d3d08e15e18 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:43.914826 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2ace8-5853-4bfe-ae59-8d3d08e15e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:43.915289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2ace8-5853-4bfe-ae59-8d3d08e15e18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:43.930559 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2ace8-5853-4bfe-ae59-8d3d08e15e18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:43.932820 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2ace8-5853-4bfe-ae59-8d3d08e15e18 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:43.960032 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-5da2ace8-5853-4bfe-ae59-8d3d08e15e18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:43.960032 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:43.960032 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:43.960032 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:43.960032 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:43.960032 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:43.960032 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:43.960032 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:43.960032 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:43.960032 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:43.960032 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:43.960032 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:43.960032 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:18:43.960032 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:18:43.960032 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:18:43.960032 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:18:43.960989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:43.960989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:43.960989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:43.960989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:43.960989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:43.960989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:43.960989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:43.960989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:43.960989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:43.960989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:43.960989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:43.960989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:43.960989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:43.960989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:43.960989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:43.960989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:43.960989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:18:43.961850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:18:43.961850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:43.961850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:43.965101 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 224/466] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:43.972412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2ace8-5853-4bfe-ae59-8d3d08e15e18 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:44.052659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dadf1a5-b761-4409-821a-adbe3fd4eed6 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:44.091695 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7080a-4340-44b5-81a8-afa4cb296aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:44.092340 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7080a-4340-44b5-81a8-afa4cb296aed None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:44.092638 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7080a-4340-44b5-81a8-afa4cb296aed None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:44.092905 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7080a-4340-44b5-81a8-afa4cb296aed None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:44.093583 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7080a-4340-44b5-81a8-afa4cb296aed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:44.095788 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7080a-4340-44b5-81a8-afa4cb296aed None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:44.104338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2ace8-5853-4bfe-ae59-8d3d08e15e18 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:44.125733 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 243/467] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Oct 4 16:18:43 2022] POST /identity/v3/users => generated 246 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:18:44.126566 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7080a-4340-44b5-81a8-afa4cb296aed None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:44.132355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:44.153076 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fd033-7a38-446a-819b-72b03e34c952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:44.153448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fd033-7a38-446a-819b-72b03e34c952 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:44.153731 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fd033-7a38-446a-819b-72b03e34c952 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:44.154009 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fd033-7a38-446a-819b-72b03e34c952 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:44.154781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750fd033-7a38-446a-819b-72b03e34c952 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:44.155118 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750fd033-7a38-446a-819b-72b03e34c952 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:44.156557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750fd033-7a38-446a-819b-72b03e34c952 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:44.171602 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 225/468] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:44.177844 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fd033-7a38-446a-819b-72b03e34c952 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:44.188486 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:44.289127 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7080a-4340-44b5-81a8-afa4cb296aed None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:44.308782 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fd033-7a38-446a-819b-72b03e34c952 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:44.327097 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b75870-041b-4feb-bf9c-97028b6645d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:44.327897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b75870-041b-4feb-bf9c-97028b6645d5 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:44.328235 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b75870-041b-4feb-bf9c-97028b6645d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:44.328574 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b75870-041b-4feb-bf9c-97028b6645d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:44.341529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b75870-041b-4feb-bf9c-97028b6645d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:44.343201 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b75870-041b-4feb-bf9c-97028b6645d5 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:44.350017 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57e691-568c-49f4-a178-5b4aa3fdb6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:44.351149 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57e691-568c-49f4-a178-5b4aa3fdb6c3 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:44.351604 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57e691-568c-49f4-a178-5b4aa3fdb6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:44.352066 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57e691-568c-49f4-a178-5b4aa3fdb6c3 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:44.353032 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57e691-568c-49f4-a178-5b4aa3fdb6c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:44.354668 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57e691-568c-49f4-a178-5b4aa3fdb6c3 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:44.359707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-d8b75870-041b-4feb-bf9c-97028b6645d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:44.359707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:44.359707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:44.359707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:44.359707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:44.359707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:44.359707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:44.359707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:44.359707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:44.359707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:44.359707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:44.359707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:44.359707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:18:44.359707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:18:44.359707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:18:44.359707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:18:44.360744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:44.360744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:44.360744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:44.360744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:44.360744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:44.360744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:44.360744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:44.360744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:44.360744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:44.360744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:44.360744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:44.360744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:44.360744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:44.360744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:44.360744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:44.360744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:44.360744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:18:44.361608 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:18:44.361608 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:44.361608 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:44.366235 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 244/469] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:44.367370 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b75870-041b-4feb-bf9c-97028b6645d5 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:44.383430 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 226/470] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Oct 4 16:18:44 2022] POST /identity/v3/users => generated 248 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:18:44.384707 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57e691-568c-49f4-a178-5b4aa3fdb6c3 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:44.446358 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:44.469612 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:44.514401 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b75870-041b-4feb-bf9c-97028b6645d5 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:44.531449 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57e691-568c-49f4-a178-5b4aa3fdb6c3 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:44.563561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76358d4e-c2ab-49ad-9980-a2f45fe899f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:44.564381 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76358d4e-c2ab-49ad-9980-a2f45fe899f6 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:44.564759 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76358d4e-c2ab-49ad-9980-a2f45fe899f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:44.565219 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76358d4e-c2ab-49ad-9980-a2f45fe899f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:44.578034 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76358d4e-c2ab-49ad-9980-a2f45fe899f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:44.579775 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76358d4e-c2ab-49ad-9980-a2f45fe899f6 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:44.584332 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d67d47-5b79-4532-a4a0-a30226d02ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:44.585181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d67d47-5b79-4532-a4a0-a30226d02ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:44.585599 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d67d47-5b79-4532-a4a0-a30226d02ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:44.586020 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d67d47-5b79-4532-a4a0-a30226d02ea3 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:44.586817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d67d47-5b79-4532-a4a0-a30226d02ea3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:44.587280 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d67d47-5b79-4532-a4a0-a30226d02ea3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:44.588813 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d67d47-5b79-4532-a4a0-a30226d02ea3 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:44.595985 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-76358d4e-c2ab-49ad-9980-a2f45fe899f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:44.595985 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:44.595985 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:44.595985 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:44.595985 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:44.595985 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:44.595985 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:44.595985 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:44.595985 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:44.595985 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:44.595985 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:44.595985 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:44.595985 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:18:44.595985 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:18:44.595985 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:18:44.595985 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:18:44.596929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:44.596929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:44.596929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:44.596929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:44.596929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:44.596929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:44.596929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:44.596929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:44.596929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:44.596929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:44.596929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:44.596929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:44.596929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:44.596929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:44.596929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:44.596929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:44.596929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:18:44.598178 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:18:44.598178 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:44.598178 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:44.598178 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 245/471] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:44.599205 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afedb5-03b6-4001-9d2b-18100c85bef1 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:44.599307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afedb5-03b6-4001-9d2b-18100c85bef1 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:44.599537 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afedb5-03b6-4001-9d2b-18100c85bef1 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:44.600943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 246/472] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:44.605529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afedb5-03b6-4001-9d2b-18100c85bef1 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:44.608502 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 227/473] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:44.610137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebb708-1163-46bb-a826-adcd7030689d None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:44.610418 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebb708-1163-46bb-a826-adcd7030689d None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:44.611657 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebb708-1163-46bb-a826-adcd7030689d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:44.634331 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-a1ebb708-1163-46bb-a826-adcd7030689d None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:44.635731 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a1ebb708-1163-46bb-a826-adcd7030689d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:44.722053 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 228/474] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:44.722936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebb708-1163-46bb-a826-adcd7030689d None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:44.750917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afedb5-03b6-4001-9d2b-18100c85bef1 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:44.766462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:44.815613 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3889b6-edf0-4fdd-bd44-91b8a3c35d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:44.816136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3889b6-edf0-4fdd-bd44-91b8a3c35d52 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:44.816407 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3889b6-edf0-4fdd-bd44-91b8a3c35d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:44.816671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3889b6-edf0-4fdd-bd44-91b8a3c35d52 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:44.817313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3889b6-edf0-4fdd-bd44-91b8a3c35d52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:44.817607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3889b6-edf0-4fdd-bd44-91b8a3c35d52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:44.819001 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3889b6-edf0-4fdd-bd44-91b8a3c35d52 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:44.835692 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:44.842855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 247/475] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:44.850621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3889b6-edf0-4fdd-bd44-91b8a3c35d52 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:44.927725 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebb708-1163-46bb-a826-adcd7030689d None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:44.994532 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e372905-9c87-4353-9de3-a8ded1e021b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:44.995175 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e372905-9c87-4353-9de3-a8ded1e021b7 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:44.995445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e372905-9c87-4353-9de3-a8ded1e021b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:44.995747 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e372905-9c87-4353-9de3-a8ded1e021b7 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:44.996392 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e372905-9c87-4353-9de3-a8ded1e021b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:44.997828 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e372905-9c87-4353-9de3-a8ded1e021b7 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:45.034994 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3889b6-edf0-4fdd-bd44-91b8a3c35d52 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:45.041336 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 229/476] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Oct 4 16:18:44 2022] POST /identity/v3/users => generated 249 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:18:45.042354 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e372905-9c87-4353-9de3-a8ded1e021b7 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:45.119899 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcc7f2-dcc9-4882-a964-6439033cc447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:45.120973 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcc7f2-dcc9-4882-a964-6439033cc447 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:45.121459 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcc7f2-dcc9-4882-a964-6439033cc447 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:45.121923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcc7f2-dcc9-4882-a964-6439033cc447 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:45.122789 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdcc7f2-dcc9-4882-a964-6439033cc447 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:45.124495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdcc7f2-dcc9-4882-a964-6439033cc447 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:45.182256 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 248/477] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Oct 4 16:18:44 2022] POST /identity/v3/users => generated 248 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:18:45.198726 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e372905-9c87-4353-9de3-a8ded1e021b7 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:45.213987 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:45.256427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f737f-b8d7-4d39-a275-ffeb0c099731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:45.257119 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f737f-b8d7-4d39-a275-ffeb0c099731 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:45.257396 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f737f-b8d7-4d39-a275-ffeb0c099731 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:45.257667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f737f-b8d7-4d39-a275-ffeb0c099731 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:45.258462 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f737f-b8d7-4d39-a275-ffeb0c099731 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:45.259928 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f737f-b8d7-4d39-a275-ffeb0c099731 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:45.269639 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.sql.core [None req-669f737f-b8d7-4d39-a275-ffeb0c099731 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 16:18:45.269639 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 04 16:18:45.269639 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [parameters: {'id': 'e1d4bb5a827b4946befc1a836619d26f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 04 16:18:45.269639 dv-cinder-749155-14-smb devstack@keystone.service[81561]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81561) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 16:18:45.287557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-669f737f-b8d7-4d39-a275-ffeb0c099731 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 04 16:18:45.287557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:45.287557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 16:18:45.287557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 16:18:45.287557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 16:18:45.287557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 16:18:45.287557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 16:18:45.287557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 16:18:45.287557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 16:18:45.287557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application conn.query(q) Oct 04 16:18:45.287557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 16:18:45.287557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 16:18:45.287557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 16:18:45.287557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application result.read() Oct 04 16:18:45.287557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 16:18:45.288495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 16:18:45.288495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 16:18:45.288495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 16:18:45.288495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 16:18:45.288495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 16:18:45.288495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 16:18:45.288495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 16:18:45.288495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 16:18:45.288495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:45.288495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 16:18:45.288495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:45.288495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:45.288495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 16:18:45.288495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 16:18:45.288495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 04 16:18:45.288495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return ref.to_dict() Oct 04 16:18:45.288495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 16:18:45.288495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application next(self.gen) Oct 04 16:18:45.289587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 16:18:45.289587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application yield resource Oct 04 16:18:45.289587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 16:18:45.289587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application next(self.gen) Oct 04 16:18:45.289587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 16:18:45.289587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 16:18:45.289587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 16:18:45.289587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 16:18:45.289587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 16:18:45.289587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise self.value Oct 04 16:18:45.289587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 16:18:45.289587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 16:18:45.289587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 16:18:45.289587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application session.commit() Oct 04 16:18:45.289587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 16:18:45.289587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 16:18:45.289587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 16:18:45.290717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 16:18:45.290717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 16:18:45.290717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self.session.flush() Oct 04 16:18:45.290717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 16:18:45.290717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 16:18:45.290717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 16:18:45.290717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 16:18:45.290717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 16:18:45.290717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application compat.raise_( Oct 04 16:18:45.290717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 16:18:45.290717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception Oct 04 16:18:45.290717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 16:18:45.290717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 16:18:45.290717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 16:18:45.290717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 16:18:45.290717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 16:18:45.290717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 16:18:45.291889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 16:18:45.291889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 16:18:45.291889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 04 16:18:45.291889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 04 16:18:45.291889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 16:18:45.291889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 16:18:45.291889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 16:18:45.291889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 16:18:45.291889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 16:18:45.291889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 16:18:45.291889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 16:18:45.291889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 16:18:45.291889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 16:18:45.291889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 16:18:45.291889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 16:18:45.291889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception Oct 04 16:18:45.292951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 16:18:45.292951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 16:18:45.292951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 16:18:45.292951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 16:18:45.292951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 16:18:45.292951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 16:18:45.292951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 16:18:45.292951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application conn.query(q) Oct 04 16:18:45.292951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 16:18:45.292951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 16:18:45.292951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 16:18:45.292951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application result.read() Oct 04 16:18:45.292951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 16:18:45.292951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 16:18:45.292951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 16:18:45.292951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 16:18:45.299580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 16:18:45.299580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 16:18:45.299580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 16:18:45.299580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 16:18:45.299580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 16:18:45.299580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 04 16:18:45.299580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [parameters: {'id': 'e1d4bb5a827b4946befc1a836619d26f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 04 16:18:45.299580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 16:18:45.299580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:45.299580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:18:45.299580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:45.299580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:45.299580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:45.299580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:45.299580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:45.299580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:45.300648 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:45.300648 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:45.300648 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:45.300648 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:45.300648 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:45.300648 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:45.300648 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 04 16:18:45.300648 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 04 16:18:45.300648 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:45.300648 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:45.300648 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 04 16:18:45.300648 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 04 16:18:45.300648 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 16:18:45.300648 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 16:18:45.300648 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 04 16:18:45.300648 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:45.301673 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 230/478] 10.222.0.55 () {60 vars in 1131 bytes} [Tue Oct 4 16:18:45 2022] POST /identity/v3/roles => generated 144 bytes in 247 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:45.301758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcc7f2-dcc9-4882-a964-6439033cc447 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:45.326108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:45.411477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcc7f2-dcc9-4882-a964-6439033cc447 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:45.447498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01584dfc-a0f5-483e-b479-dc1dc39779fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:45.448156 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01584dfc-a0f5-483e-b479-dc1dc39779fa None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:45.448424 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01584dfc-a0f5-483e-b479-dc1dc39779fa None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:45.448727 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01584dfc-a0f5-483e-b479-dc1dc39779fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:45.461172 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01584dfc-a0f5-483e-b479-dc1dc39779fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:45.466623 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-01584dfc-a0f5-483e-b479-dc1dc39779fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 16:18:45.466623 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:45.466623 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:45.466623 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:45.466623 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:45.466623 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:45.466623 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:45.466623 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:45.466623 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:45.466623 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:45.466623 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:45.466623 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:45.466623 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:45.466623 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:45.466623 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:45.466623 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:45.468797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:45.468797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:45.468797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:45.468797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:45.468797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:45.468797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:45.468797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:45.468797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:45.468797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:45.468797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:45.468797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:45.468797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:45.468797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:45.468797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:45.468797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:45.468797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:45.470867 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:45.470867 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:45.470867 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:45.470867 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:45.470867 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:45.470867 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:45.470867 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:45.470867 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:45.470867 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:45.470867 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:45.470867 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 16:18:45.470867 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:45.470867 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 249/479] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Oct 4 16:18:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:45.475008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f737f-b8d7-4d39-a275-ffeb0c099731 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:45.588498 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f737f-b8d7-4d39-a275-ffeb0c099731 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:45.629711 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d83bd-e644-4ee1-920a-e156e24b591e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:45.630328 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d83bd-e644-4ee1-920a-e156e24b591e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:45.630665 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d83bd-e644-4ee1-920a-e156e24b591e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:45.630935 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d83bd-e644-4ee1-920a-e156e24b591e None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:45.631634 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d83bd-e644-4ee1-920a-e156e24b591e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:45.631929 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d83bd-e644-4ee1-920a-e156e24b591e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:45.633311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d83bd-e644-4ee1-920a-e156e24b591e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:45.642177 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 231/480] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:18:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:46.767954 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b439f4-2793-41d0-9139-8605149bb0da None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:46.768520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b439f4-2793-41d0-9139-8605149bb0da None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:46.768520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b439f4-2793-41d0-9139-8605149bb0da None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:46.770169 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 250/481] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:46.785083 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e302b-ea70-423f-8839-5fdfb4e49829 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:46.785603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e302b-ea70-423f-8839-5fdfb4e49829 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:46.785603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e302b-ea70-423f-8839-5fdfb4e49829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:46.816704 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-616e302b-ea70-423f-8839-5fdfb4e49829 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:46.817922 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-616e302b-ea70-423f-8839-5fdfb4e49829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:46.860925 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:46.866933 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607b7b3-1e68-478d-9908-b2b058a8793a None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:46.867252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607b7b3-1e68-478d-9908-b2b058a8793a None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:46.867807 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607b7b3-1e68-478d-9908-b2b058a8793a None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:46.869133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 251/482] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:46.875555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ecd96-fdb8-4554-a6fa-326c5dacd8ec None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:46.875856 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ecd96-fdb8-4554-a6fa-326c5dacd8ec None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:46.876100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ecd96-fdb8-4554-a6fa-326c5dacd8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:46.904288 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-7f9ecd96-fdb8-4554-a6fa-326c5dacd8ec None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:46.908590 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-7f9ecd96-fdb8-4554-a6fa-326c5dacd8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:46.933526 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 232/483] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:47.002686 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 252/484] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:47.223096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e302b-ea70-423f-8839-5fdfb4e49829 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:47.351717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e302b-ea70-423f-8839-5fdfb4e49829 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:47.385979 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4d5fa-ef1d-4d31-901a-c0560815c9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:47.386675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4d5fa-ef1d-4d31-901a-c0560815c9f0 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:47.386948 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4d5fa-ef1d-4d31-901a-c0560815c9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:47.387244 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4d5fa-ef1d-4d31-901a-c0560815c9f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:47.397613 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4d5fa-ef1d-4d31-901a-c0560815c9f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:47.402529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-e8b4d5fa-ef1d-4d31-901a-c0560815c9f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:18:47.402529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:47.402529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:47.402529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:47.402529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:47.402529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:47.402529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:47.402529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:47.402529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:47.402529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:47.402529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:47.402529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:47.402529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:47.402529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:47.402529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:47.402529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:47.403464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:47.403464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:47.403464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:47.403464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:47.403464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:47.403464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:47.403464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:47.403464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:47.403464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:47.403464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:47.403464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:47.403464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:47.403464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:47.403464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:47.403464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:47.403464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:47.404693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:47.404693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:47.404693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:47.404693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:47.404693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:47.404693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:47.404693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:47.404693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:47.404693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:47.404693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:47.404693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:18:47.404693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:47.404693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 233/485] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Oct 4 16:18:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:47.410022 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ecd96-fdb8-4554-a6fa-326c5dacd8ec None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:47.426458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:47.530563 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ecd96-fdb8-4554-a6fa-326c5dacd8ec None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:47.550757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4d5fa-ef1d-4d31-901a-c0560815c9f0 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:47.572358 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f222a2-4c47-47ce-8f07-7a72615cb259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:47.572984 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f222a2-4c47-47ce-8f07-7a72615cb259 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:47.573283 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f222a2-4c47-47ce-8f07-7a72615cb259 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:47.573539 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f222a2-4c47-47ce-8f07-7a72615cb259 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:47.574279 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f222a2-4c47-47ce-8f07-7a72615cb259 None admin] RBAC: Adding query filter params (name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:47.574586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f222a2-4c47-47ce-8f07-7a72615cb259 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:47.576002 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f222a2-4c47-47ce-8f07-7a72615cb259 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:47.582576 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:47.587262 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 253/486] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Oct 4 16:18:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:47.594699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f222a2-4c47-47ce-8f07-7a72615cb259 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:47.674648 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4d5fa-ef1d-4d31-901a-c0560815c9f0 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:47.720427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c367ec-cb0e-4256-acfd-5d7103315648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:47.721715 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c367ec-cb0e-4256-acfd-5d7103315648 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:47.722432 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c367ec-cb0e-4256-acfd-5d7103315648 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:47.722923 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c367ec-cb0e-4256-acfd-5d7103315648 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:47.739062 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c367ec-cb0e-4256-acfd-5d7103315648 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:47.744849 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-89c367ec-cb0e-4256-acfd-5d7103315648 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:18:47.744849 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:47.744849 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:47.744849 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:47.744849 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:47.744849 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:47.744849 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:47.744849 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:47.744849 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:47.744849 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:47.744849 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:47.744849 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:47.744849 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:47.744849 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:47.744849 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:47.744849 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:47.745835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:47.745835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:47.745835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:47.745835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:47.745835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:47.745835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:47.745835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:47.745835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:47.745835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:47.745835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:47.745835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:47.745835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:47.745835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:47.745835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:47.745835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:47.745835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:47.746642 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:47.746642 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:47.746642 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:47.746642 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:47.746642 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:47.746642 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:47.746642 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:47.746642 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:47.746642 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:47.746642 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:47.746642 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:18:47.746642 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:47.749312 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:47.750818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 234/487] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Oct 4 16:18:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:18:47.760165 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c367ec-cb0e-4256-acfd-5d7103315648 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:47.800493 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f222a2-4c47-47ce-8f07-7a72615cb259 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:47.868104 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c5fa4-589b-43f1-a124-1b0337e11c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:47.868767 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c5fa4-589b-43f1-a124-1b0337e11c14 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:47.869029 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c5fa4-589b-43f1-a124-1b0337e11c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:47.869294 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c5fa4-589b-43f1-a124-1b0337e11c14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:47.887830 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c5fa4-589b-43f1-a124-1b0337e11c14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:47.889728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c5fa4-589b-43f1-a124-1b0337e11c14 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:47.914057 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:47.924686 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-4e0c5fa4-589b-43f1-a124-1b0337e11c14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:47.924686 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:47.924686 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:47.924686 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:47.924686 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:47.924686 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:47.924686 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:47.924686 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:47.924686 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:47.924686 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:47.924686 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:47.924686 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:47.924686 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:18:47.924686 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:18:47.924686 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:18:47.924686 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:18:47.925639 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:47.925639 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:47.925639 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:47.925639 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:47.925639 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:47.925639 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:47.925639 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:47.925639 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:47.925639 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:47.925639 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:47.925639 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:47.925639 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:47.925639 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:47.925639 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:47.925639 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:47.925639 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:47.925639 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:18:47.926507 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:18:47.926507 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:47.926507 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:47.928926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 254/488] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:18:47.935297 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c367ec-cb0e-4256-acfd-5d7103315648 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:47.944932 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c5fa4-589b-43f1-a124-1b0337e11c14 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:47.994602 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511bb5b-d5f0-4e7a-803b-cfe5a8e96a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:47.995261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511bb5b-d5f0-4e7a-803b-cfe5a8e96a68 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:47.995690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511bb5b-d5f0-4e7a-803b-cfe5a8e96a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:47.995963 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511bb5b-d5f0-4e7a-803b-cfe5a8e96a68 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:47.996633 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511bb5b-d5f0-4e7a-803b-cfe5a8e96a68 None admin] RBAC: Adding query filter params (name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:47.996947 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511bb5b-d5f0-4e7a-803b-cfe5a8e96a68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:47.998362 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511bb5b-d5f0-4e7a-803b-cfe5a8e96a68 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:48.007261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 235/489] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Oct 4 16:18:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:48.016009 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511bb5b-d5f0-4e7a-803b-cfe5a8e96a68 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:48.070244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c5fa4-589b-43f1-a124-1b0337e11c14 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:48.100482 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:48.109463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86672d93-fedb-4915-b171-a4d2455bdec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:48.110390 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86672d93-fedb-4915-b171-a4d2455bdec8 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:48.110695 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86672d93-fedb-4915-b171-a4d2455bdec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:48.110943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86672d93-fedb-4915-b171-a4d2455bdec8 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:48.111612 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86672d93-fedb-4915-b171-a4d2455bdec8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:48.111914 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86672d93-fedb-4915-b171-a4d2455bdec8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:48.113291 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86672d93-fedb-4915-b171-a4d2455bdec8 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:48.119172 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511bb5b-d5f0-4e7a-803b-cfe5a8e96a68 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:48.125613 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 255/490] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:48.130778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cf9a7-d84b-436f-ae10-004af6af4bd4 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:48.130778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cf9a7-d84b-436f-ae10-004af6af4bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:48.130778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cf9a7-d84b-436f-ae10-004af6af4bd4 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:48.133148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 256/491] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:48.134316 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2c9ea-f775-4008-b87f-a7e192557e3b None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:48.134593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2c9ea-f775-4008-b87f-a7e192557e3b None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:48.134871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2c9ea-f775-4008-b87f-a7e192557e3b None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:48.140309 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 257/492] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:48.140309 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2c9ea-f775-4008-b87f-a7e192557e3b None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:48.161963 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ff1f0-ebab-44cb-b41f-06f5a8634114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:48.162604 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ff1f0-ebab-44cb-b41f-06f5a8634114 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:48.162879 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ff1f0-ebab-44cb-b41f-06f5a8634114 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:48.163430 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ff1f0-ebab-44cb-b41f-06f5a8634114 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:48.175973 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ff1f0-ebab-44cb-b41f-06f5a8634114 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:48.177485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ff1f0-ebab-44cb-b41f-06f5a8634114 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:48.184236 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:48.193001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-a84ff1f0-ebab-44cb-b41f-06f5a8634114 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:48.193001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:48.193001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:48.193001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:48.193001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:48.193001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:48.193001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:48.193001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:48.193001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:48.193001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:48.193001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:48.193001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:48.193001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:18:48.193001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:18:48.193001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:18:48.193001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:18:48.193918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:48.193918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:48.193918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:48.193918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:48.193918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:48.193918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:48.193918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:48.193918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:48.193918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:48.193918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:48.193918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:48.193918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:48.193918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:48.193918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:48.193918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:48.193918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:48.193918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:18:48.200230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:18:48.200230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:48.200230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:48.200230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 236/493] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:48.200230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60b383-513b-4b00-ab30-b52fe82fe496 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:48.200230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60b383-513b-4b00-ab30-b52fe82fe496 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:48.200230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60b383-513b-4b00-ab30-b52fe82fe496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:48.215368 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-8b60b383-513b-4b00-ab30-b52fe82fe496 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:48.216657 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-8b60b383-513b-4b00-ab30-b52fe82fe496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:48.250997 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2c9ea-f775-4008-b87f-a7e192557e3b None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:48.287011 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 237/494] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:48.299156 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16ce4f-ee1d-4887-ba08-701154e11fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:48.299156 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16ce4f-ee1d-4887-ba08-701154e11fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:48.299156 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16ce4f-ee1d-4887-ba08-701154e11fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:48.299450 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbc4fe-e0c2-4ffe-b44a-b382ec21333e None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:48.299534 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16ce4f-ee1d-4887-ba08-701154e11fe5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:48.299632 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbc4fe-e0c2-4ffe-b44a-b382ec21333e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:48.299632 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbc4fe-e0c2-4ffe-b44a-b382ec21333e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:48.307278 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16ce4f-ee1d-4887-ba08-701154e11fe5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:48.308962 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16ce4f-ee1d-4887-ba08-701154e11fe5 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:48.315567 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-bdfbc4fe-e0c2-4ffe-b44a-b382ec21333e None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:48.316868 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-bdfbc4fe-e0c2-4ffe-b44a-b382ec21333e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:48.322621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-4e16ce4f-ee1d-4887-ba08-701154e11fe5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 16:18:48.322621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:48.322621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:48.322621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:48.322621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:48.322621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:48.322621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:48.322621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:48.322621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:48.322621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:48.322621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:48.322621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:48.322621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:18:48.322621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:18:48.322621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:18:48.322621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:18:48.323756 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:48.323756 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:48.323756 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:18:48.323756 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:18:48.323756 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:18:48.323756 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:18:48.323756 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:48.323756 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:48.323756 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:48.323756 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:48.323756 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:48.323756 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:48.323756 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:48.323756 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:48.323756 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:48.323756 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:48.323756 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:48.323756 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:48.324659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:48.324659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:48.324659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:18:48.324659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:18:48.324659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:18:48.324659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:18:48.324659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:18:48.324659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:18:48.324659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 16:18:48.324659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:48.327147 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 258/495] 10.222.0.55 () {56 vars in 1093 bytes} [Tue Oct 4 16:18:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:48.328088 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16ce4f-ee1d-4887-ba08-701154e11fe5 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:48.387434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:48.399121 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 238/496] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:48.400645 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbc4fe-e0c2-4ffe-b44a-b382ec21333e None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:48.466392 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:48.496207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16ce4f-ee1d-4887-ba08-701154e11fe5 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:48.518234 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbc4fe-e0c2-4ffe-b44a-b382ec21333e None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:48.558446 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bc20d-c1e2-4177-9284-636643cfaed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:48.559651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bc20d-c1e2-4177-9284-636643cfaed0 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:48.560378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bc20d-c1e2-4177-9284-636643cfaed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:48.561007 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bc20d-c1e2-4177-9284-636643cfaed0 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:48.562381 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292bc20d-c1e2-4177-9284-636643cfaed0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:48.562976 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292bc20d-c1e2-4177-9284-636643cfaed0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:48.565496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292bc20d-c1e2-4177-9284-636643cfaed0 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:48.580567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ee050-55ae-4205-b998-abe7ffe199cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:48.581088 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ee050-55ae-4205-b998-abe7ffe199cc None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:48.581363 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ee050-55ae-4205-b998-abe7ffe199cc None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:48.581705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ee050-55ae-4205-b998-abe7ffe199cc None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:48.582610 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ee050-55ae-4205-b998-abe7ffe199cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:48.582998 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ee050-55ae-4205-b998-abe7ffe199cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:48.584875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ee050-55ae-4205-b998-abe7ffe199cc None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:48.610874 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 239/497] 10.222.0.55 () {56 vars in 1133 bytes} [Tue Oct 4 16:18:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:48.611970 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bc20d-c1e2-4177-9284-636643cfaed0 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:48.612625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 259/498] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:48.618671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ee050-55ae-4205-b998-abe7ffe199cc None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:48.740699 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bc20d-c1e2-4177-9284-636643cfaed0 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:48.758125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:48.768486 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ee050-55ae-4205-b998-abe7ffe199cc None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:48.778678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314bdd91-c1e6-466f-8d55-207b2e9c2289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:48.779694 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bdd91-c1e6-466f-8d55-207b2e9c2289 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:48.780171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bdd91-c1e6-466f-8d55-207b2e9c2289 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:48.780397 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:48.780826 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bdd91-c1e6-466f-8d55-207b2e9c2289 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:48.793589 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314bdd91-c1e6-466f-8d55-207b2e9c2289 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:48.799052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-314bdd91-c1e6-466f-8d55-207b2e9c2289 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:18:48.799052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:48.799052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:48.799052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:48.799052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:48.799052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:48.799052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:48.799052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:48.799052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:48.799052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:48.799052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:48.799052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:48.799052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:48.799052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:48.799052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:48.799052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:48.800126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:48.800126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:48.800126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:48.800126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:48.800126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:48.800126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:48.800126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:48.800126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:48.800126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:48.800126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:48.800126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:48.800126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:48.800126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:48.800126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:48.800126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:48.800126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:48.800936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:48.800936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:48.800936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:48.800936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:48.800936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:48.800936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:48.800936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:48.800936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:48.800936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:48.800936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:48.800936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:18:48.800936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:48.800936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 240/499] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Oct 4 16:18:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:48.801616 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314bdd91-c1e6-466f-8d55-207b2e9c2289 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:48.813760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223fc85-65fb-48ac-9c45-8670f789660d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:48.814375 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223fc85-65fb-48ac-9c45-8670f789660d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:48.814652 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223fc85-65fb-48ac-9c45-8670f789660d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:48.814923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223fc85-65fb-48ac-9c45-8670f789660d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:48.893385 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223fc85-65fb-48ac-9c45-8670f789660d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:48.895817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223fc85-65fb-48ac-9c45-8670f789660d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:48.901449 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314bdd91-c1e6-466f-8d55-207b2e9c2289 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:48.938382 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a7a83-1e5b-46ea-9328-460920c0cc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:48.939041 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a7a83-1e5b-46ea-9328-460920c0cc84 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:48.939295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a7a83-1e5b-46ea-9328-460920c0cc84 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:48.939576 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a7a83-1e5b-46ea-9328-460920c0cc84 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:48.946792 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a7a83-1e5b-46ea-9328-460920c0cc84 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:48.948305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a7a83-1e5b-46ea-9328-460920c0cc84 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:48.961696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-071a7a83-1e5b-46ea-9328-460920c0cc84 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 16:18:48.961696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:48.961696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:48.961696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:48.961696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:48.961696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:48.961696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:48.961696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:48.961696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:48.961696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:48.961696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:48.961696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:48.961696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:18:48.961696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:18:48.961696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:18:48.961696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:18:48.962603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:48.962603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:48.962603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:18:48.962603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:18:48.962603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:18:48.962603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:18:48.962603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:48.962603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:48.962603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:48.962603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:48.962603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:48.962603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:48.962603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:48.962603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:48.962603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:48.962603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:48.962603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:48.962603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:48.964014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:48.964014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:48.964014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:18:48.964014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:18:48.964014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:18:48.964014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:18:48.964014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:18:48.964014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:18:48.964014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 16:18:48.964014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:48.964014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 241/500] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:48.964014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199af02-48e1-4dab-bf17-60e887a447ed None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:48.964666 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199af02-48e1-4dab-bf17-60e887a447ed None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:48.964666 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199af02-48e1-4dab-bf17-60e887a447ed None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:48.967164 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 242/501] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:48.968752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199af02-48e1-4dab-bf17-60e887a447ed None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:49.003740 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:49.008148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 260/502] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:18:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 16:18:49.008982 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223fc85-65fb-48ac-9c45-8670f789660d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:49.019961 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:49.071619 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199af02-48e1-4dab-bf17-60e887a447ed None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:49.104648 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afee972-5ed7-4acc-8323-c9f53e2cece0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:49.105282 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afee972-5ed7-4acc-8323-c9f53e2cece0 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:49.105552 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afee972-5ed7-4acc-8323-c9f53e2cece0 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:49.105817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afee972-5ed7-4acc-8323-c9f53e2cece0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:49.109932 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223fc85-65fb-48ac-9c45-8670f789660d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:49.118635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afee972-5ed7-4acc-8323-c9f53e2cece0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:49.123800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-2afee972-5ed7-4acc-8323-c9f53e2cece0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:18:49.123800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:49.123800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:49.123800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:49.123800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:49.123800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:49.123800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:49.123800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:49.123800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:49.123800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:49.123800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:49.123800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:49.123800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:49.123800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:49.123800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:49.123800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:49.124842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:49.124842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:49.124842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:49.124842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:49.124842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:49.124842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:49.124842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:49.124842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:49.124842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:49.124842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:49.124842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:49.124842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:49.124842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:49.124842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:49.124842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:49.124842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:49.128012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:49.128012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:49.128012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:49.128012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:49.128012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:49.128012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:49.128012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:49.128012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:49.128012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:49.128012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:49.128012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:18:49.128012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:49.128012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 243/503] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Oct 4 16:18:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:49.128012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afee972-5ed7-4acc-8323-c9f53e2cece0 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:49.143745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39a3e8-9cac-4c34-bcd1-9735de67886c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:49.144287 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39a3e8-9cac-4c34-bcd1-9735de67886c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:49.144565 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39a3e8-9cac-4c34-bcd1-9735de67886c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:49.144826 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39a3e8-9cac-4c34-bcd1-9735de67886c None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:49.145474 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39a3e8-9cac-4c34-bcd1-9735de67886c None admin] RBAC: Adding query filter params (name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:49.145774 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39a3e8-9cac-4c34-bcd1-9735de67886c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:49.147178 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39a3e8-9cac-4c34-bcd1-9735de67886c None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:49.154906 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 261/504] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Oct 4 16:18:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:49.156133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1e86a-87f2-4ae8-ba18-5d0c158c3eab None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:49.156408 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1e86a-87f2-4ae8-ba18-5d0c158c3eab None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:49.156677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1e86a-87f2-4ae8-ba18-5d0c158c3eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:49.174322 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-39c1e86a-87f2-4ae8-ba18-5d0c158c3eab None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:49.175550 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-39c1e86a-87f2-4ae8-ba18-5d0c158c3eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:49.222499 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:49.229277 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afee972-5ed7-4acc-8323-c9f53e2cece0 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:49.237326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:49.242231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 262/505] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:49.243187 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1e86a-87f2-4ae8-ba18-5d0c158c3eab None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:49.281870 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16043baa-2722-41cd-a05c-ed22e2b094ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:49.282897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16043baa-2722-41cd-a05c-ed22e2b094ea None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:49.283379 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16043baa-2722-41cd-a05c-ed22e2b094ea None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:49.284378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16043baa-2722-41cd-a05c-ed22e2b094ea None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:49.285171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16043baa-2722-41cd-a05c-ed22e2b094ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:49.285678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16043baa-2722-41cd-a05c-ed22e2b094ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:49.288349 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16043baa-2722-41cd-a05c-ed22e2b094ea None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:49.323434 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 244/506] 10.222.0.55 () {56 vars in 1137 bytes} [Tue Oct 4 16:18:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:49.323434 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16043baa-2722-41cd-a05c-ed22e2b094ea None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:49.361731 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1e86a-87f2-4ae8-ba18-5d0c158c3eab None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:49.398889 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87aa0d9-f38f-4346-a676-e137b73ca28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:49.399476 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87aa0d9-f38f-4346-a676-e137b73ca28d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:49.399746 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87aa0d9-f38f-4346-a676-e137b73ca28d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:49.400010 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87aa0d9-f38f-4346-a676-e137b73ca28d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:49.410780 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87aa0d9-f38f-4346-a676-e137b73ca28d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:49.412454 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87aa0d9-f38f-4346-a676-e137b73ca28d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:49.421309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16043baa-2722-41cd-a05c-ed22e2b094ea None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:49.427889 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-d87aa0d9-f38f-4346-a676-e137b73ca28d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:49.427889 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:49.427889 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:49.427889 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:49.427889 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:49.427889 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:49.427889 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:49.427889 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:49.427889 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:49.427889 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:49.427889 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:49.427889 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:49.427889 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:18:49.427889 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:18:49.427889 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:18:49.427889 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:18:49.428782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:49.428782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:49.428782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:49.428782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:49.428782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:49.428782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:49.428782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:49.428782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:49.428782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:49.428782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:49.428782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:49.428782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:49.428782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:49.428782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:49.428782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:49.428782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:49.428782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:18:49.429784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:18:49.429784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:49.429784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:49.431446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 263/507] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:49.432357 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87aa0d9-f38f-4346-a676-e137b73ca28d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:49.459802 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124e80f-36f8-4c6a-9ed9-2d43b4998f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:49.460418 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124e80f-36f8-4c6a-9ed9-2d43b4998f20 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:49.460708 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124e80f-36f8-4c6a-9ed9-2d43b4998f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:49.460971 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124e80f-36f8-4c6a-9ed9-2d43b4998f20 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:49.461634 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124e80f-36f8-4c6a-9ed9-2d43b4998f20 None admin] RBAC: Adding query filter params (name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:49.461931 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124e80f-36f8-4c6a-9ed9-2d43b4998f20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:49.463333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124e80f-36f8-4c6a-9ed9-2d43b4998f20 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:49.471278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 245/508] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Oct 4 16:18:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:49.472064 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124e80f-36f8-4c6a-9ed9-2d43b4998f20 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:49.489478 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:49.497097 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:49.545640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87aa0d9-f38f-4346-a676-e137b73ca28d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:49.591649 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa399cd8-87e7-4013-aa7e-d6d6c3e26c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:49.592640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa399cd8-87e7-4013-aa7e-d6d6c3e26c88 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:49.593087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa399cd8-87e7-4013-aa7e-d6d6c3e26c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:49.593524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa399cd8-87e7-4013-aa7e-d6d6c3e26c88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:49.610260 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa399cd8-87e7-4013-aa7e-d6d6c3e26c88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:49.611945 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa399cd8-87e7-4013-aa7e-d6d6c3e26c88 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:49.618381 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124e80f-36f8-4c6a-9ed9-2d43b4998f20 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:49.627876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-fa399cd8-87e7-4013-aa7e-d6d6c3e26c88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:49.627876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:49.627876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:49.627876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:49.627876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:49.627876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:49.627876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:49.627876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:49.627876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:49.627876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:49.627876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:49.627876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:49.627876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:18:49.627876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:18:49.627876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:18:49.627876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:18:49.628953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:49.628953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:49.628953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:49.628953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:49.628953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:49.628953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:49.628953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:49.628953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:49.628953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:49.628953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:49.628953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:49.628953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:49.628953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:49.628953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:49.628953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:49.628953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:49.628953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:18:49.629799 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:18:49.629799 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:49.629799 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:49.629799 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 264/509] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:49.629799 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa399cd8-87e7-4013-aa7e-d6d6c3e26c88 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:49.662749 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd2f19-2cdf-4815-95cf-980974bec520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:49.663321 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd2f19-2cdf-4815-95cf-980974bec520 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:49.663596 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd2f19-2cdf-4815-95cf-980974bec520 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:49.663877 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd2f19-2cdf-4815-95cf-980974bec520 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:49.737538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa399cd8-87e7-4013-aa7e-d6d6c3e26c88 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:49.740093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:49.744951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd2f19-2cdf-4815-95cf-980974bec520 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:49.746808 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd2f19-2cdf-4815-95cf-980974bec520 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:49.768391 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:49.779330 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63964a2-1a69-4273-9954-3761f430abb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:49.779949 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63964a2-1a69-4273-9954-3761f430abb1 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:49.780214 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63964a2-1a69-4273-9954-3761f430abb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:49.780492 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63964a2-1a69-4273-9954-3761f430abb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:49.781146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63964a2-1a69-4273-9954-3761f430abb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:49.781442 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63964a2-1a69-4273-9954-3761f430abb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:49.782820 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63964a2-1a69-4273-9954-3761f430abb1 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:49.796130 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 265/510] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:49.797015 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63964a2-1a69-4273-9954-3761f430abb1 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:49.862492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 246/511] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:18:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:18:49.863415 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd2f19-2cdf-4815-95cf-980974bec520 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:49.906756 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63964a2-1a69-4273-9954-3761f430abb1 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:49.945471 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c85382-bffc-42b7-bdc9-8bfb1beff092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:49.946015 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c85382-bffc-42b7-bdc9-8bfb1beff092 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:49.946294 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c85382-bffc-42b7-bdc9-8bfb1beff092 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:49.946555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c85382-bffc-42b7-bdc9-8bfb1beff092 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:49.956836 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c85382-bffc-42b7-bdc9-8bfb1beff092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:49.958288 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c85382-bffc-42b7-bdc9-8bfb1beff092 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:49.968367 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd2f19-2cdf-4815-95cf-980974bec520 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:49.972784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-d5c85382-bffc-42b7-bdc9-8bfb1beff092 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:49.972784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:49.972784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:49.972784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:49.972784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:49.972784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:49.972784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:49.972784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:49.972784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:49.972784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:49.972784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:49.972784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:49.972784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:18:49.972784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:18:49.972784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:18:49.972784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:18:49.973699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:49.973699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:49.973699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:49.973699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:49.973699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:49.973699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:49.973699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:49.973699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:49.973699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:49.973699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:49.973699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:49.973699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:49.973699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:49.973699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:49.973699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:49.973699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:49.973699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:18:49.974591 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:18:49.974591 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:49.974591 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:49.974591 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 266/512] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:49.974802 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c85382-bffc-42b7-bdc9-8bfb1beff092 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:49.985203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:49.996908 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:50.003492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4d5e3-277d-4ec0-983d-2245c4a1d1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:50.004133 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4d5e3-277d-4ec0-983d-2245c4a1d1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:50.004409 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4d5e3-277d-4ec0-983d-2245c4a1d1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:50.004679 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4d5e3-277d-4ec0-983d-2245c4a1d1b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:50.015552 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4d5e3-277d-4ec0-983d-2245c4a1d1b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:50.017015 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4d5e3-277d-4ec0-983d-2245c4a1d1b0 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:50.031892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-4ed4d5e3-277d-4ec0-983d-2245c4a1d1b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:50.031892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:50.031892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:50.031892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:50.031892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:50.031892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:50.031892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:50.031892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:50.031892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:50.031892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:50.031892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:50.031892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:50.031892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:18:50.031892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:18:50.031892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:18:50.031892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:18:50.032835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:50.032835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:50.032835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:50.032835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:50.032835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:50.032835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:50.032835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:50.032835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:50.032835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:50.032835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:50.032835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:50.032835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:50.032835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:50.032835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:50.032835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:50.032835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:50.032835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:18:50.033690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:18:50.033690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:50.033690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:50.033690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 247/513] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:50.033915 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4d5e3-277d-4ec0-983d-2245c4a1d1b0 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:50.087146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c85382-bffc-42b7-bdc9-8bfb1beff092 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:50.121368 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66464c-5b54-4961-8b87-895dcff9ea02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:50.121974 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66464c-5b54-4961-8b87-895dcff9ea02 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:50.122283 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66464c-5b54-4961-8b87-895dcff9ea02 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:50.122551 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66464c-5b54-4961-8b87-895dcff9ea02 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:50.123245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66464c-5b54-4961-8b87-895dcff9ea02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:50.123531 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66464c-5b54-4961-8b87-895dcff9ea02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:50.124909 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66464c-5b54-4961-8b87-895dcff9ea02 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:50.136870 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 267/514] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:50.137705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66464c-5b54-4961-8b87-895dcff9ea02 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:50.138517 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4d5e3-277d-4ec0-983d-2245c4a1d1b0 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:50.173741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5c6c3-0cc4-4e86-8b3e-da106574de9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:50.174385 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5c6c3-0cc4-4e86-8b3e-da106574de9c None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:50.174658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5c6c3-0cc4-4e86-8b3e-da106574de9c None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:50.174944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5c6c3-0cc4-4e86-8b3e-da106574de9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:50.182572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5c6c3-0cc4-4e86-8b3e-da106574de9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:50.184227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5c6c3-0cc4-4e86-8b3e-da106574de9c None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:50.197256 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-fec5c6c3-0cc4-4e86-8b3e-da106574de9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:18:50.197256 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:50.197256 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:50.197256 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:50.197256 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:50.197256 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:50.197256 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:50.197256 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:50.197256 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:50.197256 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:50.197256 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:50.197256 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:50.197256 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:18:50.197256 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:18:50.197256 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:18:50.198311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:18:50.198311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:50.198311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:50.198311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:50.198311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:50.198311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:50.198311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:50.198311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:50.198311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:50.198311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:50.198311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:50.198311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:50.198311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:50.198311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:50.198311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:50.198311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:50.198311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:50.199414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:18:50.199414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:18:50.199414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:18:50.199414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:18:50.199414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:18:50.199414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:18:50.199414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:18:50.199414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:50.199414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 248/515] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:18:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:50.199414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5c6c3-0cc4-4e86-8b3e-da106574de9c None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:50.233593 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:50.236341 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:50.262542 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66464c-5b54-4961-8b87-895dcff9ea02 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:50.304779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cd306-9ef1-4c32-9967-a2cd633d1a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:50.305414 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cd306-9ef1-4c32-9967-a2cd633d1a86 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:50.305694 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cd306-9ef1-4c32-9967-a2cd633d1a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:50.305964 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cd306-9ef1-4c32-9967-a2cd633d1a86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:50.310404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5c6c3-0cc4-4e86-8b3e-da106574de9c None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:50.317592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cd306-9ef1-4c32-9967-a2cd633d1a86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:50.319382 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cd306-9ef1-4c32-9967-a2cd633d1a86 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:50.335174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-e53cd306-9ef1-4c32-9967-a2cd633d1a86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:50.335174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:50.335174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:50.335174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:50.335174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:50.335174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:50.335174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:50.335174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:50.335174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:50.335174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:50.335174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:50.335174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:50.335174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:18:50.335174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:18:50.335174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:18:50.335174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:18:50.338285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:50.338285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:50.338285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:50.338285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:50.338285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:50.338285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:50.338285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:50.338285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:50.338285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:50.338285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:50.338285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:50.338285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:50.338285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:50.338285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:50.338285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:50.338285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:50.338285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:18:50.339413 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:18:50.339413 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:50.339413 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:50.339413 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 268/516] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:50.339413 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cd306-9ef1-4c32-9967-a2cd633d1a86 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:50.352006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d5e36-7d7d-439b-a846-8e08dc6ea0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:50.352728 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d5e36-7d7d-439b-a846-8e08dc6ea0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:50.353001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d5e36-7d7d-439b-a846-8e08dc6ea0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:50.353264 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d5e36-7d7d-439b-a846-8e08dc6ea0e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:50.353906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d5e36-7d7d-439b-a846-8e08dc6ea0e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:50.354198 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d5e36-7d7d-439b-a846-8e08dc6ea0e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:50.355712 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d5e36-7d7d-439b-a846-8e08dc6ea0e7 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:50.368057 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 249/517] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:50.369038 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d5e36-7d7d-439b-a846-8e08dc6ea0e7 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:50.447452 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cd306-9ef1-4c32-9967-a2cd633d1a86 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:50.460995 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:50.473992 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d5e36-7d7d-439b-a846-8e08dc6ea0e7 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:50.475622 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:50.485724 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407260a-33cf-4880-9b6f-32b46ba08fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:50.486346 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407260a-33cf-4880-9b6f-32b46ba08fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:50.486620 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407260a-33cf-4880-9b6f-32b46ba08fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:50.486891 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407260a-33cf-4880-9b6f-32b46ba08fc7 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:50.487579 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407260a-33cf-4880-9b6f-32b46ba08fc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:50.487878 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407260a-33cf-4880-9b6f-32b46ba08fc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:50.489273 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407260a-33cf-4880-9b6f-32b46ba08fc7 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:50.503342 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 269/518] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:50.504469 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407260a-33cf-4880-9b6f-32b46ba08fc7 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:50.513775 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733bd25-806d-4d67-b4d5-e8ed6924642c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:50.514420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733bd25-806d-4d67-b4d5-e8ed6924642c None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:50.514694 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733bd25-806d-4d67-b4d5-e8ed6924642c None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:50.514965 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733bd25-806d-4d67-b4d5-e8ed6924642c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:50.522329 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733bd25-806d-4d67-b4d5-e8ed6924642c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:50.523830 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733bd25-806d-4d67-b4d5-e8ed6924642c None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:50.535911 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-5733bd25-806d-4d67-b4d5-e8ed6924642c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 16:18:50.535911 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:50.535911 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:50.535911 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:50.535911 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:50.535911 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:50.535911 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:50.535911 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:50.535911 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:50.535911 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:50.535911 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:50.535911 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:50.535911 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:18:50.535911 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:18:50.535911 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:18:50.535911 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:18:50.536873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:50.536873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:50.536873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:18:50.536873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:18:50.536873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:18:50.536873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:18:50.536873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:50.536873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:50.536873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:50.536873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:50.536873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:50.536873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:50.536873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:50.536873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:50.536873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:50.536873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:50.536873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:50.536873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:50.537809 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:50.537809 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:50.537809 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:18:50.537809 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:18:50.537809 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:18:50.537809 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:18:50.537809 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:18:50.537809 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:18:50.537809 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 16:18:50.537809 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:50.537809 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 250/519] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Oct 4 16:18:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:50.538378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733bd25-806d-4d67-b4d5-e8ed6924642c None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:50.613988 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407260a-33cf-4880-9b6f-32b46ba08fc7 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:50.654073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2c75c-fbc7-4ea2-830c-021d324c68e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:50.654941 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2c75c-fbc7-4ea2-830c-021d324c68e9 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:50.655435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733bd25-806d-4d67-b4d5-e8ed6924642c None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:50.655594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2c75c-fbc7-4ea2-830c-021d324c68e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:50.655867 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2c75c-fbc7-4ea2-830c-021d324c68e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:50.656930 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2c75c-fbc7-4ea2-830c-021d324c68e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:50.657394 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2c75c-fbc7-4ea2-830c-021d324c68e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:50.659743 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2c75c-fbc7-4ea2-830c-021d324c68e9 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:50.687725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 270/520] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:18:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:50.688879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2c75c-fbc7-4ea2-830c-021d324c68e9 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:50.690777 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3e47e-aa3f-437f-b986-47680388f581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:50.691445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3e47e-aa3f-437f-b986-47680388f581 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:50.691765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3e47e-aa3f-437f-b986-47680388f581 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:50.691980 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3e47e-aa3f-437f-b986-47680388f581 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:50.692644 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3e47e-aa3f-437f-b986-47680388f581 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:50.692945 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3e47e-aa3f-437f-b986-47680388f581 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:50.694340 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3e47e-aa3f-437f-b986-47680388f581 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:50.706668 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 251/521] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:50.707444 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3e47e-aa3f-437f-b986-47680388f581 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:50.719414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:50.749076 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:50.813204 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2c75c-fbc7-4ea2-830c-021d324c68e9 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:50.830143 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3e47e-aa3f-437f-b986-47680388f581 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:50.849218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774389e-a2be-4116-839a-a9ad89f4add8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:50.849885 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774389e-a2be-4116-839a-a9ad89f4add8 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:50.850160 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774389e-a2be-4116-839a-a9ad89f4add8 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:50.850429 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774389e-a2be-4116-839a-a9ad89f4add8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:50.857881 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774389e-a2be-4116-839a-a9ad89f4add8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:50.859358 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774389e-a2be-4116-839a-a9ad89f4add8 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:50.871133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-0774389e-a2be-4116-839a-a9ad89f4add8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 16:18:50.871133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:50.871133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:50.871133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:50.871133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:50.871133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:50.871133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:50.871133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:50.871133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:50.871133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:50.871133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:50.871133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:50.871133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:18:50.871133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:18:50.871133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:18:50.871133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:18:50.872585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:50.872585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:50.872585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:18:50.872585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:18:50.872585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:18:50.872585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:18:50.872585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:50.872585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:50.872585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:50.872585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:50.872585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:50.872585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:50.872585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:50.872585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:50.872585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:50.872585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:50.872585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:50.872585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:50.874100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:50.874100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:50.874100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:18:50.874100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:18:50.874100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:18:50.874100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:18:50.874100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:18:50.874100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:18:50.874100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 16:18:50.874100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:50.874100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 271/522] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:50.874100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774389e-a2be-4116-839a-a9ad89f4add8 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:50.886658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a4dbb-aea1-4cf6-94b0-4e0f1e5a7e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:50.887670 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a4dbb-aea1-4cf6-94b0-4e0f1e5a7e8b None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:50.888154 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a4dbb-aea1-4cf6-94b0-4e0f1e5a7e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:50.888643 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a4dbb-aea1-4cf6-94b0-4e0f1e5a7e8b None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:50.889837 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a4dbb-aea1-4cf6-94b0-4e0f1e5a7e8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:50.892568 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a4dbb-aea1-4cf6-94b0-4e0f1e5a7e8b None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:50.923806 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 252/523] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Oct 4 16:18:50 2022] POST /identity/v3/users => generated 247 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:18:50.926156 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a4dbb-aea1-4cf6-94b0-4e0f1e5a7e8b None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:51.016484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774389e-a2be-4116-839a-a9ad89f4add8 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:51.022504 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:51.031456 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:51.068000 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e73e3-2a1a-42c1-9255-cc9fce0af8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:51.068978 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e73e3-2a1a-42c1-9255-cc9fce0af8ff None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:51.069246 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e73e3-2a1a-42c1-9255-cc9fce0af8ff None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:51.069521 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e73e3-2a1a-42c1-9255-cc9fce0af8ff None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:51.070343 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e73e3-2a1a-42c1-9255-cc9fce0af8ff None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:51.070654 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e73e3-2a1a-42c1-9255-cc9fce0af8ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:51.072222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e73e3-2a1a-42c1-9255-cc9fce0af8ff None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:51.080188 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a4dbb-aea1-4cf6-94b0-4e0f1e5a7e8b None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:51.111988 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 272/524] 10.222.0.55 () {56 vars in 1139 bytes} [Tue Oct 4 16:18:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:51.112860 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e73e3-2a1a-42c1-9255-cc9fce0af8ff None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:51.123131 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22936325-5ae0-4f4e-8dbc-5e0f48c24c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:51.124100 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22936325-5ae0-4f4e-8dbc-5e0f48c24c72 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:51.124100 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22936325-5ae0-4f4e-8dbc-5e0f48c24c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:51.124287 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22936325-5ae0-4f4e-8dbc-5e0f48c24c72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:51.125034 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22936325-5ae0-4f4e-8dbc-5e0f48c24c72 None admin] RBAC: Adding query filter params (role.id=2165a726b4034e1584166027f2361b5f, scope.project.id=e480e782c4fa403a913ca7179db0843b, user.id=6cdee0584fe045028a44c385d032d2c7) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:51.125339 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22936325-5ae0-4f4e-8dbc-5e0f48c24c72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:51.126837 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22936325-5ae0-4f4e-8dbc-5e0f48c24c72 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:51.133340 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 253/525] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:18:50 2022] GET /identity/v3/role_assignments?user.id=6cdee0584fe045028a44c385d032d2c7&scope.project.id=e480e782c4fa403a913ca7179db0843b&role.id=2165a726b4034e1584166027f2361b5f => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:51.134125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22936325-5ae0-4f4e-8dbc-5e0f48c24c72 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:51.242077 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e73e3-2a1a-42c1-9255-cc9fce0af8ff None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:51.267895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22936325-5ae0-4f4e-8dbc-5e0f48c24c72 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:51.286392 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532ee95-6bbc-4f3c-ac8b-381508e4b3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:51.287085 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532ee95-6bbc-4f3c-ac8b-381508e4b3f5 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:51.287363 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532ee95-6bbc-4f3c-ac8b-381508e4b3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:51.287627 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532ee95-6bbc-4f3c-ac8b-381508e4b3f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:51.296580 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532ee95-6bbc-4f3c-ac8b-381508e4b3f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:51.300286 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532ee95-6bbc-4f3c-ac8b-381508e4b3f5 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:51.302253 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:51.312563 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32530ee3-65a0-47e9-b357-68546e8f2e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:51.313550 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32530ee3-65a0-47e9-b357-68546e8f2e04 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:51.314047 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32530ee3-65a0-47e9-b357-68546e8f2e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:51.314510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32530ee3-65a0-47e9-b357-68546e8f2e04 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:51.315567 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32530ee3-65a0-47e9-b357-68546e8f2e04 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:51.316080 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32530ee3-65a0-47e9-b357-68546e8f2e04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:51.317741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32530ee3-65a0-47e9-b357-68546e8f2e04 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:51.319318 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-f532ee95-6bbc-4f3c-ac8b-381508e4b3f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:18:51.319318 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:51.319318 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:51.319318 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:51.319318 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:51.319318 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:51.319318 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:51.319318 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:51.319318 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:51.319318 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:51.319318 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:51.319318 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:51.319318 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:18:51.319318 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:18:51.319318 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:18:51.320163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:18:51.320163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:51.320163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:51.320163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:51.320163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:51.320163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:51.320163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:51.320163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:51.320163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:51.320163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:51.320163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:51.320163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:51.320163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:51.320163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:51.320163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:51.320163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:51.320163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:51.321092 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:18:51.321092 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:18:51.321092 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:18:51.321092 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:18:51.321092 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:18:51.321092 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:18:51.321092 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:18:51.321092 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:51.322383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 273/526] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:18:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:51.323335 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532ee95-6bbc-4f3c-ac8b-381508e4b3f5 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:51.341304 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 254/527] 10.222.0.55 () {56 vars in 1137 bytes} [Tue Oct 4 16:18:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:51.342494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32530ee3-65a0-47e9-b357-68546e8f2e04 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:51.367533 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:51.448519 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532ee95-6bbc-4f3c-ac8b-381508e4b3f5 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:51.452208 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32530ee3-65a0-47e9-b357-68546e8f2e04 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:51.487469 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6895a-0fe4-436d-9785-b8ad56a9056e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:51.488192 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6895a-0fe4-436d-9785-b8ad56a9056e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:51.488473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6895a-0fe4-436d-9785-b8ad56a9056e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:51.488745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6895a-0fe4-436d-9785-b8ad56a9056e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:51.498861 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fa3b5-f9ab-4d5b-b542-8fa3069c947a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:51.500590 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fa3b5-f9ab-4d5b-b542-8fa3069c947a None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:51.501070 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fa3b5-f9ab-4d5b-b542-8fa3069c947a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:51.501535 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fa3b5-f9ab-4d5b-b542-8fa3069c947a None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:51.502927 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fa3b5-f9ab-4d5b-b542-8fa3069c947a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:51.503471 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fa3b5-f9ab-4d5b-b542-8fa3069c947a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:51.505944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fa3b5-f9ab-4d5b-b542-8fa3069c947a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:51.531537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 255/528] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:18:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:51.532423 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fa3b5-f9ab-4d5b-b542-8fa3069c947a None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:51.591211 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6895a-0fe4-436d-9785-b8ad56a9056e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:51.593212 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6895a-0fe4-436d-9785-b8ad56a9056e None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:51.594190 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:51.636092 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:51.676024 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fa3b5-f9ab-4d5b-b542-8fa3069c947a None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:51.733737 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e65668-23b4-49ff-88a4-10098ef660e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:51.734973 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e65668-23b4-49ff-88a4-10098ef660e4 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:51.735597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e65668-23b4-49ff-88a4-10098ef660e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:51.736216 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e65668-23b4-49ff-88a4-10098ef660e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:51.743090 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 274/529] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:18:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:18:51.745862 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6895a-0fe4-436d-9785-b8ad56a9056e None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:51.819320 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e65668-23b4-49ff-88a4-10098ef660e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:51.821965 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e65668-23b4-49ff-88a4-10098ef660e4 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:51.877521 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:51.900437 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6895a-0fe4-436d-9785-b8ad56a9056e None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:51.940020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:51.945328 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 256/530] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:18:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:18:51.946441 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e65668-23b4-49ff-88a4-10098ef660e4 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:51.953966 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c693b6-fbdb-4665-b6fd-e7cd88ffed56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:51.954745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c693b6-fbdb-4665-b6fd-e7cd88ffed56 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:51.955153 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c693b6-fbdb-4665-b6fd-e7cd88ffed56 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:51.955522 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c693b6-fbdb-4665-b6fd-e7cd88ffed56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:51.956359 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c693b6-fbdb-4665-b6fd-e7cd88ffed56 None admin] RBAC: Adding query filter params (role.id=2165a726b4034e1584166027f2361b5f, scope.project.id=e480e782c4fa403a913ca7179db0843b, user.id=74b3e45a14bd4b539974e9e5e278ee62) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:51.956767 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c693b6-fbdb-4665-b6fd-e7cd88ffed56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:51.958416 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c693b6-fbdb-4665-b6fd-e7cd88ffed56 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:51.965007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 275/531] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:18:51 2022] GET /identity/v3/role_assignments?user.id=74b3e45a14bd4b539974e9e5e278ee62&scope.project.id=e480e782c4fa403a913ca7179db0843b&role.id=2165a726b4034e1584166027f2361b5f => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:51.966126 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c693b6-fbdb-4665-b6fd-e7cd88ffed56 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:52.069975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e65668-23b4-49ff-88a4-10098ef660e4 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:52.088661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c693b6-fbdb-4665-b6fd-e7cd88ffed56 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:52.112548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673480e8-cf29-4d77-9679-615dbb2a52cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:52.113699 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673480e8-cf29-4d77-9679-615dbb2a52cb None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:52.114224 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673480e8-cf29-4d77-9679-615dbb2a52cb None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:52.114694 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673480e8-cf29-4d77-9679-615dbb2a52cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:52.127590 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673480e8-cf29-4d77-9679-615dbb2a52cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:52.129631 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673480e8-cf29-4d77-9679-615dbb2a52cb None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:52.136488 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e91d2-918e-498c-a3b0-0c1be15b447b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:52.137146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e91d2-918e-498c-a3b0-0c1be15b447b None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:52.137425 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e91d2-918e-498c-a3b0-0c1be15b447b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:52.137703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e91d2-918e-498c-a3b0-0c1be15b447b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:52.139333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:52.150926 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-673480e8-cf29-4d77-9679-615dbb2a52cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:52.150926 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:52.150926 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:52.150926 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:52.150926 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:52.150926 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:52.150926 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:52.150926 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:52.150926 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:52.150926 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:52.150926 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:52.150926 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:52.150926 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:18:52.150926 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:18:52.150926 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:18:52.150926 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:18:52.152035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:52.152035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:52.152035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:52.152035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:52.152035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:52.152035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:52.152035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:52.152035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:52.152035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:52.152035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:52.152035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:52.152035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:52.152035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:52.152035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:52.152035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:52.152035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:52.152035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:18:52.152915 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:18:52.152915 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:52.152915 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:52.153081 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e91d2-918e-498c-a3b0-0c1be15b447b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:52.153081 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e91d2-918e-498c-a3b0-0c1be15b447b None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:52.155278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 257/532] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:52.167572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673480e8-cf29-4d77-9679-615dbb2a52cb None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:52.168916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-cc5e91d2-918e-498c-a3b0-0c1be15b447b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:52.168916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:52.168916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:52.168916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:52.168916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:52.168916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:52.168916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:52.168916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:52.168916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:52.168916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:52.168916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:52.168916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:52.168916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:18:52.168916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:18:52.168916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:18:52.168916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:18:52.170207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:52.170207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:52.170207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:52.170207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:52.170207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:52.170207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:52.170207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:52.170207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:52.170207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:52.170207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:52.170207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:52.170207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:52.170207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:52.170207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:52.170207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:52.170207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:52.170207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:18:52.171085 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:18:52.171085 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:52.171085 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:52.171085 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 276/533] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:52.176671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e91d2-918e-498c-a3b0-0c1be15b447b None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:52.236232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:52.301379 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e91d2-918e-498c-a3b0-0c1be15b447b None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:52.302197 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673480e8-cf29-4d77-9679-615dbb2a52cb None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:52.340233 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f024f1-123a-4843-9f81-fea77841a1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:52.340754 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f024f1-123a-4843-9f81-fea77841a1b6 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:52.341024 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f024f1-123a-4843-9f81-fea77841a1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:52.341279 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f024f1-123a-4843-9f81-fea77841a1b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:52.342215 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f024f1-123a-4843-9f81-fea77841a1b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:52.342511 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f024f1-123a-4843-9f81-fea77841a1b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:52.344492 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f024f1-123a-4843-9f81-fea77841a1b6 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:52.362295 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 277/534] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:52.367693 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f024f1-123a-4843-9f81-fea77841a1b6 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:52.385835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1608877-0791-419c-912e-ae36170280d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:52.387258 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1608877-0791-419c-912e-ae36170280d0 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:52.387914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1608877-0791-419c-912e-ae36170280d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:52.388539 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1608877-0791-419c-912e-ae36170280d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:52.390402 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1608877-0791-419c-912e-ae36170280d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:52.390402 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1608877-0791-419c-912e-ae36170280d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:52.391938 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1608877-0791-419c-912e-ae36170280d0 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:52.411030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 258/535] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:52.416980 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1608877-0791-419c-912e-ae36170280d0 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:52.479562 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:52.531566 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1608877-0791-419c-912e-ae36170280d0 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:52.565636 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f024f1-123a-4843-9f81-fea77841a1b6 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:52.567529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:52.592803 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c5c55-9b2b-416f-83f4-0e3eb14f7d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:52.594271 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c5c55-9b2b-416f-83f4-0e3eb14f7d79 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:52.595141 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c5c55-9b2b-416f-83f4-0e3eb14f7d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:52.595903 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c5c55-9b2b-416f-83f4-0e3eb14f7d79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:52.608653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c5c55-9b2b-416f-83f4-0e3eb14f7d79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:52.611720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c5c55-9b2b-416f-83f4-0e3eb14f7d79 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:52.633426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-8a2c5c55-9b2b-416f-83f4-0e3eb14f7d79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:18:52.633426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:52.633426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:52.633426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:52.633426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:52.633426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:52.633426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:52.633426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:52.633426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:52.633426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:52.633426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:52.633426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:52.633426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:18:52.633426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:18:52.633426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:18:52.634949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:18:52.634949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:52.634949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:52.634949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:52.634949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:52.634949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:52.634949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:52.634949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:52.634949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:52.634949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:52.634949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:52.634949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:52.634949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:52.634949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:52.634949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:52.634949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:52.634949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:52.636677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:18:52.636677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:18:52.636677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:18:52.636677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:18:52.636677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:18:52.636677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:18:52.636677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:18:52.636677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:52.647024 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030627d2-6bfd-4abb-82af-11eb01b82a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:52.647024 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030627d2-6bfd-4abb-82af-11eb01b82a3a None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:52.647024 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030627d2-6bfd-4abb-82af-11eb01b82a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:52.647024 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030627d2-6bfd-4abb-82af-11eb01b82a3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:52.647896 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 259/536] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:18:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:52.651205 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c5c55-9b2b-416f-83f4-0e3eb14f7d79 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:52.666198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030627d2-6bfd-4abb-82af-11eb01b82a3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:52.668710 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030627d2-6bfd-4abb-82af-11eb01b82a3a None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:52.697330 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-030627d2-6bfd-4abb-82af-11eb01b82a3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:18:52.697330 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:52.697330 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:52.697330 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:52.697330 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:52.697330 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:52.697330 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:52.697330 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:52.697330 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:52.697330 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:52.697330 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:52.697330 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:52.697330 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:18:52.697330 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:18:52.697330 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:18:52.698244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:18:52.698244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:52.698244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:52.698244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:52.698244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:52.698244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:52.698244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:52.698244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:52.698244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:52.698244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:52.698244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:52.698244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:52.698244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:52.698244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:52.698244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:52.698244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:52.698244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:52.699204 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:18:52.699204 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:18:52.699204 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:18:52.699204 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:18:52.699204 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:18:52.699204 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:18:52.699204 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:18:52.699204 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:52.705956 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 278/537] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:18:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:52.711492 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030627d2-6bfd-4abb-82af-11eb01b82a3a None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:52.855244 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c5c55-9b2b-416f-83f4-0e3eb14f7d79 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:52.895469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:52.927557 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030627d2-6bfd-4abb-82af-11eb01b82a3a None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:52.933830 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b1c51-16d8-4d3c-9346-39754cef47fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:52.934525 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b1c51-16d8-4d3c-9346-39754cef47fc None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:52.934804 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b1c51-16d8-4d3c-9346-39754cef47fc None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:52.935110 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b1c51-16d8-4d3c-9346-39754cef47fc None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:52.935820 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b1c51-16d8-4d3c-9346-39754cef47fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:52.936265 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b1c51-16d8-4d3c-9346-39754cef47fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:52.937741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b1c51-16d8-4d3c-9346-39754cef47fc None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:52.973423 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 260/538] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:18:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:52.979776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b1c51-16d8-4d3c-9346-39754cef47fc None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:53.024788 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9a10d-626a-43f0-a559-85b25f27cb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:53.025421 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9a10d-626a-43f0-a559-85b25f27cb31 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:53.025700 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9a10d-626a-43f0-a559-85b25f27cb31 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:53.025973 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9a10d-626a-43f0-a559-85b25f27cb31 None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:53.026686 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9a10d-626a-43f0-a559-85b25f27cb31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:53.027094 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9a10d-626a-43f0-a559-85b25f27cb31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:53.028554 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9a10d-626a-43f0-a559-85b25f27cb31 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:53.057257 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 279/539] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:18:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:53.065491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9a10d-626a-43f0-a559-85b25f27cb31 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:53.110570 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:53.214921 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b1c51-16d8-4d3c-9346-39754cef47fc None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:53.292855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16908646-8445-41dc-87db-ce0322f0e70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:53.293491 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16908646-8445-41dc-87db-ce0322f0e70e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:53.293769 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16908646-8445-41dc-87db-ce0322f0e70e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:53.294039 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16908646-8445-41dc-87db-ce0322f0e70e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:53.295180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16908646-8445-41dc-87db-ce0322f0e70e None admin] RBAC: Adding query filter params (role.id=2165a726b4034e1584166027f2361b5f, scope.project.id=e480e782c4fa403a913ca7179db0843b, user.id=d6ae980afbfd49dea9bbb0adc02b9031) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:53.295492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16908646-8445-41dc-87db-ce0322f0e70e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:53.296988 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16908646-8445-41dc-87db-ce0322f0e70e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:53.308577 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9a10d-626a-43f0-a559-85b25f27cb31 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:53.310863 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 261/540] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:18:52 2022] GET /identity/v3/role_assignments?user.id=d6ae980afbfd49dea9bbb0adc02b9031&scope.project.id=e480e782c4fa403a913ca7179db0843b&role.id=2165a726b4034e1584166027f2361b5f => generated 259 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:53.376210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd6aca-b720-4f5a-89ea-68158841cb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:53.376761 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd6aca-b720-4f5a-89ea-68158841cb4a None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:53.377034 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd6aca-b720-4f5a-89ea-68158841cb4a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:53.377301 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd6aca-b720-4f5a-89ea-68158841cb4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:53.378048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd6aca-b720-4f5a-89ea-68158841cb4a None admin] RBAC: Adding query filter params (role.id=2165a726b4034e1584166027f2361b5f, scope.project.id=e480e782c4fa403a913ca7179db0843b, user.id=7d717575c1d8415fbd09d61d1cbef2d0) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:53.378349 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd6aca-b720-4f5a-89ea-68158841cb4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:53.379866 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd6aca-b720-4f5a-89ea-68158841cb4a None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:53.396481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 280/541] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:18:53 2022] GET /identity/v3/role_assignments?user.id=7d717575c1d8415fbd09d61d1cbef2d0&scope.project.id=e480e782c4fa403a913ca7179db0843b&role.id=2165a726b4034e1584166027f2361b5f => generated 259 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:53.418941 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32611141-12cd-450d-b527-cf2820b6ed4c None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:53.419281 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32611141-12cd-450d-b527-cf2820b6ed4c None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:53.419522 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32611141-12cd-450d-b527-cf2820b6ed4c None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:53.421280 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 262/542] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:18:53.428134 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cefdd-d585-46c5-905e-d60bd6759779 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:53.428464 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cefdd-d585-46c5-905e-d60bd6759779 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:53.428689 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cefdd-d585-46c5-905e-d60bd6759779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:53.450875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-918cefdd-d585-46c5-905e-d60bd6759779 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:53.452214 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-918cefdd-d585-46c5-905e-d60bd6759779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:53.549024 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 281/543] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 16:18:53.941916 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32611141-12cd-450d-b527-cf2820b6ed4c None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:54.001217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:54.001916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92318d-0a35-420b-aff7-99fda0c6cacd None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:54.002352 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92318d-0a35-420b-aff7-99fda0c6cacd None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:54.002622 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92318d-0a35-420b-aff7-99fda0c6cacd None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:54.004730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 282/544] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:54.010227 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52565341-f8b6-4b24-b13d-a3c2d8acb4fb None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:54.010580 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52565341-f8b6-4b24-b13d-a3c2d8acb4fb None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:54.010937 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52565341-f8b6-4b24-b13d-a3c2d8acb4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:54.031280 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-52565341-f8b6-4b24-b13d-a3c2d8acb4fb None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:54.032649 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-52565341-f8b6-4b24-b13d-a3c2d8acb4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:54.046680 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:54.119504 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32611141-12cd-450d-b527-cf2820b6ed4c None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:54.170066 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d178ad-212f-4910-b34b-c8826c2145bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:54.170711 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d178ad-212f-4910-b34b-c8826c2145bd None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:54.170999 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d178ad-212f-4910-b34b-c8826c2145bd None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:54.171343 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d178ad-212f-4910-b34b-c8826c2145bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:54.182619 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d178ad-212f-4910-b34b-c8826c2145bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:54.185700 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 283/545] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 16:18:54.188030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-92d178ad-212f-4910-b34b-c8826c2145bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:18:54.188030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:54.188030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:54.188030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:54.188030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:54.188030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:54.188030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:54.188030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:54.188030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:54.188030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:54.188030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:54.188030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:54.188030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:54.188030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:54.188030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:54.188030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:54.188908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:54.188908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:54.188908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:54.188908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:54.188908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:54.188908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:54.188908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:54.188908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:54.188908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:54.188908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:54.188908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:54.188908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:54.188908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:54.188908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:54.188908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:54.188908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:54.189688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:54.189688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:54.189688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:54.189688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:54.189688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:54.189688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:54.189688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:54.189688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:54.189688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:54.189688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:54.189688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:18:54.189688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:54.189688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 263/546] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Oct 4 16:18:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:54.195466 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52565341-f8b6-4b24-b13d-a3c2d8acb4fb None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:54.348945 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52565341-f8b6-4b24-b13d-a3c2d8acb4fb None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:54.402654 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b3bb8-871d-47b5-b3e0-06c6c98f1b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:54.403693 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b3bb8-871d-47b5-b3e0-06c6c98f1b6d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:54.404219 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b3bb8-871d-47b5-b3e0-06c6c98f1b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:54.404694 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b3bb8-871d-47b5-b3e0-06c6c98f1b6d None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:54.405856 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b3bb8-871d-47b5-b3e0-06c6c98f1b6d None admin] RBAC: Adding query filter params (name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:54.406320 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b3bb8-871d-47b5-b3e0-06c6c98f1b6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:54.408604 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b3bb8-871d-47b5-b3e0-06c6c98f1b6d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:54.433127 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 284/547] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Oct 4 16:18:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:54.438703 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d178ad-212f-4910-b34b-c8826c2145bd None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:54.589487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b3bb8-871d-47b5-b3e0-06c6c98f1b6d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:54.594540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d178ad-212f-4910-b34b-c8826c2145bd None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:54.596204 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:54.615775 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:54.634260 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbe2fa-f415-4dda-a4ad-ceda4ff9ae42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:54.634913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbe2fa-f415-4dda-a4ad-ceda4ff9ae42 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:54.635222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbe2fa-f415-4dda-a4ad-ceda4ff9ae42 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:54.635500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbe2fa-f415-4dda-a4ad-ceda4ff9ae42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:54.646720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbe2fa-f415-4dda-a4ad-ceda4ff9ae42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:54.648389 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbe2fa-f415-4dda-a4ad-ceda4ff9ae42 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:54.671012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-d6cbe2fa-f415-4dda-a4ad-ceda4ff9ae42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:54.671012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:54.671012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:54.671012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:54.671012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:54.671012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:54.671012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:54.671012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:54.671012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:54.671012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:54.671012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:54.671012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:54.671012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:18:54.671012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:18:54.671012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:18:54.671012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:18:54.672013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:54.672013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:54.672013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:54.672013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:54.672013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:54.672013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:54.672013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:54.672013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:54.672013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:54.672013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:54.672013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:54.672013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:54.672013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:54.672013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:54.672013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:54.672013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:54.672013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:18:54.673015 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:18:54.673015 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:54.673015 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:54.673015 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 264/548] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:54.674206 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbe2fa-f415-4dda-a4ad-ceda4ff9ae42 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:54.800699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b3bb8-871d-47b5-b3e0-06c6c98f1b6d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:54.856246 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbe2fa-f415-4dda-a4ad-ceda4ff9ae42 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:54.864220 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d3ee8-eed3-4b43-8a5b-bbcbcab0a99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:54.865230 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d3ee8-eed3-4b43-8a5b-bbcbcab0a99a None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:54.865716 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d3ee8-eed3-4b43-8a5b-bbcbcab0a99a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:54.866182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d3ee8-eed3-4b43-8a5b-bbcbcab0a99a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:54.878667 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d3ee8-eed3-4b43-8a5b-bbcbcab0a99a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:54.885637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-e72d3ee8-eed3-4b43-8a5b-bbcbcab0a99a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:18:54.885637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:54.885637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:54.885637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:54.885637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:54.885637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:54.885637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:54.885637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:54.885637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:54.885637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:54.885637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:54.885637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:54.885637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:54.885637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:54.885637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:54.885637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:54.887182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:54.887182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:54.887182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:54.887182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:54.887182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:54.887182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:54.887182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:54.887182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:54.887182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:54.887182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:54.887182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:54.887182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:54.887182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:54.887182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:54.887182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:54.887182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:54.888151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:54.888151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:54.888151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:54.888151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:54.888151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:54.888151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:54.888151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:54.888151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:54.888151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:54.888151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:54.888151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:18:54.888151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:54.891660 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 285/549] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Oct 4 16:18:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:54.893245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d593a-0b94-4cb9-99fa-8dc78015692b None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:54.893732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d593a-0b94-4cb9-99fa-8dc78015692b None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:54.894203 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d593a-0b94-4cb9-99fa-8dc78015692b None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:54.899865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 286/550] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:54.900360 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a63e92-60c5-4c2a-a2d4-3e24dc714adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:54.900992 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a63e92-60c5-4c2a-a2d4-3e24dc714adc None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:54.901320 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a63e92-60c5-4c2a-a2d4-3e24dc714adc None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:54.901596 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a63e92-60c5-4c2a-a2d4-3e24dc714adc None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:54.901960 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d593a-0b94-4cb9-99fa-8dc78015692b None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:54.902347 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a63e92-60c5-4c2a-a2d4-3e24dc714adc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:54.902651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a63e92-60c5-4c2a-a2d4-3e24dc714adc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:54.904193 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a63e92-60c5-4c2a-a2d4-3e24dc714adc None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:54.917405 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 265/551] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:54.918850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd06dc3-2232-40ed-826e-8574e56ee448 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:54.919162 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd06dc3-2232-40ed-826e-8574e56ee448 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:54.919435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd06dc3-2232-40ed-826e-8574e56ee448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:54.939267 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-1fd06dc3-2232-40ed-826e-8574e56ee448 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:54.940583 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-1fd06dc3-2232-40ed-826e-8574e56ee448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:54.950878 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:54.982054 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:55.020196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d593a-0b94-4cb9-99fa-8dc78015692b None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:55.020582 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 266/552] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:55.021837 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd06dc3-2232-40ed-826e-8574e56ee448 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:55.082311 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf847b-8ecd-4876-aec7-94c1e0dcb976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:55.082932 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf847b-8ecd-4876-aec7-94c1e0dcb976 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:55.083232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf847b-8ecd-4876-aec7-94c1e0dcb976 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:55.083502 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf847b-8ecd-4876-aec7-94c1e0dcb976 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:55.084174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf847b-8ecd-4876-aec7-94c1e0dcb976 None admin] RBAC: Adding query filter params (name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:55.084475 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf847b-8ecd-4876-aec7-94c1e0dcb976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:55.085855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf847b-8ecd-4876-aec7-94c1e0dcb976 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:55.104725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 287/553] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Oct 4 16:18:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:55.110478 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf847b-8ecd-4876-aec7-94c1e0dcb976 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:55.206257 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd06dc3-2232-40ed-826e-8574e56ee448 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:55.267936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31514e31-7dea-4252-ad87-9299f10230aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:55.268630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31514e31-7dea-4252-ad87-9299f10230aa None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:55.268915 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31514e31-7dea-4252-ad87-9299f10230aa None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:55.269183 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31514e31-7dea-4252-ad87-9299f10230aa None admin] PATH_INFO: `/v3/users/swift` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:55.279716 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31514e31-7dea-4252-ad87-9299f10230aa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:55.281186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31514e31-7dea-4252-ad87-9299f10230aa None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:55.290869 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf847b-8ecd-4876-aec7-94c1e0dcb976 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:55.305903 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-31514e31-7dea-4252-ad87-9299f10230aa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 16:18:55.305903 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:55.305903 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:55.305903 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:55.305903 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:55.305903 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:55.305903 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:55.305903 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:55.305903 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:55.305903 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:55.305903 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:55.305903 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:55.305903 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:18:55.305903 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:18:55.305903 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:18:55.305903 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:18:55.306892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:55.306892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:55.306892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:18:55.306892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:18:55.306892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:18:55.306892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:18:55.306892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:55.306892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:55.306892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:55.306892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:55.306892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:55.306892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:55.306892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:55.306892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:55.306892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:55.306892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:55.306892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:55.306892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:55.307855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:55.307855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:55.307855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:18:55.307855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:18:55.307855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:18:55.307855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:18:55.307855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:18:55.307855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:18:55.307855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 16:18:55.307855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:55.307855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 267/554] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:18:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:55.313981 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31514e31-7dea-4252-ad87-9299f10230aa None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:55.320478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:55.352407 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:55.360157 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57009f5-9f41-4153-92ab-6fa6e8b07a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:55.360808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57009f5-9f41-4153-92ab-6fa6e8b07a18 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:55.361232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57009f5-9f41-4153-92ab-6fa6e8b07a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:55.361565 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57009f5-9f41-4153-92ab-6fa6e8b07a18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:55.372823 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57009f5-9f41-4153-92ab-6fa6e8b07a18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:55.374421 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57009f5-9f41-4153-92ab-6fa6e8b07a18 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:55.391222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-e57009f5-9f41-4153-92ab-6fa6e8b07a18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:55.391222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:55.391222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:55.391222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:55.391222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:55.391222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:55.391222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:55.391222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:55.391222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:55.391222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:55.391222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:55.391222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:55.391222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:18:55.391222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:18:55.391222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:18:55.391222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:18:55.392481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:55.392481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:55.392481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:55.392481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:55.392481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:55.392481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:55.392481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:55.392481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:55.392481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:55.392481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:55.392481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:55.392481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:55.392481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:55.392481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:55.392481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:55.392481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:55.392481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:18:55.393562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:18:55.393562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:55.393562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:55.394954 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 288/555] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:55.395940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57009f5-9f41-4153-92ab-6fa6e8b07a18 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:55.457147 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31514e31-7dea-4252-ad87-9299f10230aa None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:55.503453 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57009f5-9f41-4153-92ab-6fa6e8b07a18 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:55.509121 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280661f-bcc5-4b84-af66-910cacb800ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:55.509977 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280661f-bcc5-4b84-af66-910cacb800ba None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:55.510451 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280661f-bcc5-4b84-af66-910cacb800ba None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:55.510872 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280661f-bcc5-4b84-af66-910cacb800ba None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:55.511876 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280661f-bcc5-4b84-af66-910cacb800ba None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:55.512883 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280661f-bcc5-4b84-af66-910cacb800ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:55.515009 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280661f-bcc5-4b84-af66-910cacb800ba None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:55.540952 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 268/556] 10.222.0.55 () {56 vars in 1135 bytes} [Tue Oct 4 16:18:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:55.542081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280661f-bcc5-4b84-af66-910cacb800ba None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:55.544031 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d833897-146d-4bdc-984e-5f6dd856f1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:55.545137 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d833897-146d-4bdc-984e-5f6dd856f1fd None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:55.545847 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d833897-146d-4bdc-984e-5f6dd856f1fd None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:55.546256 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d833897-146d-4bdc-984e-5f6dd856f1fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:55.558779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d833897-146d-4bdc-984e-5f6dd856f1fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:55.564500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-1d833897-146d-4bdc-984e-5f6dd856f1fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:18:55.564500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:55.564500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:55.564500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:55.564500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:55.564500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:55.564500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:55.564500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:55.564500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:55.564500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:55.564500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:55.564500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:55.564500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:55.564500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:55.564500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:55.564500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:55.566121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:55.566121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:55.566121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:55.566121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:55.566121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:55.566121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:55.566121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:55.566121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:55.566121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:55.566121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:55.566121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:55.566121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:55.566121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:55.566121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:55.566121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:55.566121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:55.567272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:55.567272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:55.567272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:55.567272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:55.567272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:55.567272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:55.567272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:55.567272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:55.567272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:55.567272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:55.567272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:18:55.567272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:55.574582 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 289/557] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Oct 4 16:18:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:55.574582 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d833897-146d-4bdc-984e-5f6dd856f1fd None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:55.633924 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:55.648612 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:55.720135 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280661f-bcc5-4b84-af66-910cacb800ba None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:55.721409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d833897-146d-4bdc-984e-5f6dd856f1fd None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:55.780094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19a3e0-7b18-46bb-a84c-f1970f69cbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:55.781053 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19a3e0-7b18-46bb-a84c-f1970f69cbba None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:55.781515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19a3e0-7b18-46bb-a84c-f1970f69cbba None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:55.781914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19a3e0-7b18-46bb-a84c-f1970f69cbba None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:55.782702 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19a3e0-7b18-46bb-a84c-f1970f69cbba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:55.783169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19a3e0-7b18-46bb-a84c-f1970f69cbba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:55.784245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f8bed-3908-42d1-9191-8611bf2e7bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:55.784866 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19a3e0-7b18-46bb-a84c-f1970f69cbba None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:55.785258 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f8bed-3908-42d1-9191-8611bf2e7bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:55.785685 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f8bed-3908-42d1-9191-8611bf2e7bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:55.786102 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f8bed-3908-42d1-9191-8611bf2e7bc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:55.803145 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 269/558] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:55.804929 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19a3e0-7b18-46bb-a84c-f1970f69cbba None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:55.875083 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f8bed-3908-42d1-9191-8611bf2e7bc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:55.876815 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f8bed-3908-42d1-9191-8611bf2e7bc3 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:55.930491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:55.934382 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19a3e0-7b18-46bb-a84c-f1970f69cbba None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:55.963745 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:55.980425 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947f724-ac82-495e-afbf-c1c80af8ee47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:55.981040 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947f724-ac82-495e-afbf-c1c80af8ee47 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:55.981316 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947f724-ac82-495e-afbf-c1c80af8ee47 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:55.981578 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947f724-ac82-495e-afbf-c1c80af8ee47 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:55.982254 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947f724-ac82-495e-afbf-c1c80af8ee47 None admin] RBAC: Adding query filter params (name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:55.982550 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947f724-ac82-495e-afbf-c1c80af8ee47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:55.983967 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947f724-ac82-495e-afbf-c1c80af8ee47 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:55.992993 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 270/559] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Oct 4 16:18:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:55.993855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947f724-ac82-495e-afbf-c1c80af8ee47 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:56.014911 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 290/560] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:18:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:18:56.016543 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194376d2-6fe2-4e11-b0b0-3d31645cab85 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:56.016823 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194376d2-6fe2-4e11-b0b0-3d31645cab85 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:56.017116 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194376d2-6fe2-4e11-b0b0-3d31645cab85 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:56.021696 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 291/561] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:56.021696 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194376d2-6fe2-4e11-b0b0-3d31645cab85 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:56.119314 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947f724-ac82-495e-afbf-c1c80af8ee47 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:56.145205 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194376d2-6fe2-4e11-b0b0-3d31645cab85 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:56.156113 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924218a4-ba2d-4023-b4ff-a5395b00fc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:56.156761 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924218a4-ba2d-4023-b4ff-a5395b00fc46 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:56.157039 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924218a4-ba2d-4023-b4ff-a5395b00fc46 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:56.157311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924218a4-ba2d-4023-b4ff-a5395b00fc46 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:56.165443 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924218a4-ba2d-4023-b4ff-a5395b00fc46 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:56.166909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924218a4-ba2d-4023-b4ff-a5395b00fc46 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:56.178689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-924218a4-ba2d-4023-b4ff-a5395b00fc46 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 16:18:56.178689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:56.178689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:56.178689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:56.178689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:56.178689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:56.178689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:56.178689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:56.178689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:56.178689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:56.178689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:56.178689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:56.178689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:18:56.178689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:18:56.178689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:18:56.178689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:18:56.179765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:56.179765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:56.179765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:18:56.179765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:18:56.179765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:18:56.179765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:18:56.179765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:56.179765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:56.179765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:56.179765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:56.179765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:56.179765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:56.179765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:56.179765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:56.179765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:56.179765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:56.179765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:56.179765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:56.180749 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:56.180749 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:56.180749 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:18:56.180749 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:18:56.180749 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:18:56.180749 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:18:56.180749 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:18:56.180749 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:18:56.180749 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 16:18:56.180749 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:56.180749 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 271/562] 10.222.0.55 () {56 vars in 1093 bytes} [Tue Oct 4 16:18:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:56.180749 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924218a4-ba2d-4023-b4ff-a5395b00fc46 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:56.183644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb47c5-f24d-4529-ade6-283d48c37ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:56.184312 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb47c5-f24d-4529-ade6-283d48c37ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:56.184585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb47c5-f24d-4529-ade6-283d48c37ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:56.184852 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb47c5-f24d-4529-ade6-283d48c37ee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:56.195515 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb47c5-f24d-4529-ade6-283d48c37ee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:56.196992 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb47c5-f24d-4529-ade6-283d48c37ee5 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:56.198933 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:56.213266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-3eeb47c5-f24d-4529-ade6-283d48c37ee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:56.213266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:56.213266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:56.213266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:56.213266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:56.213266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:56.213266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:56.213266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:56.213266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:56.213266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:56.213266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:56.213266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:56.213266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:18:56.213266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:18:56.213266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:18:56.213266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:18:56.214594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:56.214594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:56.214594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:56.214594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:56.214594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:56.214594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:56.214594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:56.214594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:56.214594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:56.214594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:56.214594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:56.214594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:56.214594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:56.214594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:56.214594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:56.214594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:56.214594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:18:56.215551 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:18:56.215551 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:56.215551 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:56.215551 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 292/563] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:56.215779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb9a68-c8ad-49a4-a94b-5c4def5bd48e None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:56.216022 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb9a68-c8ad-49a4-a94b-5c4def5bd48e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:56.216379 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb9a68-c8ad-49a4-a94b-5c4def5bd48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:56.231792 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:56.235323 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-34cb9a68-c8ad-49a4-a94b-5c4def5bd48e None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:56.236555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-34cb9a68-c8ad-49a4-a94b-5c4def5bd48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:56.295675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924218a4-ba2d-4023-b4ff-a5395b00fc46 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:56.309953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 293/564] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:56.311257 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c2647-66d6-4f54-98a9-944218a7180a None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:56.311535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c2647-66d6-4f54-98a9-944218a7180a None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:56.311800 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c2647-66d6-4f54-98a9-944218a7180a None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:56.313037 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 294/565] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:18:56.313719 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c2647-66d6-4f54-98a9-944218a7180a None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:56.348056 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a17858-f77a-4535-84b4-541084204003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:56.348808 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a17858-f77a-4535-84b4-541084204003 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:56.349169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a17858-f77a-4535-84b4-541084204003 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:56.349330 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a17858-f77a-4535-84b4-541084204003 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:56.363593 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a17858-f77a-4535-84b4-541084204003 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:56.365057 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a17858-f77a-4535-84b4-541084204003 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:56.381768 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-59a17858-f77a-4535-84b4-541084204003 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:56.381768 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:56.381768 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:56.381768 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:56.381768 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:56.381768 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:56.381768 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:56.381768 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:56.381768 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:56.381768 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:56.381768 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:56.381768 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:56.381768 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:18:56.381768 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:18:56.381768 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:18:56.381768 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:18:56.382848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:56.382848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:56.382848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:56.382848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:56.382848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:56.382848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:56.382848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:56.382848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:56.382848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:56.382848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:56.382848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:56.382848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:56.382848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:56.382848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:56.382848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:56.382848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:56.382848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:18:56.384001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:18:56.384001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:56.384001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:56.387442 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 272/566] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:56.388123 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a17858-f77a-4535-84b4-541084204003 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:56.432299 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c2647-66d6-4f54-98a9-944218a7180a None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:56.456234 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:56.468796 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13749ea4-e886-4b81-9092-e5b346505886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:56.469490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13749ea4-e886-4b81-9092-e5b346505886 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:56.469836 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13749ea4-e886-4b81-9092-e5b346505886 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:56.470191 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13749ea4-e886-4b81-9092-e5b346505886 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:56.471461 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13749ea4-e886-4b81-9092-e5b346505886 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:56.471829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13749ea4-e886-4b81-9092-e5b346505886 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:56.473682 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13749ea4-e886-4b81-9092-e5b346505886 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:56.491557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:56.498079 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 295/567] 10.222.0.55 () {56 vars in 1133 bytes} [Tue Oct 4 16:18:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:56.498079 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e26c5-ea44-4277-9cea-c69b10719b4a None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:56.498079 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e26c5-ea44-4277-9cea-c69b10719b4a None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:56.498079 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e26c5-ea44-4277-9cea-c69b10719b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:56.504605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a17858-f77a-4535-84b4-541084204003 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:56.515358 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-b90e26c5-ea44-4277-9cea-c69b10719b4a None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:18:56.516569 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b90e26c5-ea44-4277-9cea-c69b10719b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:18:56.538141 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d061f5e-3b84-440e-a068-9f85a876a18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:56.538751 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d061f5e-3b84-440e-a068-9f85a876a18e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:56.539041 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d061f5e-3b84-440e-a068-9f85a876a18e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:56.539313 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d061f5e-3b84-440e-a068-9f85a876a18e None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:56.539946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d061f5e-3b84-440e-a068-9f85a876a18e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:56.540238 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d061f5e-3b84-440e-a068-9f85a876a18e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:56.541595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d061f5e-3b84-440e-a068-9f85a876a18e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:56.555014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 273/568] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:56.555190 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d061f5e-3b84-440e-a068-9f85a876a18e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:56.591033 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 296/569] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:18:56.591894 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e26c5-ea44-4277-9cea-c69b10719b4a None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:56.671022 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d061f5e-3b84-440e-a068-9f85a876a18e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:56.697814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e26c5-ea44-4277-9cea-c69b10719b4a None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:56.705724 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9a792-1a5b-4d79-b050-5aef9064eb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:56.706336 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9a792-1a5b-4d79-b050-5aef9064eb8f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:56.706604 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9a792-1a5b-4d79-b050-5aef9064eb8f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:56.706866 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9a792-1a5b-4d79-b050-5aef9064eb8f None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:56.707533 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9a792-1a5b-4d79-b050-5aef9064eb8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:56.707827 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9a792-1a5b-4d79-b050-5aef9064eb8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:56.709192 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9a792-1a5b-4d79-b050-5aef9064eb8f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:56.712793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:56.721492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 274/570] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:56.726632 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9a792-1a5b-4d79-b050-5aef9064eb8f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:56.735953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab18844-a0c4-4e12-8ba2-6d4f4d9037fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:56.736641 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab18844-a0c4-4e12-8ba2-6d4f4d9037fd None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:56.736924 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab18844-a0c4-4e12-8ba2-6d4f4d9037fd None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:56.737195 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab18844-a0c4-4e12-8ba2-6d4f4d9037fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:56.744908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:56.749020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab18844-a0c4-4e12-8ba2-6d4f4d9037fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:56.750551 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab18844-a0c4-4e12-8ba2-6d4f4d9037fd None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:56.765108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-cab18844-a0c4-4e12-8ba2-6d4f4d9037fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:56.765108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:56.765108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:56.765108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:56.765108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:56.765108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:56.765108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:56.765108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:56.765108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:56.765108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:56.765108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:56.765108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:56.765108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:18:56.765108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:18:56.765108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:18:56.765108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:18:56.766252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:56.766252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:56.766252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:56.766252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:56.766252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:56.766252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:56.766252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:56.766252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:56.766252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:56.766252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:56.766252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:56.766252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:56.766252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:56.766252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:56.766252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:56.766252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:56.766252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:18:56.767528 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:18:56.767528 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:56.767528 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:56.768111 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 297/571] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:56.768764 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab18844-a0c4-4e12-8ba2-6d4f4d9037fd None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:56.838093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9a792-1a5b-4d79-b050-5aef9064eb8f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:56.869873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab18844-a0c4-4e12-8ba2-6d4f4d9037fd None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:56.870806 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dea7b1-fdbd-4be8-8906-01a94baf278c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:56.871509 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dea7b1-fdbd-4be8-8906-01a94baf278c None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:56.871785 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dea7b1-fdbd-4be8-8906-01a94baf278c None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:56.872053 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dea7b1-fdbd-4be8-8906-01a94baf278c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:56.879403 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dea7b1-fdbd-4be8-8906-01a94baf278c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:56.880870 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dea7b1-fdbd-4be8-8906-01a94baf278c None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:56.892179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-e1dea7b1-fdbd-4be8-8906-01a94baf278c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 16:18:56.892179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:56.892179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:56.892179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:56.892179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:56.892179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:56.892179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:56.892179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:56.892179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:56.892179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:56.892179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:56.892179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:56.892179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:18:56.892179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:18:56.892179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:18:56.892179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:18:56.893278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:56.893278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:56.893278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:18:56.893278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:18:56.893278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:18:56.893278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:18:56.893278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:56.893278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:56.893278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:56.893278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:56.893278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:56.893278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:56.893278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:56.893278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:56.893278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:56.893278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:56.893278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:56.893278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:56.894492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:56.894492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:56.894492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:18:56.894492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:18:56.894492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:18:56.894492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:18:56.894492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:18:56.894492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:18:56.894492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 16:18:56.894492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:56.894492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 275/572] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:56.895875 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dea7b1-fdbd-4be8-8906-01a94baf278c None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:56.906247 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039aa30c-b0fe-4295-a1f3-ad69d75a0080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:56.906876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039aa30c-b0fe-4295-a1f3-ad69d75a0080 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:56.907177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039aa30c-b0fe-4295-a1f3-ad69d75a0080 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:56.907446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039aa30c-b0fe-4295-a1f3-ad69d75a0080 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:56.917610 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039aa30c-b0fe-4295-a1f3-ad69d75a0080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:56.923560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-039aa30c-b0fe-4295-a1f3-ad69d75a0080 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:18:56.923560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:56.923560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:56.923560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:56.923560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:56.923560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:56.923560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:56.923560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:56.923560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:56.923560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:56.923560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:56.923560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:56.923560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:56.923560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:56.923560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:56.923560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:56.924662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:56.924662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:56.924662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:56.924662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:56.924662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:56.924662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:56.924662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:56.924662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:56.924662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:56.924662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:56.924662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:56.924662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:56.924662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:56.924662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:56.924662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:56.924662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:56.925702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:56.925702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:56.925702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:56.925702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:56.925702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:56.925702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:56.925702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:56.925702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:56.925702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:56.925702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:56.925702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:18:56.925702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:56.925702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 298/573] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Oct 4 16:18:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:56.925702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039aa30c-b0fe-4295-a1f3-ad69d75a0080 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:56.950678 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:56.978509 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:57.002517 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dea7b1-fdbd-4be8-8906-01a94baf278c None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:57.026297 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039aa30c-b0fe-4295-a1f3-ad69d75a0080 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:57.035459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8249962-c3ae-43ad-aa21-b8122b842379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:57.036088 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8249962-c3ae-43ad-aa21-b8122b842379 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:57.036362 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8249962-c3ae-43ad-aa21-b8122b842379 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:57.036632 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8249962-c3ae-43ad-aa21-b8122b842379 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:57.043417 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8249962-c3ae-43ad-aa21-b8122b842379 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:57.045365 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8249962-c3ae-43ad-aa21-b8122b842379 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:57.056998 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-c8249962-c3ae-43ad-aa21-b8122b842379 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:18:57.056998 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:57.056998 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:57.056998 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:57.056998 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:57.056998 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:57.056998 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:57.056998 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:57.056998 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:57.056998 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:57.056998 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:57.056998 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:57.056998 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:18:57.056998 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:18:57.056998 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:18:57.058094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:18:57.058094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:57.058094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:57.058094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:57.058094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:57.058094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:57.058094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:57.058094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:57.058094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:57.058094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:57.058094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:57.058094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:57.058094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:57.058094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:57.058094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:57.058094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:57.058094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:57.059324 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:18:57.059324 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:18:57.059324 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:18:57.059324 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:18:57.059324 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:18:57.059324 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:18:57.059324 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:18:57.059324 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:57.059324 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 276/574] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:18:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:57.059324 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8249962-c3ae-43ad-aa21-b8122b842379 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:57.065809 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2127e44-9c65-4097-a7e8-0ee3271d7e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:57.066431 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2127e44-9c65-4097-a7e8-0ee3271d7e85 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:57.066708 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2127e44-9c65-4097-a7e8-0ee3271d7e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:57.067007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2127e44-9c65-4097-a7e8-0ee3271d7e85 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:57.067663 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2127e44-9c65-4097-a7e8-0ee3271d7e85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:57.067963 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2127e44-9c65-4097-a7e8-0ee3271d7e85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:57.069336 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2127e44-9c65-4097-a7e8-0ee3271d7e85 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:57.085767 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 299/575] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:57.085767 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2127e44-9c65-4097-a7e8-0ee3271d7e85 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:57.161147 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8249962-c3ae-43ad-aa21-b8122b842379 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:57.167218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:57.183899 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2127e44-9c65-4097-a7e8-0ee3271d7e85 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:57.197085 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b0215-2b70-414f-b7d5-05d6a1446a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:57.197726 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b0215-2b70-414f-b7d5-05d6a1446a8c None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:57.198004 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b0215-2b70-414f-b7d5-05d6a1446a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:57.198272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b0215-2b70-414f-b7d5-05d6a1446a8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:57.201000 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:57.209075 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b0215-2b70-414f-b7d5-05d6a1446a8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:18:57.214481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-c36b0215-2b70-414f-b7d5-05d6a1446a8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:18:57.214481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:57.214481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:57.214481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:57.214481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:57.214481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:57.214481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:57.214481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:57.214481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:57.214481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:57.214481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:57.214481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:57.214481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:18:57.214481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:18:57.214481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:18:57.214481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:18:57.215445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:18:57.215445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:18:57.215445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:18:57.215445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:18:57.215445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:57.215445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:57.215445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:57.215445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:57.215445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:57.215445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:57.215445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:57.215445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:57.215445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:57.215445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:57.215445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:57.215445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:57.216291 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:57.216291 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:57.216291 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:57.216291 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:57.216291 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:18:57.216291 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:18:57.216291 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:18:57.216291 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:18:57.216291 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:18:57.216291 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:18:57.216291 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:18:57.216291 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:57.216291 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 277/576] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Oct 4 16:18:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:57.216988 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b0215-2b70-414f-b7d5-05d6a1446a8c None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:57.221554 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610d4db-d000-48be-86aa-b49bb66059d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:57.222176 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610d4db-d000-48be-86aa-b49bb66059d3 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:57.223241 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610d4db-d000-48be-86aa-b49bb66059d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:57.223241 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610d4db-d000-48be-86aa-b49bb66059d3 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:57.223473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610d4db-d000-48be-86aa-b49bb66059d3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:57.223773 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610d4db-d000-48be-86aa-b49bb66059d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:57.225213 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610d4db-d000-48be-86aa-b49bb66059d3 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:57.242736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 300/577] 10.222.0.55 () {56 vars in 1137 bytes} [Tue Oct 4 16:18:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:57.243571 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610d4db-d000-48be-86aa-b49bb66059d3 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:57.322508 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b0215-2b70-414f-b7d5-05d6a1446a8c None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:57.344067 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610d4db-d000-48be-86aa-b49bb66059d3 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:57.355762 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e6b5a-5988-4945-934c-556312d9673c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:57.356368 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e6b5a-5988-4945-934c-556312d9673c None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:57.356659 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e6b5a-5988-4945-934c-556312d9673c None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:57.356930 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e6b5a-5988-4945-934c-556312d9673c None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:57.357582 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e6b5a-5988-4945-934c-556312d9673c None admin] RBAC: Adding query filter params (name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:57.357876 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e6b5a-5988-4945-934c-556312d9673c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:57.359280 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e6b5a-5988-4945-934c-556312d9673c None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:57.367401 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 278/578] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Oct 4 16:18:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:57.368106 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e6b5a-5988-4945-934c-556312d9673c None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:57.378383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86dfb4-35a5-41e0-8b85-b244846023a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:57.379010 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86dfb4-35a5-41e0-8b85-b244846023a8 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:57.379295 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86dfb4-35a5-41e0-8b85-b244846023a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:57.379556 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86dfb4-35a5-41e0-8b85-b244846023a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:57.380252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86dfb4-35a5-41e0-8b85-b244846023a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:57.380530 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86dfb4-35a5-41e0-8b85-b244846023a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:57.381940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86dfb4-35a5-41e0-8b85-b244846023a8 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:57.393448 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 301/579] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:18:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:57.394242 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86dfb4-35a5-41e0-8b85-b244846023a8 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:57.400299 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:57.431245 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:57.472460 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e6b5a-5988-4945-934c-556312d9673c None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:57.497852 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86dfb4-35a5-41e0-8b85-b244846023a8 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:57.507716 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab467ed-6007-4cac-883a-62fc82bb86b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:57.508656 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab467ed-6007-4cac-883a-62fc82bb86b8 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:57.508927 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab467ed-6007-4cac-883a-62fc82bb86b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:57.509213 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab467ed-6007-4cac-883a-62fc82bb86b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:57.515867 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab467ed-6007-4cac-883a-62fc82bb86b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:57.517368 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab467ed-6007-4cac-883a-62fc82bb86b8 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:57.529464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-8ab467ed-6007-4cac-883a-62fc82bb86b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:18:57.529464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:57.529464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:57.529464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:57.529464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:57.529464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:57.529464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:57.529464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:57.529464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:57.529464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:57.529464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:57.529464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:57.529464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:18:57.529464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:18:57.529464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:18:57.530573 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:18:57.530573 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:57.530573 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:57.530573 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:57.530573 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:57.530573 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:57.530573 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:57.530573 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:57.530573 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:57.530573 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:57.530573 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:57.530573 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:57.530573 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:57.530573 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:57.530573 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:57.530573 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:57.530573 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:57.531873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:18:57.531873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:18:57.531873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:18:57.531873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:18:57.531873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:18:57.531873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:18:57.531873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:18:57.531873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:57.531873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 279/580] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:18:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:57.531873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab467ed-6007-4cac-883a-62fc82bb86b8 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:57.533934 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97b530-ff89-4cdd-b8fd-c635fb57b36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:57.534557 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97b530-ff89-4cdd-b8fd-c635fb57b36a None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:57.534841 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97b530-ff89-4cdd-b8fd-c635fb57b36a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:57.535158 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97b530-ff89-4cdd-b8fd-c635fb57b36a None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:57.535822 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97b530-ff89-4cdd-b8fd-c635fb57b36a None admin] RBAC: Adding query filter params (name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:57.536114 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97b530-ff89-4cdd-b8fd-c635fb57b36a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:57.537506 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97b530-ff89-4cdd-b8fd-c635fb57b36a None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:57.546455 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 302/581] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Oct 4 16:18:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:57.547088 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97b530-ff89-4cdd-b8fd-c635fb57b36a None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:57.608175 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:57.634662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab467ed-6007-4cac-883a-62fc82bb86b8 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:57.645047 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97b530-ff89-4cdd-b8fd-c635fb57b36a None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:57.651082 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:57.669093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c7efa-ee44-44f4-9e22-e1ae5e769d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:57.670103 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c7efa-ee44-44f4-9e22-e1ae5e769d9e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:57.670348 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c7efa-ee44-44f4-9e22-e1ae5e769d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:57.670621 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c7efa-ee44-44f4-9e22-e1ae5e769d9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:57.681477 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c7efa-ee44-44f4-9e22-e1ae5e769d9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:57.682111 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ac2b6-d6d3-438a-a569-348c7ced1f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:57.682741 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ac2b6-d6d3-438a-a569-348c7ced1f5a None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:57.682970 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c7efa-ee44-44f4-9e22-e1ae5e769d9e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:57.683123 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ac2b6-d6d3-438a-a569-348c7ced1f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:57.683439 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ac2b6-d6d3-438a-a569-348c7ced1f5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:57.693671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ac2b6-d6d3-438a-a569-348c7ced1f5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:57.695131 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ac2b6-d6d3-438a-a569-348c7ced1f5a None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:57.697249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-1f1c7efa-ee44-44f4-9e22-e1ae5e769d9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:57.697249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:57.697249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:57.697249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:57.697249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:57.697249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:57.697249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:57.697249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:57.697249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:57.697249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:57.697249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:57.697249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:57.697249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:18:57.697249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:18:57.697249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:18:57.697249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:18:57.698281 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:57.698281 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:57.698281 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:57.698281 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:57.698281 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:57.698281 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:57.698281 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:57.698281 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:57.698281 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:57.698281 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:57.698281 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:57.698281 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:57.698281 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:57.698281 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:57.698281 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:57.698281 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:57.698281 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:18:57.699594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:18:57.699594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:57.699594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:57.699594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 280/582] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:57.699594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c7efa-ee44-44f4-9e22-e1ae5e769d9e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:57.712253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-d98ac2b6-d6d3-438a-a569-348c7ced1f5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:57.712253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:57.712253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:57.712253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:57.712253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:57.712253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:57.712253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:57.712253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:57.712253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:57.712253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:57.712253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:57.712253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:57.712253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:18:57.712253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:18:57.712253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:18:57.712253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:18:57.713398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:57.713398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:57.713398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:57.713398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:57.713398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:57.713398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:57.713398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:57.713398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:57.713398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:57.713398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:57.713398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:57.713398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:57.713398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:57.713398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:57.713398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:57.713398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:57.713398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:18:57.714345 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:18:57.714345 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:57.714345 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:57.714345 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 303/583] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:57.714345 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ac2b6-d6d3-438a-a569-348c7ced1f5a None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:57.802905 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c7efa-ee44-44f4-9e22-e1ae5e769d9e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:57.815943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ac2b6-d6d3-438a-a569-348c7ced1f5a None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:57.832854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:57.837785 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3b3e1-7df4-4a35-bbfd-184cf46c513e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:57.838395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3b3e1-7df4-4a35-bbfd-184cf46c513e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:57.838657 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3b3e1-7df4-4a35-bbfd-184cf46c513e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:57.838913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3b3e1-7df4-4a35-bbfd-184cf46c513e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:57.839703 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3b3e1-7df4-4a35-bbfd-184cf46c513e None admin] RBAC: Adding query filter params (role.id=2165a726b4034e1584166027f2361b5f, scope.project.id=e480e782c4fa403a913ca7179db0843b, user.id=6590cb6c1c964039b9dea771a647bdac) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:57.839986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3b3e1-7df4-4a35-bbfd-184cf46c513e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:57.841422 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3b3e1-7df4-4a35-bbfd-184cf46c513e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:57.846721 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 281/584] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:18:57 2022] GET /identity/v3/role_assignments?user.id=6590cb6c1c964039b9dea771a647bdac&scope.project.id=e480e782c4fa403a913ca7179db0843b&role.id=2165a726b4034e1584166027f2361b5f => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:57.847522 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3b3e1-7df4-4a35-bbfd-184cf46c513e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:57.851751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4956058-19f5-480d-a693-8f1164409fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:57.852379 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4956058-19f5-480d-a693-8f1164409fdd None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:57.852661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4956058-19f5-480d-a693-8f1164409fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:57.852933 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4956058-19f5-480d-a693-8f1164409fdd None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:57.853634 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4956058-19f5-480d-a693-8f1164409fdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:57.853936 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4956058-19f5-480d-a693-8f1164409fdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:57.855550 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4956058-19f5-480d-a693-8f1164409fdd None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:57.869703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 304/585] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:18:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:57.871272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4956058-19f5-480d-a693-8f1164409fdd None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:57.887836 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:57.964783 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3b3e1-7df4-4a35-bbfd-184cf46c513e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:57.984118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4956058-19f5-480d-a693-8f1164409fdd None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:58.001505 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad0a90-1129-4291-a1c7-246a07ef1075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:58.002178 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad0a90-1129-4291-a1c7-246a07ef1075 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:58.002460 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad0a90-1129-4291-a1c7-246a07ef1075 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:58.002736 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad0a90-1129-4291-a1c7-246a07ef1075 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:58.014029 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad0a90-1129-4291-a1c7-246a07ef1075 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:58.015570 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad0a90-1129-4291-a1c7-246a07ef1075 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:58.027581 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa692f-0b18-4853-9db5-2ff329fbf8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:58.028225 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa692f-0b18-4853-9db5-2ff329fbf8ce None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:58.028509 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa692f-0b18-4853-9db5-2ff329fbf8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:58.028776 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa692f-0b18-4853-9db5-2ff329fbf8ce None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:58.029429 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa692f-0b18-4853-9db5-2ff329fbf8ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:58.029726 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa692f-0b18-4853-9db5-2ff329fbf8ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:58.031141 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa692f-0b18-4853-9db5-2ff329fbf8ce None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:58.032033 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-f8ad0a90-1129-4291-a1c7-246a07ef1075 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:58.032033 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:58.032033 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:58.032033 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:58.032033 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:58.032033 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:58.032033 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:58.032033 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:58.032033 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:58.032033 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:58.032033 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:58.032033 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:58.032033 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:18:58.032033 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:18:58.032033 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:18:58.032033 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:18:58.033457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:58.033457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:58.033457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:58.033457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:58.033457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:58.033457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:58.033457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:58.033457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:58.033457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:58.033457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:58.033457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:58.033457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:58.033457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:58.033457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:58.033457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:58.033457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:58.033457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:18:58.034345 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:18:58.034345 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:58.034345 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:58.034345 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 282/586] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:58.034345 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad0a90-1129-4291-a1c7-246a07ef1075 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:58.051133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 305/587] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:58.052035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa692f-0b18-4853-9db5-2ff329fbf8ce None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:58.100042 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:58.150073 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:58.168028 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad0a90-1129-4291-a1c7-246a07ef1075 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:58.187220 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa692f-0b18-4853-9db5-2ff329fbf8ce None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:58.208005 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f644a02-169a-439b-9268-e0f87f6ee8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:58.208466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f644a02-169a-439b-9268-e0f87f6ee8c8 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:58.208740 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f644a02-169a-439b-9268-e0f87f6ee8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:58.209019 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f644a02-169a-439b-9268-e0f87f6ee8c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:58.209660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f644a02-169a-439b-9268-e0f87f6ee8c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:58.209949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f644a02-169a-439b-9268-e0f87f6ee8c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:58.211446 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f644a02-169a-439b-9268-e0f87f6ee8c8 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:58.227186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 283/588] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:58.228093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f644a02-169a-439b-9268-e0f87f6ee8c8 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:58.241133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d568c67-5c01-4851-b65c-f27e025168d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:58.242222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d568c67-5c01-4851-b65c-f27e025168d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:58.242714 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d568c67-5c01-4851-b65c-f27e025168d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:58.243240 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d568c67-5c01-4851-b65c-f27e025168d3 None admin] PATH_INFO: `/v3/projects/e480e782c4fa403a913ca7179db0843b/users/6cdee0584fe045028a44c385d032d2c7/roles/2165a726b4034e1584166027f2361b5f` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:58.268470 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d568c67-5c01-4851-b65c-f27e025168d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e480e782c4fa403a913ca7179db0843b, user_id=6cdee0584fe045028a44c385d032d2c7, role_id=2165a726b4034e1584166027f2361b5f)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:58.273412 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d568c67-5c01-4851-b65c-f27e025168d3 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:58.291874 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 306/589] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Oct 4 16:18:58 2022] PUT /identity/v3/projects/e480e782c4fa403a913ca7179db0843b/users/6cdee0584fe045028a44c385d032d2c7/roles/2165a726b4034e1584166027f2361b5f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:18:58.292599 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d568c67-5c01-4851-b65c-f27e025168d3 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:58.385546 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f644a02-169a-439b-9268-e0f87f6ee8c8 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:58.399488 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:58.424649 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d568c67-5c01-4851-b65c-f27e025168d3 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:58.447249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f9ba2-ad5f-428e-8331-54dd1347e912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:58.448305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f9ba2-ad5f-428e-8331-54dd1347e912 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:58.448755 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f9ba2-ad5f-428e-8331-54dd1347e912 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:58.449150 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f9ba2-ad5f-428e-8331-54dd1347e912 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:58.450221 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f9ba2-ad5f-428e-8331-54dd1347e912 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:58.450707 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f9ba2-ad5f-428e-8331-54dd1347e912 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:58.452747 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f9ba2-ad5f-428e-8331-54dd1347e912 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:58.471495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 284/590] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:58.472502 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f9ba2-ad5f-428e-8331-54dd1347e912 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:58.474572 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbdbc3-f09e-4f6c-9365-830d0640ce80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:58.475829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbdbc3-f09e-4f6c-9365-830d0640ce80 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:58.476330 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbdbc3-f09e-4f6c-9365-830d0640ce80 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:58.477781 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbdbc3-f09e-4f6c-9365-830d0640ce80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:58.484546 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:58.487198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbdbc3-f09e-4f6c-9365-830d0640ce80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:58.490244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbdbc3-f09e-4f6c-9365-830d0640ce80 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:58.504296 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-cfdbdbc3-f09e-4f6c-9365-830d0640ce80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:18:58.504296 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:58.504296 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:58.504296 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:58.504296 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:58.504296 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:58.504296 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:58.504296 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:58.504296 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:58.504296 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:58.504296 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:58.504296 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:58.504296 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:18:58.504296 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:18:58.504296 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:18:58.505418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:18:58.505418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:58.505418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:58.505418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:58.505418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:58.505418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:58.505418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:58.505418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:58.505418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:58.505418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:58.505418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:58.505418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:58.505418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:58.505418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:58.505418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:58.505418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:58.505418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:58.506480 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:18:58.506480 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:18:58.506480 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:18:58.506480 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:18:58.506480 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:18:58.506480 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:18:58.506480 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:18:58.506480 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:58.509794 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 307/591] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:18:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:58.512866 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbdbc3-f09e-4f6c-9365-830d0640ce80 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:58.626600 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f9ba2-ad5f-428e-8331-54dd1347e912 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:58.657908 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbdbc3-f09e-4f6c-9365-830d0640ce80 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:58.673121 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d8c03-14c7-4926-b4a6-b1f151438ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:58.674391 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d8c03-14c7-4926-b4a6-b1f151438ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:58.674734 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d8c03-14c7-4926-b4a6-b1f151438ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:58.675352 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d8c03-14c7-4926-b4a6-b1f151438ca8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:58.686002 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d8c03-14c7-4926-b4a6-b1f151438ca8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:58.688482 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d8c03-14c7-4926-b4a6-b1f151438ca8 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:58.695578 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99c6dc-8523-4795-9274-f3978d46158e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:58.696278 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99c6dc-8523-4795-9274-f3978d46158e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:58.696548 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99c6dc-8523-4795-9274-f3978d46158e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:58.696814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99c6dc-8523-4795-9274-f3978d46158e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:58.702553 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-006d8c03-14c7-4926-b4a6-b1f151438ca8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 16:18:58.702553 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:58.702553 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:58.702553 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:58.702553 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:58.702553 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:58.702553 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:58.702553 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:58.702553 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:58.702553 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:58.702553 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:58.702553 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:58.702553 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:18:58.702553 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:18:58.702553 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:18:58.702553 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:18:58.705044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:58.705044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:58.705044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:18:58.705044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:18:58.705044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:18:58.705044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:18:58.705044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:58.705044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:58.705044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:58.705044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:58.705044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:58.705044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:58.705044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:58.705044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:58.705044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:58.705044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:58.705044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:58.705044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:58.707299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:58.707299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:58.707299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:18:58.707299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:18:58.707299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:18:58.707299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:18:58.707299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:18:58.707299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:18:58.707299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 16:18:58.707299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:58.707299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 285/592] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Oct 4 16:18:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:58.707299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d8c03-14c7-4926-b4a6-b1f151438ca8 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:58.708696 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99c6dc-8523-4795-9274-f3978d46158e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:58.716594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99c6dc-8523-4795-9274-f3978d46158e None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:58.731594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-bf99c6dc-8523-4795-9274-f3978d46158e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 16:18:58.731594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:58.731594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:58.731594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:58.731594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:58.731594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:58.731594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:58.731594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:58.731594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:58.731594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:58.731594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:58.731594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:58.731594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:18:58.731594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:18:58.731594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:18:58.731594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:18:58.732740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:58.732740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:58.732740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:18:58.732740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:18:58.732740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:18:58.732740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:18:58.732740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:58.732740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:58.732740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:58.732740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:58.732740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:58.732740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:58.732740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:58.732740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:58.732740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:58.732740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:58.732740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:58.732740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:58.733749 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:58.733749 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:58.733749 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:18:58.733749 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:18:58.733749 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:18:58.733749 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:18:58.733749 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:18:58.733749 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:18:58.733749 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 16:18:58.733749 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:58.735821 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 308/593] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:18:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:58.737040 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99c6dc-8523-4795-9274-f3978d46158e None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:58.747244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:58.803371 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:58.829810 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d8c03-14c7-4926-b4a6-b1f151438ca8 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:58.846492 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99c6dc-8523-4795-9274-f3978d46158e None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:58.866024 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2388d8c-82ad-4aba-b3fb-5c0a08c7ae4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:58.866805 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2388d8c-82ad-4aba-b3fb-5c0a08c7ae4e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:58.867206 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2388d8c-82ad-4aba-b3fb-5c0a08c7ae4e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:58.867572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2388d8c-82ad-4aba-b3fb-5c0a08c7ae4e None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:58.868374 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2388d8c-82ad-4aba-b3fb-5c0a08c7ae4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:58.868763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2388d8c-82ad-4aba-b3fb-5c0a08c7ae4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:58.871358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2388d8c-82ad-4aba-b3fb-5c0a08c7ae4e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:58.883700 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90610d70-273b-401a-8c30-0e09560272bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:58.884563 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90610d70-273b-401a-8c30-0e09560272bc None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:58.884975 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90610d70-273b-401a-8c30-0e09560272bc None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:58.885384 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90610d70-273b-401a-8c30-0e09560272bc None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:58.886297 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90610d70-273b-401a-8c30-0e09560272bc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:58.886811 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90610d70-273b-401a-8c30-0e09560272bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:58.891931 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 286/594] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:18:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:58.891931 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2388d8c-82ad-4aba-b3fb-5c0a08c7ae4e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:58.892702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90610d70-273b-401a-8c30-0e09560272bc None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:58.923119 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 309/595] 10.222.0.55 () {56 vars in 1139 bytes} [Tue Oct 4 16:18:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:58.923119 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90610d70-273b-401a-8c30-0e09560272bc None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:58.991869 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:59.041426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90610d70-273b-401a-8c30-0e09560272bc None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:59.051529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2388d8c-82ad-4aba-b3fb-5c0a08c7ae4e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:59.083121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40fd05-e808-4bda-8137-62fb5e4200f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:59.084018 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40fd05-e808-4bda-8137-62fb5e4200f4 None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:59.084325 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40fd05-e808-4bda-8137-62fb5e4200f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:59.084690 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40fd05-e808-4bda-8137-62fb5e4200f4 None admin] PATH_INFO: `/v3/projects/e480e782c4fa403a913ca7179db0843b/users/74b3e45a14bd4b539974e9e5e278ee62/roles/2165a726b4034e1584166027f2361b5f` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:59.086878 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:59.097931 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248fcb6-e3b5-4feb-93db-338372925c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:59.099134 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248fcb6-e3b5-4feb-93db-338372925c55 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:59.099620 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248fcb6-e3b5-4feb-93db-338372925c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:59.100323 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248fcb6-e3b5-4feb-93db-338372925c55 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:59.101764 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7248fcb6-e3b5-4feb-93db-338372925c55 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:59.102507 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7248fcb6-e3b5-4feb-93db-338372925c55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:59.104252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40fd05-e808-4bda-8137-62fb5e4200f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e480e782c4fa403a913ca7179db0843b, user_id=74b3e45a14bd4b539974e9e5e278ee62, role_id=2165a726b4034e1584166027f2361b5f)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:59.104478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7248fcb6-e3b5-4feb-93db-338372925c55 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:59.105957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40fd05-e808-4bda-8137-62fb5e4200f4 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:59.131768 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 310/597] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Oct 4 16:18:58 2022] PUT /identity/v3/projects/e480e782c4fa403a913ca7179db0843b/users/74b3e45a14bd4b539974e9e5e278ee62/roles/2165a726b4034e1584166027f2361b5f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:18:59.132117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 287/597] 10.222.0.55 () {56 vars in 1137 bytes} [Tue Oct 4 16:18:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:59.133124 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40fd05-e808-4bda-8137-62fb5e4200f4 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:59.133893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248fcb6-e3b5-4feb-93db-338372925c55 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:59.245866 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248fcb6-e3b5-4feb-93db-338372925c55 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:59.307833 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5d45b-50d4-4c7b-9d6e-58ae4515423f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:59.308842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5d45b-50d4-4c7b-9d6e-58ae4515423f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:59.309278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5d45b-50d4-4c7b-9d6e-58ae4515423f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:59.309739 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5d45b-50d4-4c7b-9d6e-58ae4515423f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:59.334218 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5d45b-50d4-4c7b-9d6e-58ae4515423f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:59.336141 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5d45b-50d4-4c7b-9d6e-58ae4515423f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:59.364152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40fd05-e808-4bda-8137-62fb5e4200f4 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:59.372579 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-09d5d45b-50d4-4c7b-9d6e-58ae4515423f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:59.372579 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:59.372579 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:59.372579 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:59.372579 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:59.372579 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:59.372579 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:59.372579 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:59.372579 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:59.372579 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:59.372579 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:59.372579 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:59.372579 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:18:59.372579 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:18:59.372579 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:18:59.372579 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:18:59.373598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:59.373598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:59.373598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:59.373598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:59.373598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:59.373598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:59.373598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:59.373598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:59.373598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:59.373598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:59.373598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:59.373598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:59.373598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:59.373598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:59.373598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:59.373598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:59.373598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:18:59.374752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:18:59.374752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:59.374752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:59.374752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 288/598] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:18:59.384018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5d45b-50d4-4c7b-9d6e-58ae4515423f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:59.424066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:59.431840 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2940cb4-a0c7-459f-95a7-53a96903b08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:59.432542 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2940cb4-a0c7-459f-95a7-53a96903b08c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:59.432813 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2940cb4-a0c7-459f-95a7-53a96903b08c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:59.433075 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2940cb4-a0c7-459f-95a7-53a96903b08c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:59.446103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2940cb4-a0c7-459f-95a7-53a96903b08c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:59.447751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2940cb4-a0c7-459f-95a7-53a96903b08c None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:59.466264 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-a2940cb4-a0c7-459f-95a7-53a96903b08c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:59.466264 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:59.466264 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:59.466264 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:59.466264 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:59.466264 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:59.466264 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:59.466264 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:59.466264 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:59.466264 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:59.466264 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:59.466264 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:59.466264 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:18:59.466264 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:18:59.466264 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:18:59.466264 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:18:59.469179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:59.469179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:59.469179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:59.469179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:59.469179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:59.469179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:59.469179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:59.469179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:59.469179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:59.469179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:59.469179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:59.469179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:59.469179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:59.469179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:59.469179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:59.469179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:59.469179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:18:59.471325 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:18:59.471325 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:18:59.471325 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:18:59.471325 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 311/599] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:18:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:18:59.472748 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2940cb4-a0c7-459f-95a7-53a96903b08c None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:59.505297 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:59.588952 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5d45b-50d4-4c7b-9d6e-58ae4515423f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:59.626709 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b04a9e-6476-451c-9704-bc06ea14f98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:59.628149 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b04a9e-6476-451c-9704-bc06ea14f98e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:59.628595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b04a9e-6476-451c-9704-bc06ea14f98e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:59.629003 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b04a9e-6476-451c-9704-bc06ea14f98e None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:59.629986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b04a9e-6476-451c-9704-bc06ea14f98e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:59.630431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b04a9e-6476-451c-9704-bc06ea14f98e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:59.632418 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b04a9e-6476-451c-9704-bc06ea14f98e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:59.651064 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 289/600] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:18:59.652931 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b04a9e-6476-451c-9704-bc06ea14f98e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:59.677012 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2940cb4-a0c7-459f-95a7-53a96903b08c None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:59.759482 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:59.767696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b04a9e-6476-451c-9704-bc06ea14f98e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:18:59.807053 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229fc4d-8d56-49f9-a561-3ff50d5d1bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:59.808255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229fc4d-8d56-49f9-a561-3ff50d5d1bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:59.808751 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229fc4d-8d56-49f9-a561-3ff50d5d1bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:59.809215 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229fc4d-8d56-49f9-a561-3ff50d5d1bc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:59.816852 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229fc4d-8d56-49f9-a561-3ff50d5d1bc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:59.818643 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229fc4d-8d56-49f9-a561-3ff50d5d1bc9 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:59.830914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-2229fc4d-8d56-49f9-a561-3ff50d5d1bc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:18:59.830914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:18:59.830914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:18:59.830914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:18:59.830914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:18:59.830914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:18:59.830914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:18:59.830914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:18:59.830914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:18:59.830914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:18:59.830914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:18:59.830914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:18:59.830914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:18:59.830914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:18:59.830914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:18:59.831895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:18:59.831895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:18:59.831895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:18:59.831895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:18:59.831895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:18:59.831895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:18:59.831895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:18:59.831895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:18:59.831895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:18:59.831895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:18:59.831895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:18:59.831895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:18:59.831895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:18:59.831895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:18:59.831895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:18:59.831895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:18:59.831895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:18:59.832786 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:18:59.832786 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:18:59.832786 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:18:59.832786 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:18:59.832786 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:18:59.832786 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:18:59.832786 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:18:59.832786 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:18:59.839028 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34576265-a25c-4052-aa93-72aa4de82a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:18:59.839028 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34576265-a25c-4052-aa93-72aa4de82a57 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:18:59.839028 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34576265-a25c-4052-aa93-72aa4de82a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:18:59.839028 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34576265-a25c-4052-aa93-72aa4de82a57 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:18:59.839712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34576265-a25c-4052-aa93-72aa4de82a57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:18:59.839712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34576265-a25c-4052-aa93-72aa4de82a57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:18:59.839712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34576265-a25c-4052-aa93-72aa4de82a57 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:18:59.840796 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 290/601] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:18:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:18:59.845706 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229fc4d-8d56-49f9-a561-3ff50d5d1bc9 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:59.874004 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 312/602] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:18:59.879259 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34576265-a25c-4052-aa93-72aa4de82a57 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:18:59.943383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:18:59.959802 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229fc4d-8d56-49f9-a561-3ff50d5d1bc9 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:00.001577 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655b618-5048-4adb-8e87-1be1f3e845be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:00.002631 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655b618-5048-4adb-8e87-1be1f3e845be None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:00.003110 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655b618-5048-4adb-8e87-1be1f3e845be None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:00.003871 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655b618-5048-4adb-8e87-1be1f3e845be None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:00.005055 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655b618-5048-4adb-8e87-1be1f3e845be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:00.005510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655b618-5048-4adb-8e87-1be1f3e845be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:00.008064 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655b618-5048-4adb-8e87-1be1f3e845be None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:00.027591 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 291/603] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:18:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:00.030870 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655b618-5048-4adb-8e87-1be1f3e845be None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:00.060576 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:00.148037 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655b618-5048-4adb-8e87-1be1f3e845be None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:00.152338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34576265-a25c-4052-aa93-72aa4de82a57 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:00.190504 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fdc9cd-1c3d-4cf8-9f2b-162c18090aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:00.191490 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdc9cd-1c3d-4cf8-9f2b-162c18090aa2 None admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:00.191909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdc9cd-1c3d-4cf8-9f2b-162c18090aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:00.192341 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdc9cd-1c3d-4cf8-9f2b-162c18090aa2 None admin] PATH_INFO: `/v3/projects/e480e782c4fa403a913ca7179db0843b/users/7d717575c1d8415fbd09d61d1cbef2d0/roles/2165a726b4034e1584166027f2361b5f` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:00.209372 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdc9cd-1c3d-4cf8-9f2b-162c18090aa2 None admin] RBAC: Authorizing `identity:create_grant(project_id=e480e782c4fa403a913ca7179db0843b, user_id=7d717575c1d8415fbd09d61d1cbef2d0, role_id=2165a726b4034e1584166027f2361b5f)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:00.211219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdc9cd-1c3d-4cf8-9f2b-162c18090aa2 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:00.235498 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 292/604] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Oct 4 16:19:00 2022] PUT /identity/v3/projects/e480e782c4fa403a913ca7179db0843b/users/7d717575c1d8415fbd09d61d1cbef2d0/roles/2165a726b4034e1584166027f2361b5f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:19:00.237852 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da0c8c-98b1-4f0e-84bd-30f5d2411a3f None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:00.238383 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da0c8c-98b1-4f0e-84bd-30f5d2411a3f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:00.238812 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da0c8c-98b1-4f0e-84bd-30f5d2411a3f None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:00.244921 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 293/605] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:00.246824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c7b99-3731-44f0-ad8e-01f1d2c26161 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:00.247269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c7b99-3731-44f0-ad8e-01f1d2c26161 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:00.247726 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c7b99-3731-44f0-ad8e-01f1d2c26161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:00.248641 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159bc31-844b-4db2-9cdb-52d9008b271c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:00.249304 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159bc31-844b-4db2-9cdb-52d9008b271c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:00.249581 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159bc31-844b-4db2-9cdb-52d9008b271c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:00.249852 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159bc31-844b-4db2-9cdb-52d9008b271c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:00.272300 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159bc31-844b-4db2-9cdb-52d9008b271c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:00.273905 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159bc31-844b-4db2-9cdb-52d9008b271c None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:00.298131 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-d95c7b99-3731-44f0-ad8e-01f1d2c26161 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:00.305274 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-d95c7b99-3731-44f0-ad8e-01f1d2c26161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:00.319245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-f159bc31-844b-4db2-9cdb-52d9008b271c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:00.319245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:00.319245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:00.319245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:00.319245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:00.319245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:00.319245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:00.319245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:00.319245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:00.319245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:00.319245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:00.319245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:00.319245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:19:00.319245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:19:00.319245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:19:00.320218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:19:00.320218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:00.320218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:00.320218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:00.320218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:00.320218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:00.320218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:00.320218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:00.320218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:00.320218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:00.320218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:00.320218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:00.320218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:00.320218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:00.320218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:00.320218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:00.320218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:00.321099 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:19:00.321099 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:19:00.321099 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:19:00.321099 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:19:00.321099 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:19:00.321099 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:19:00.321099 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:00.321099 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:00.321099 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 313/606] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:18:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 441 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:00.332630 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159bc31-844b-4db2-9cdb-52d9008b271c None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:00.535408 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:00.536822 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:00.547926 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 294/607] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:19:00.551936 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159bc31-844b-4db2-9cdb-52d9008b271c None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:00.586541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cfae5-fb41-414b-831c-a549377ed78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:00.587191 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cfae5-fb41-414b-831c-a549377ed78b None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:00.587465 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cfae5-fb41-414b-831c-a549377ed78b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:00.587734 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cfae5-fb41-414b-831c-a549377ed78b None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:00.588433 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cfae5-fb41-414b-831c-a549377ed78b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:00.588729 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cfae5-fb41-414b-831c-a549377ed78b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:00.590247 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cfae5-fb41-414b-831c-a549377ed78b None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:00.603897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 314/608] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:19:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:00.612117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c7b99-3731-44f0-ad8e-01f1d2c26161 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:00.791907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c7b99-3731-44f0-ad8e-01f1d2c26161 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:00.834552 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7f5f6-35ab-4a50-89d7-fbb5d1fc18ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:00.835317 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7f5f6-35ab-4a50-89d7-fbb5d1fc18ba None admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:00.835590 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7f5f6-35ab-4a50-89d7-fbb5d1fc18ba None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:00.835857 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7f5f6-35ab-4a50-89d7-fbb5d1fc18ba None admin] PATH_INFO: `/v3/projects/e480e782c4fa403a913ca7179db0843b/users/d6ae980afbfd49dea9bbb0adc02b9031/roles/2165a726b4034e1584166027f2361b5f` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:00.836208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6057073-c0cf-412f-9268-cd8083b7260c None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:00.836487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6057073-c0cf-412f-9268-cd8083b7260c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:00.836751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6057073-c0cf-412f-9268-cd8083b7260c None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:00.838340 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 315/609] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:19:00.844180 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01087784-6bb2-42a7-af8e-f180e77baeab None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:00.844457 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01087784-6bb2-42a7-af8e-f180e77baeab None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:00.844723 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01087784-6bb2-42a7-af8e-f180e77baeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:00.852043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7f5f6-35ab-4a50-89d7-fbb5d1fc18ba None admin] RBAC: Authorizing `identity:create_grant(project_id=e480e782c4fa403a913ca7179db0843b, user_id=d6ae980afbfd49dea9bbb0adc02b9031, role_id=2165a726b4034e1584166027f2361b5f)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:00.853560 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7f5f6-35ab-4a50-89d7-fbb5d1fc18ba None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:00.871188 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-01087784-6bb2-42a7-af8e-f180e77baeab None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:00.872481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-01087784-6bb2-42a7-af8e-f180e77baeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:00.885168 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 295/610] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Oct 4 16:19:00 2022] PUT /identity/v3/projects/e480e782c4fa403a913ca7179db0843b/users/d6ae980afbfd49dea9bbb0adc02b9031/roles/2165a726b4034e1584166027f2361b5f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:19:00.916231 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7f5f6-35ab-4a50-89d7-fbb5d1fc18ba None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:00.968709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 316/611] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:19:00.971834 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:01.032587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7f5f6-35ab-4a50-89d7-fbb5d1fc18ba None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:01.071552 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01181da-9a02-43b0-b8e1-14bd63515681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:01.072209 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01181da-9a02-43b0-b8e1-14bd63515681 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:01.072482 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01181da-9a02-43b0-b8e1-14bd63515681 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:01.072747 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01181da-9a02-43b0-b8e1-14bd63515681 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:01.085479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01181da-9a02-43b0-b8e1-14bd63515681 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:19:01.090891 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-e01181da-9a02-43b0-b8e1-14bd63515681 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:19:01.090891 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:01.090891 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:01.090891 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:01.090891 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:01.090891 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:01.090891 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:01.090891 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:01.090891 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:01.090891 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:01.090891 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:01.090891 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:01.090891 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:19:01.090891 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:19:01.090891 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:19:01.090891 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:19:01.091909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:19:01.091909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:19:01.091909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:19:01.091909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:19:01.091909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:01.091909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:01.091909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:01.091909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:01.091909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:01.091909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:01.091909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:01.091909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:01.091909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:01.091909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:01.091909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:01.091909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:01.092742 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:01.092742 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:01.092742 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:01.092742 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:01.092742 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:19:01.092742 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:19:01.092742 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:19:01.092742 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:19:01.092742 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:19:01.092742 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:19:01.092742 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:19:01.092742 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:01.092742 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 296/612] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Oct 4 16:19:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:19:01.100077 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01087784-6bb2-42a7-af8e-f180e77baeab None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:01.203494 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:01.227653 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01087784-6bb2-42a7-af8e-f180e77baeab None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:01.266138 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189141ad-c4f5-46bb-a51c-9a7d33a7e467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:01.266759 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189141ad-c4f5-46bb-a51c-9a7d33a7e467 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:01.267060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189141ad-c4f5-46bb-a51c-9a7d33a7e467 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:01.267328 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189141ad-c4f5-46bb-a51c-9a7d33a7e467 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:01.267996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189141ad-c4f5-46bb-a51c-9a7d33a7e467 None admin] RBAC: Adding query filter params (name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:01.268292 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189141ad-c4f5-46bb-a51c-9a7d33a7e467 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:01.269671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189141ad-c4f5-46bb-a51c-9a7d33a7e467 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:01.278675 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 317/613] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Oct 4 16:19:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:19:01.284179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01181da-9a02-43b0-b8e1-14bd63515681 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:01.352501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189141ad-c4f5-46bb-a51c-9a7d33a7e467 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:01.467902 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01181da-9a02-43b0-b8e1-14bd63515681 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:01.478492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:01.512700 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189141ad-c4f5-46bb-a51c-9a7d33a7e467 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:01.533168 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3cbba-d629-4547-ba2f-8486e2c8cd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:01.534213 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3cbba-d629-4547-ba2f-8486e2c8cd57 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:01.534699 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3cbba-d629-4547-ba2f-8486e2c8cd57 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:01.535181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3cbba-d629-4547-ba2f-8486e2c8cd57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:01.547774 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3cbba-d629-4547-ba2f-8486e2c8cd57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:01.549515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3cbba-d629-4547-ba2f-8486e2c8cd57 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:01.566084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-15d3cbba-d629-4547-ba2f-8486e2c8cd57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:01.566084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:01.566084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:01.566084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:01.566084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:01.566084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:01.566084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:01.566084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:01.566084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:01.566084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:01.566084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:01.566084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:01.566084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:01.566084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:01.566084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:01.566084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:01.567061 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:01.567061 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:01.567061 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:01.567061 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:01.567061 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:01.567061 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:01.567061 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:01.567061 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:01.567061 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:01.567061 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:01.567061 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:01.567061 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:01.567061 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:01.567061 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:01.567061 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:01.567061 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:01.567061 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:01.567959 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:01.567959 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:01.567959 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:01.570170 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 297/614] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:01.577017 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3cbba-d629-4547-ba2f-8486e2c8cd57 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:01.611801 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645d9b9-4a10-4a35-9166-428bcbecf3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:01.612448 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645d9b9-4a10-4a35-9166-428bcbecf3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:01.612637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645d9b9-4a10-4a35-9166-428bcbecf3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:01.612908 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645d9b9-4a10-4a35-9166-428bcbecf3d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:01.634245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:01.643588 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645d9b9-4a10-4a35-9166-428bcbecf3d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:19:01.650317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-b645d9b9-4a10-4a35-9166-428bcbecf3d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:19:01.650317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:01.650317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:01.650317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:01.650317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:01.650317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:01.650317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:01.650317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:01.650317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:01.650317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:01.650317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:01.650317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:01.650317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:19:01.650317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:19:01.650317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:19:01.650317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:19:01.651317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:19:01.651317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:19:01.651317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:19:01.651317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:19:01.651317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:01.651317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:01.651317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:01.651317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:01.651317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:01.651317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:01.651317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:01.651317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:01.651317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:01.651317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:01.651317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:01.651317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:01.652274 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:01.652274 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:01.652274 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:01.652274 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:01.652274 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:19:01.652274 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:19:01.652274 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:19:01.652274 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:19:01.652274 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:19:01.652274 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:19:01.652274 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:19:01.652274 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:01.655657 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 318/615] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Oct 4 16:19:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:19:01.663791 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645d9b9-4a10-4a35-9166-428bcbecf3d6 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:01.741521 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3cbba-d629-4547-ba2f-8486e2c8cd57 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:01.815705 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a658d0-a4a2-4cd1-9b5a-e1d0c61bd9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:01.816347 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a658d0-a4a2-4cd1-9b5a-e1d0c61bd9a4 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:01.816610 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a658d0-a4a2-4cd1-9b5a-e1d0c61bd9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:01.816898 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a658d0-a4a2-4cd1-9b5a-e1d0c61bd9a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:01.817556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a658d0-a4a2-4cd1-9b5a-e1d0c61bd9a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:01.817860 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a658d0-a4a2-4cd1-9b5a-e1d0c61bd9a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:01.819273 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a658d0-a4a2-4cd1-9b5a-e1d0c61bd9a4 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:01.831379 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645d9b9-4a10-4a35-9166-428bcbecf3d6 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:01.842738 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 298/616] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:01.846732 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a658d0-a4a2-4cd1-9b5a-e1d0c61bd9a4 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:01.870528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:01.918687 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c039e7-de58-43ef-a4f3-b8579f475572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:01.920006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c039e7-de58-43ef-a4f3-b8579f475572 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:01.920432 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c039e7-de58-43ef-a4f3-b8579f475572 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:01.920846 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c039e7-de58-43ef-a4f3-b8579f475572 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:01.921664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c039e7-de58-43ef-a4f3-b8579f475572 None admin] RBAC: Adding query filter params (name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:01.922105 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c039e7-de58-43ef-a4f3-b8579f475572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:01.923680 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c039e7-de58-43ef-a4f3-b8579f475572 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:01.934042 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 319/617] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Oct 4 16:19:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:01.939991 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c039e7-de58-43ef-a4f3-b8579f475572 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:02.009241 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a658d0-a4a2-4cd1-9b5a-e1d0c61bd9a4 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:02.034500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:02.046500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb85a83-35d8-4e7e-9fee-c4e6ae8c70ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:02.047455 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb85a83-35d8-4e7e-9fee-c4e6ae8c70ce None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:02.047878 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb85a83-35d8-4e7e-9fee-c4e6ae8c70ce None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:02.048288 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb85a83-35d8-4e7e-9fee-c4e6ae8c70ce None admin] PATH_INFO: `/v3/users/swift` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:02.055991 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb85a83-35d8-4e7e-9fee-c4e6ae8c70ce None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:02.057628 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb85a83-35d8-4e7e-9fee-c4e6ae8c70ce None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:02.070474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-0eb85a83-35d8-4e7e-9fee-c4e6ae8c70ce None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 16:19:02.070474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:02.070474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:02.070474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:02.070474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:02.070474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:02.070474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:02.070474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:02.070474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:02.070474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:02.070474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:02.070474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:02.070474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:19:02.070474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:19:02.070474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:19:02.070474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:19:02.071700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:02.071700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:02.071700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:19:02.071700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:02.071700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:19:02.071700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:02.071700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:02.071700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:02.071700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:02.071700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:02.071700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:02.071700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:02.071700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:02.071700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:02.071700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:02.071700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:02.071700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:02.071700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:02.072913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:02.072913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:02.072913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:19:02.072913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:19:02.072913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:19:02.072913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:19:02.072913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:19:02.072913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:19:02.072913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 16:19:02.072913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:02.075039 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 299/618] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:19:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:19:02.076484 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a3f67-1b63-4f30-b430-45300ff33bc4 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:02.076951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a3f67-1b63-4f30-b430-45300ff33bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:02.077417 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a3f67-1b63-4f30-b430-45300ff33bc4 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:02.077709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c039e7-de58-43ef-a4f3-b8579f475572 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:02.079396 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 300/619] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:02.083131 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a3f67-1b63-4f30-b430-45300ff33bc4 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:02.117237 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cafe470-c0d4-42a0-9526-d44699b8efaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:02.117875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafe470-c0d4-42a0-9526-d44699b8efaf None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:02.118150 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafe470-c0d4-42a0-9526-d44699b8efaf None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:02.118420 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafe470-c0d4-42a0-9526-d44699b8efaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:02.130597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cafe470-c0d4-42a0-9526-d44699b8efaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:02.131547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cafe470-c0d4-42a0-9526-d44699b8efaf None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:02.146705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-2cafe470-c0d4-42a0-9526-d44699b8efaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:02.146705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:02.146705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:02.146705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:02.146705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:02.146705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:02.146705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:02.146705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:02.146705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:02.146705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:02.146705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:02.146705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:02.146705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:02.146705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:02.146705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:02.146705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:02.147730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:02.147730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:02.147730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:02.147730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:02.147730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:02.147730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:02.147730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:02.147730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:02.147730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:02.147730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:02.147730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:02.147730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:02.147730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:02.147730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:02.147730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:02.147730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:02.147730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:02.148660 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:02.148660 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:02.148660 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:02.148660 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 320/620] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:02.149508 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60cb63-adc2-4d41-a46d-96d30e0aa8ee None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:02.149788 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60cb63-adc2-4d41-a46d-96d30e0aa8ee None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:02.150057 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60cb63-adc2-4d41-a46d-96d30e0aa8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:02.169804 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-8c60cb63-adc2-4d41-a46d-96d30e0aa8ee None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:02.171018 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8c60cb63-adc2-4d41-a46d-96d30e0aa8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:02.190179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:02.222656 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a3f67-1b63-4f30-b430-45300ff33bc4 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:02.241257 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 321/621] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:19:02.251742 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60cb63-adc2-4d41-a46d-96d30e0aa8ee None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:02.284419 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15892012-8e39-4ee3-8197-d4c84802150f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:02.285030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15892012-8e39-4ee3-8197-d4c84802150f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:02.285304 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15892012-8e39-4ee3-8197-d4c84802150f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:02.285570 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15892012-8e39-4ee3-8197-d4c84802150f None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:02.286301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15892012-8e39-4ee3-8197-d4c84802150f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:02.286599 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15892012-8e39-4ee3-8197-d4c84802150f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:02.288071 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15892012-8e39-4ee3-8197-d4c84802150f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:02.319861 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:02.321431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 301/622] 10.222.0.55 () {56 vars in 1135 bytes} [Tue Oct 4 16:19:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:02.328928 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15892012-8e39-4ee3-8197-d4c84802150f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:02.407492 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60cb63-adc2-4d41-a46d-96d30e0aa8ee None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:02.463375 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b1929-3054-4d85-86b4-09f87128a9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:02.463998 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b1929-3054-4d85-86b4-09f87128a9bb None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:02.464355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b1929-3054-4d85-86b4-09f87128a9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:02.464625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b1929-3054-4d85-86b4-09f87128a9bb None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:02.465278 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b1929-3054-4d85-86b4-09f87128a9bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:02.465578 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b1929-3054-4d85-86b4-09f87128a9bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:02.466952 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b1929-3054-4d85-86b4-09f87128a9bb None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:02.489994 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 322/623] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:02.495921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b1929-3054-4d85-86b4-09f87128a9bb None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:02.508030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15892012-8e39-4ee3-8197-d4c84802150f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:02.577571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e6ec2-fa7b-4d2c-8a43-5c43f5173a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:02.578240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e6ec2-fa7b-4d2c-8a43-5c43f5173a5d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:02.578509 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e6ec2-fa7b-4d2c-8a43-5c43f5173a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:02.578779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e6ec2-fa7b-4d2c-8a43-5c43f5173a5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:02.584185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:02.595429 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e6ec2-fa7b-4d2c-8a43-5c43f5173a5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:02.597731 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e6ec2-fa7b-4d2c-8a43-5c43f5173a5d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:02.617651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-e07e6ec2-fa7b-4d2c-8a43-5c43f5173a5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:02.617651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:02.617651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:02.617651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:02.617651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:02.617651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:02.617651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:02.617651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:02.617651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:02.617651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:02.617651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:02.617651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:02.617651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:02.617651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:02.617651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:02.617651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:02.618652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:02.618652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:02.618652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:02.618652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:02.618652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:02.618652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:02.618652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:02.618652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:02.618652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:02.618652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:02.618652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:02.618652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:02.618652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:02.618652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:02.618652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:02.618652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:02.618652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:02.619629 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:02.619629 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:02.619629 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:02.621875 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 302/624] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:02.627703 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e6ec2-fa7b-4d2c-8a43-5c43f5173a5d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:02.653023 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b1929-3054-4d85-86b4-09f87128a9bb None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:02.655311 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:02.695126 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8646db-703a-4aca-b7c3-a35fa220556b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:02.695621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8646db-703a-4aca-b7c3-a35fa220556b None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:02.695898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8646db-703a-4aca-b7c3-a35fa220556b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:02.696168 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8646db-703a-4aca-b7c3-a35fa220556b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:02.705123 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8646db-703a-4aca-b7c3-a35fa220556b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:02.706679 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8646db-703a-4aca-b7c3-a35fa220556b None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:02.720793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-3d8646db-703a-4aca-b7c3-a35fa220556b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 16:19:02.720793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:02.720793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:02.720793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:02.720793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:02.720793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:02.720793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:02.720793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:02.720793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:02.720793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:02.720793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:02.720793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:02.720793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:19:02.720793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:19:02.720793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:19:02.720793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:19:02.721868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:02.721868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:02.721868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:19:02.721868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:02.721868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:19:02.721868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:02.721868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:02.721868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:02.721868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:02.721868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:02.721868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:02.721868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:02.721868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:02.721868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:02.721868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:02.721868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:02.721868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:02.721868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:02.722834 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:02.722834 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:02.722834 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:19:02.722834 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:19:02.722834 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:19:02.722834 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:19:02.722834 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:19:02.722834 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:19:02.722834 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 16:19:02.722834 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:02.722834 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 323/625] 10.222.0.55 () {56 vars in 1093 bytes} [Tue Oct 4 16:19:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:02.723983 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8646db-703a-4aca-b7c3-a35fa220556b None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:02.749710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e6ec2-fa7b-4d2c-8a43-5c43f5173a5d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:02.788763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b907cc4-3282-4e16-b85a-d0ea29638b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:02.789853 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b907cc4-3282-4e16-b85a-d0ea29638b3e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:02.790347 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b907cc4-3282-4e16-b85a-d0ea29638b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:02.790816 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b907cc4-3282-4e16-b85a-d0ea29638b3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:02.807229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b907cc4-3282-4e16-b85a-d0ea29638b3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:19:02.815994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-1b907cc4-3282-4e16-b85a-d0ea29638b3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:19:02.815994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:02.815994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:02.815994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:02.815994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:02.815994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:02.815994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:02.815994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:02.815994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:02.815994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:02.815994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:02.815994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:02.815994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:19:02.815994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:19:02.815994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:19:02.815994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:19:02.817459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:19:02.817459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:19:02.817459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:19:02.817459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:19:02.817459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:02.817459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:02.817459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:02.817459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:02.817459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:02.817459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:02.817459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:02.817459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:02.817459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:02.817459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:02.817459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:02.817459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:02.818302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:02.818302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:02.818302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:02.818302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:02.818302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:19:02.818302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:19:02.818302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:19:02.818302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:19:02.818302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:19:02.818302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:19:02.818302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:19:02.818302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:02.818302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 303/626] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Oct 4 16:19:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:02.819553 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b907cc4-3282-4e16-b85a-d0ea29638b3e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:02.845220 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8646db-703a-4aca-b7c3-a35fa220556b None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:02.893780 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7225c-f063-46f7-aa7f-8b8999fe7486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:02.895154 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:02.896572 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7225c-f063-46f7-aa7f-8b8999fe7486 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:02.897228 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7225c-f063-46f7-aa7f-8b8999fe7486 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:02.897791 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7225c-f063-46f7-aa7f-8b8999fe7486 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:02.898690 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7225c-f063-46f7-aa7f-8b8999fe7486 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:02.899338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7225c-f063-46f7-aa7f-8b8999fe7486 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:02.902456 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7225c-f063-46f7-aa7f-8b8999fe7486 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:02.928797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 324/627] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:02.930717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7225c-f063-46f7-aa7f-8b8999fe7486 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:02.971090 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:02.974399 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b907cc4-3282-4e16-b85a-d0ea29638b3e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:03.027669 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e883d-079f-4d51-a14f-06f3d21a7eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:03.028329 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e883d-079f-4d51-a14f-06f3d21a7eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:03.028601 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e883d-079f-4d51-a14f-06f3d21a7eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:03.028874 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e883d-079f-4d51-a14f-06f3d21a7eb9 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:03.029608 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e883d-079f-4d51-a14f-06f3d21a7eb9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:03.029913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e883d-079f-4d51-a14f-06f3d21a7eb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:03.031408 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e883d-079f-4d51-a14f-06f3d21a7eb9 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:03.055996 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 304/628] 10.222.0.55 () {56 vars in 1133 bytes} [Tue Oct 4 16:19:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:03.055996 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7a42f-83c3-4fed-8540-fe2221c1aff6 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:03.055996 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7a42f-83c3-4fed-8540-fe2221c1aff6 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:03.055996 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7a42f-83c3-4fed-8540-fe2221c1aff6 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:03.055996 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 305/629] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:03.055996 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7a42f-83c3-4fed-8540-fe2221c1aff6 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:03.089337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7225c-f063-46f7-aa7f-8b8999fe7486 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:03.126665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cf5e1-a3c9-48d6-ac17-c2e46f7fdb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:03.127320 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cf5e1-a3c9-48d6-ac17-c2e46f7fdb11 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:03.127596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cf5e1-a3c9-48d6-ac17-c2e46f7fdb11 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:03.127859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cf5e1-a3c9-48d6-ac17-c2e46f7fdb11 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:03.128524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7cf5e1-a3c9-48d6-ac17-c2e46f7fdb11 None admin] RBAC: Adding query filter params (name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:03.128818 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7cf5e1-a3c9-48d6-ac17-c2e46f7fdb11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:03.130847 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7cf5e1-a3c9-48d6-ac17-c2e46f7fdb11 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:03.141366 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 325/630] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Oct 4 16:19:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:03.142232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cf5e1-a3c9-48d6-ac17-c2e46f7fdb11 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:03.171580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7a42f-83c3-4fed-8540-fe2221c1aff6 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:03.180196 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:03.207760 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25218e4a-e98a-400a-abe5-ccc9d4040614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:03.208497 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25218e4a-e98a-400a-abe5-ccc9d4040614 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:03.208768 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25218e4a-e98a-400a-abe5-ccc9d4040614 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:03.209035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25218e4a-e98a-400a-abe5-ccc9d4040614 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:03.216708 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25218e4a-e98a-400a-abe5-ccc9d4040614 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:03.218396 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25218e4a-e98a-400a-abe5-ccc9d4040614 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:03.230874 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-25218e4a-e98a-400a-abe5-ccc9d4040614 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:03.230874 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:03.230874 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:03.230874 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:03.230874 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:03.230874 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:03.230874 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:03.230874 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:03.230874 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:03.230874 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:03.230874 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:03.230874 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:03.230874 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:19:03.230874 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:19:03.230874 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:19:03.236687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:19:03.236687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:03.236687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:03.236687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:03.236687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:03.236687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:03.236687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:03.236687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:03.236687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:03.236687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:03.236687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:03.236687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:03.236687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:03.236687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:03.236687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:03.236687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:03.236687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:03.237597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:19:03.237597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:19:03.237597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:19:03.237597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:19:03.237597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:19:03.237597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:19:03.237597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:03.237597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:03.237597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 306/631] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:19:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:03.237597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c497be-3764-4286-943f-30d46ea50f44 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:03.237597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c497be-3764-4286-943f-30d46ea50f44 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:03.238186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c497be-3764-4286-943f-30d46ea50f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:03.250624 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:03.254075 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-09c497be-3764-4286-943f-30d46ea50f44 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:03.255452 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-09c497be-3764-4286-943f-30d46ea50f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:03.270666 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cf5e1-a3c9-48d6-ac17-c2e46f7fdb11 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:03.309542 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ec4f1-1739-430a-9f05-7d97d0fec5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:03.310166 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ec4f1-1739-430a-9f05-7d97d0fec5d7 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:03.310541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ec4f1-1739-430a-9f05-7d97d0fec5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:03.310709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ec4f1-1739-430a-9f05-7d97d0fec5d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:03.331026 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 307/632] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:19:03.343962 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c497be-3764-4286-943f-30d46ea50f44 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:03.394440 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ec4f1-1739-430a-9f05-7d97d0fec5d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:03.396669 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ec4f1-1739-430a-9f05-7d97d0fec5d7 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:03.454015 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:03.462525 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c497be-3764-4286-943f-30d46ea50f44 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:03.518370 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16130783-22d0-41b4-b3c0-11f03c832643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:03.519615 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16130783-22d0-41b4-b3c0-11f03c832643 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:03.520198 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16130783-22d0-41b4-b3c0-11f03c832643 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:03.520790 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16130783-22d0-41b4-b3c0-11f03c832643 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:03.521502 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:03.540680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16130783-22d0-41b4-b3c0-11f03c832643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:03.547558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16130783-22d0-41b4-b3c0-11f03c832643 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:03.548122 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 326/633] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:19:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:19:03.549237 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ec4f1-1739-430a-9f05-7d97d0fec5d7 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:03.564660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-16130783-22d0-41b4-b3c0-11f03c832643 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:03.564660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:03.564660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:03.564660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:03.564660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:03.564660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:03.564660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:03.564660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:03.564660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:03.564660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:03.564660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:03.564660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:03.564660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:03.564660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:03.564660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:03.564660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:03.565667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:03.565667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:03.565667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:03.565667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:03.565667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:03.565667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:03.565667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:03.565667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:03.565667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:03.565667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:03.565667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:03.565667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:03.565667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:03.565667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:03.565667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:03.565667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:03.565667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:03.566548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:03.566548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:03.566548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:03.570612 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 308/634] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:03.571693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16130783-22d0-41b4-b3c0-11f03c832643 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:03.656968 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ec4f1-1739-430a-9f05-7d97d0fec5d7 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:03.677948 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16130783-22d0-41b4-b3c0-11f03c832643 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:03.701312 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869e0ca-5c1c-4da5-b721-393291f6f194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:03.701929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869e0ca-5c1c-4da5-b721-393291f6f194 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:03.702212 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869e0ca-5c1c-4da5-b721-393291f6f194 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:03.702477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869e0ca-5c1c-4da5-b721-393291f6f194 None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:03.703223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869e0ca-5c1c-4da5-b721-393291f6f194 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:03.703538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869e0ca-5c1c-4da5-b721-393291f6f194 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:03.705071 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869e0ca-5c1c-4da5-b721-393291f6f194 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:03.719873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 327/635] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:19:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:03.721166 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0c5ba-fb2c-4a89-93f6-e499ad6bd8dc None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:03.721461 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0c5ba-fb2c-4a89-93f6-e499ad6bd8dc None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:03.721745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0c5ba-fb2c-4a89-93f6-e499ad6bd8dc None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:03.723596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 328/636] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:03.724075 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0c5ba-fb2c-4a89-93f6-e499ad6bd8dc None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:03.730026 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020cc00-8d6a-4c6f-bc3c-aaff57ab9f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:03.730683 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020cc00-8d6a-4c6f-bc3c-aaff57ab9f88 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:03.730958 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020cc00-8d6a-4c6f-bc3c-aaff57ab9f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:03.731262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020cc00-8d6a-4c6f-bc3c-aaff57ab9f88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:03.742151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020cc00-8d6a-4c6f-bc3c-aaff57ab9f88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:03.743643 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020cc00-8d6a-4c6f-bc3c-aaff57ab9f88 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:03.751642 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:03.758855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-f020cc00-8d6a-4c6f-bc3c-aaff57ab9f88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:03.758855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:03.758855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:03.758855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:03.758855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:03.758855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:03.758855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:03.758855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:03.758855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:03.758855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:03.758855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:03.758855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:03.758855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:03.758855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:03.758855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:03.758855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:03.760112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:03.760112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:03.760112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:03.760112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:03.760112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:03.760112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:03.760112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:03.760112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:03.760112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:03.760112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:03.760112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:03.760112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:03.760112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:03.760112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:03.760112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:03.760112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:03.760112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:03.761111 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:03.761111 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:03.761111 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:03.761111 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 309/637] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:03.762025 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020cc00-8d6a-4c6f-bc3c-aaff57ab9f88 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:03.776190 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:03.841846 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0c5ba-fb2c-4a89-93f6-e499ad6bd8dc None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:03.874810 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020cc00-8d6a-4c6f-bc3c-aaff57ab9f88 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:03.876656 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a05b8c-d4fa-47a7-ac59-5311ba434d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:03.877275 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a05b8c-d4fa-47a7-ac59-5311ba434d90 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:03.877553 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a05b8c-d4fa-47a7-ac59-5311ba434d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:03.877824 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a05b8c-d4fa-47a7-ac59-5311ba434d90 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:03.878469 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a05b8c-d4fa-47a7-ac59-5311ba434d90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:03.878766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a05b8c-d4fa-47a7-ac59-5311ba434d90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:03.880200 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a05b8c-d4fa-47a7-ac59-5311ba434d90 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:03.891906 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 329/638] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:03.892723 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a05b8c-d4fa-47a7-ac59-5311ba434d90 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:03.910661 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb97c4-26e5-4bf8-bb3b-30e61c8df94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:03.911347 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb97c4-26e5-4bf8-bb3b-30e61c8df94f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:03.911625 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb97c4-26e5-4bf8-bb3b-30e61c8df94f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:03.911900 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb97c4-26e5-4bf8-bb3b-30e61c8df94f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:03.924248 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb97c4-26e5-4bf8-bb3b-30e61c8df94f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:19:03.930481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-a9eb97c4-26e5-4bf8-bb3b-30e61c8df94f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:19:03.930481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:03.930481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:03.930481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:03.930481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:03.930481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:03.930481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:03.930481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:03.930481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:03.930481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:03.930481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:03.930481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:03.930481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:19:03.930481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:19:03.930481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:19:03.930481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:19:03.931463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:19:03.931463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:19:03.931463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:19:03.931463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:19:03.931463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:03.931463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:03.931463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:03.931463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:03.931463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:03.931463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:03.931463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:03.931463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:03.931463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:03.931463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:03.931463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:03.931463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:03.932334 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:03.932334 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:03.932334 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:03.932334 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:03.932334 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:19:03.932334 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:19:03.932334 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:19:03.932334 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:19:03.932334 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:19:03.932334 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:19:03.932334 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:19:03.932334 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:03.932334 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 310/639] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Oct 4 16:19:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:03.933084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b03d1-726e-43d2-b68d-d836ebde26a7 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:03.933172 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b03d1-726e-43d2-b68d-d836ebde26a7 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:03.933495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b03d1-726e-43d2-b68d-d836ebde26a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:03.951604 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-c44b03d1-726e-43d2-b68d-d836ebde26a7 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:03.952841 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c44b03d1-726e-43d2-b68d-d836ebde26a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:03.997117 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a05b8c-d4fa-47a7-ac59-5311ba434d90 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:03.999529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:04.011350 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:04.024004 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 311/640] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:19:04.025089 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b03d1-726e-43d2-b68d-d836ebde26a7 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:04.034480 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8149c-8151-4611-bd10-63f38d49db08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:04.035123 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8149c-8151-4611-bd10-63f38d49db08 None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:04.035401 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8149c-8151-4611-bd10-63f38d49db08 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:04.035672 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8149c-8151-4611-bd10-63f38d49db08 None admin] PATH_INFO: `/v3/projects/e480e782c4fa403a913ca7179db0843b/users/6590cb6c1c964039b9dea771a647bdac/roles/2165a726b4034e1584166027f2361b5f` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:04.053165 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8149c-8151-4611-bd10-63f38d49db08 None admin] RBAC: Authorizing `identity:create_grant(project_id=e480e782c4fa403a913ca7179db0843b, user_id=6590cb6c1c964039b9dea771a647bdac, role_id=2165a726b4034e1584166027f2361b5f)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:04.054622 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8149c-8151-4611-bd10-63f38d49db08 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:04.071708 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 330/641] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Oct 4 16:19:03 2022] PUT /identity/v3/projects/e480e782c4fa403a913ca7179db0843b/users/6590cb6c1c964039b9dea771a647bdac/roles/2165a726b4034e1584166027f2361b5f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:19:04.084008 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8149c-8151-4611-bd10-63f38d49db08 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:04.155587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b03d1-726e-43d2-b68d-d836ebde26a7 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:04.197899 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7609c1-ef31-49f6-a548-3eb7fb89112e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:04.199233 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7609c1-ef31-49f6-a548-3eb7fb89112e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:04.199913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7609c1-ef31-49f6-a548-3eb7fb89112e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:04.200408 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7609c1-ef31-49f6-a548-3eb7fb89112e None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:04.201372 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7609c1-ef31-49f6-a548-3eb7fb89112e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:04.201880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7609c1-ef31-49f6-a548-3eb7fb89112e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:04.203664 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7609c1-ef31-49f6-a548-3eb7fb89112e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:04.218309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 312/642] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:04.219868 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7609c1-ef31-49f6-a548-3eb7fb89112e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:04.242655 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8149c-8151-4611-bd10-63f38d49db08 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:04.285719 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847ad76-3758-4a61-b30d-82065d7074e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:04.286290 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847ad76-3758-4a61-b30d-82065d7074e5 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:04.286562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847ad76-3758-4a61-b30d-82065d7074e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:04.286863 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847ad76-3758-4a61-b30d-82065d7074e5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:04.294197 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:04.296124 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847ad76-3758-4a61-b30d-82065d7074e5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:04.297167 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847ad76-3758-4a61-b30d-82065d7074e5 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:04.311498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-b847ad76-3758-4a61-b30d-82065d7074e5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 16:19:04.311498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:04.311498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:04.311498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:04.311498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:04.311498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:04.311498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:04.311498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:04.311498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:04.311498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:04.311498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:04.311498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:04.311498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:19:04.311498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:19:04.311498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:19:04.311498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:19:04.312593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:04.312593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:04.312593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:19:04.312593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:04.312593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:19:04.312593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:04.312593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:04.312593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:04.312593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:04.312593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:04.312593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:04.312593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:04.312593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:04.312593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:04.312593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:04.312593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:04.312593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:04.312593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:04.313584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:04.313584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:04.313584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:19:04.313584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:19:04.313584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:19:04.313584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:19:04.313584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:19:04.313584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:19:04.313584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 16:19:04.313584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:04.313584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 331/643] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:19:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:04.313584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847ad76-3758-4a61-b30d-82065d7074e5 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:04.331417 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:04.357994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7609c1-ef31-49f6-a548-3eb7fb89112e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:04.393775 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b3006-4e78-4122-b402-f51db16cde51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:04.394688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b3006-4e78-4122-b402-f51db16cde51 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:04.395191 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b3006-4e78-4122-b402-f51db16cde51 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:04.395660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b3006-4e78-4122-b402-f51db16cde51 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:04.396828 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b3006-4e78-4122-b402-f51db16cde51 None admin] RBAC: Adding query filter params (name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:04.397598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b3006-4e78-4122-b402-f51db16cde51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:04.399582 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b3006-4e78-4122-b402-f51db16cde51 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:04.418433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 313/644] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Oct 4 16:19:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:04.418433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b3006-4e78-4122-b402-f51db16cde51 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:04.457417 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847ad76-3758-4a61-b30d-82065d7074e5 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:04.512976 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bb9fd-daa5-4198-96b8-46d0f241a98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:04.513622 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bb9fd-daa5-4198-96b8-46d0f241a98f None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:04.513900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bb9fd-daa5-4198-96b8-46d0f241a98f None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:04.514171 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bb9fd-daa5-4198-96b8-46d0f241a98f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:04.521955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bb9fd-daa5-4198-96b8-46d0f241a98f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:04.523459 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bb9fd-daa5-4198-96b8-46d0f241a98f None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:04.536662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-0f9bb9fd-daa5-4198-96b8-46d0f241a98f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:04.536662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:04.536662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:04.536662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:04.536662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:04.536662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:04.536662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:04.536662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:04.536662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:04.536662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:04.536662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:04.536662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:04.536662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:19:04.536662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:19:04.536662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:19:04.537595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:19:04.537595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:04.537595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:04.537595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:04.537595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:04.537595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:04.537595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:04.537595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:04.537595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:04.537595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:04.537595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:04.537595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:04.537595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:04.537595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:04.537595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:04.537595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:04.537595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:04.538659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:19:04.538659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:19:04.538659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:19:04.538659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:19:04.538659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:19:04.538659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:19:04.538659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:04.538659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:04.538659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 332/645] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:19:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:04.538659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bb9fd-daa5-4198-96b8-46d0f241a98f None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:04.548143 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b3006-4e78-4122-b402-f51db16cde51 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:04.562559 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:04.596919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c213c-1844-4e9e-8dd2-dbf48840b620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:04.597563 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c213c-1844-4e9e-8dd2-dbf48840b620 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:04.597835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c213c-1844-4e9e-8dd2-dbf48840b620 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:04.598102 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c213c-1844-4e9e-8dd2-dbf48840b620 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:04.609232 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c213c-1844-4e9e-8dd2-dbf48840b620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:19:04.614564 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-4b7c213c-1844-4e9e-8dd2-dbf48840b620 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:19:04.614564 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:04.614564 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:04.614564 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:04.614564 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:04.614564 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:04.614564 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:04.614564 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:04.614564 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:04.614564 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:04.614564 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:04.614564 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:04.614564 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:19:04.614564 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:19:04.614564 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:19:04.614564 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:19:04.615581 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:19:04.615581 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:19:04.615581 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:19:04.615581 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:19:04.615581 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:04.615581 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:04.615581 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:04.615581 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:04.615581 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:04.615581 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:04.615581 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:04.615581 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:04.615581 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:04.615581 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:04.615581 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:04.615581 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:04.616426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:04.616426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:04.616426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:04.616426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:04.616426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:19:04.616426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:19:04.616426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:19:04.616426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:19:04.616426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:19:04.616426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:19:04.616426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:19:04.616426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:04.616426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 314/646] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Oct 4 16:19:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:04.617786 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c213c-1844-4e9e-8dd2-dbf48840b620 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:04.631801 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:04.664129 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bb9fd-daa5-4198-96b8-46d0f241a98f None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:04.704182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc200a0-d2ea-4300-bec4-c004f7755d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:04.704900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc200a0-d2ea-4300-bec4-c004f7755d78 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:04.705177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc200a0-d2ea-4300-bec4-c004f7755d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:04.705559 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc200a0-d2ea-4300-bec4-c004f7755d78 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:04.706303 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc200a0-d2ea-4300-bec4-c004f7755d78 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:04.706611 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc200a0-d2ea-4300-bec4-c004f7755d78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:04.708088 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc200a0-d2ea-4300-bec4-c004f7755d78 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:04.720818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c213c-1844-4e9e-8dd2-dbf48840b620 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:04.732393 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 333/647] 10.222.0.55 () {56 vars in 1137 bytes} [Tue Oct 4 16:19:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:04.733339 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc200a0-d2ea-4300-bec4-c004f7755d78 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:04.757991 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc3d56-6427-42db-9068-f2e4d1fe93e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:04.758810 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc3d56-6427-42db-9068-f2e4d1fe93e1 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:04.759218 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc3d56-6427-42db-9068-f2e4d1fe93e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:04.759588 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc3d56-6427-42db-9068-f2e4d1fe93e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:04.772209 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc3d56-6427-42db-9068-f2e4d1fe93e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:04.773848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc3d56-6427-42db-9068-f2e4d1fe93e1 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:04.788944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-50bc3d56-6427-42db-9068-f2e4d1fe93e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:04.788944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:04.788944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:04.788944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:04.788944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:04.788944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:04.788944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:04.788944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:04.788944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:04.788944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:04.788944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:04.788944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:04.788944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:04.788944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:04.788944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:04.788944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:04.790117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:04.790117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:04.790117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:04.790117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:04.790117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:04.790117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:04.790117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:04.790117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:04.790117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:04.790117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:04.790117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:04.790117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:04.790117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:04.790117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:04.790117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:04.790117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:04.790117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:04.791266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:04.791266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:04.791266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:04.791692 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 315/648] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:04.797500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc3d56-6427-42db-9068-f2e4d1fe93e1 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:04.832261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:04.867708 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc200a0-d2ea-4300-bec4-c004f7755d78 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:04.899787 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:04.905873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbaf72-8e46-45c3-95b4-ed83b11d6e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:04.906650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbaf72-8e46-45c3-95b4-ed83b11d6e7e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:04.907293 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbaf72-8e46-45c3-95b4-ed83b11d6e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:04.907568 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbaf72-8e46-45c3-95b4-ed83b11d6e7e None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:04.908408 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddbaf72-8e46-45c3-95b4-ed83b11d6e7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:04.908706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddbaf72-8e46-45c3-95b4-ed83b11d6e7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:04.910149 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddbaf72-8e46-45c3-95b4-ed83b11d6e7e None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:04.918396 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc3d56-6427-42db-9068-f2e4d1fe93e1 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:04.927758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 334/649] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:19:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:04.927758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbaf72-8e46-45c3-95b4-ed83b11d6e7e None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:04.955424 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ce520-c544-4323-ae20-e669d33f154c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:04.956031 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ce520-c544-4323-ae20-e669d33f154c None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:04.956303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ce520-c544-4323-ae20-e669d33f154c None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:04.956563 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ce520-c544-4323-ae20-e669d33f154c None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:04.957220 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ce520-c544-4323-ae20-e669d33f154c None admin] RBAC: Adding query filter params (name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:04.957513 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ce520-c544-4323-ae20-e669d33f154c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:04.958887 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ce520-c544-4323-ae20-e669d33f154c None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:04.973268 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 316/650] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Oct 4 16:19:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:04.973268 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ce520-c544-4323-ae20-e669d33f154c None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:05.048457 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbaf72-8e46-45c3-95b4-ed83b11d6e7e None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:05.072857 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:05.088904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ce520-c544-4323-ae20-e669d33f154c None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:05.089537 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253872ef-d08e-47e8-9ca1-96c355448ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:05.090158 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253872ef-d08e-47e8-9ca1-96c355448ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:05.090546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253872ef-d08e-47e8-9ca1-96c355448ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:05.090872 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253872ef-d08e-47e8-9ca1-96c355448ef6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:05.129200 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85b498-883d-4e71-8a39-ae659276324e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:05.130171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85b498-883d-4e71-8a39-ae659276324e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:05.130609 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85b498-883d-4e71-8a39-ae659276324e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:05.131411 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85b498-883d-4e71-8a39-ae659276324e None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:05.131862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85b498-883d-4e71-8a39-ae659276324e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:05.132357 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85b498-883d-4e71-8a39-ae659276324e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:05.134674 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85b498-883d-4e71-8a39-ae659276324e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:05.161018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 317/651] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:05.161018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85b498-883d-4e71-8a39-ae659276324e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:05.188659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:05.201915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253872ef-d08e-47e8-9ca1-96c355448ef6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:05.204314 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253872ef-d08e-47e8-9ca1-96c355448ef6 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:05.277411 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85b498-883d-4e71-8a39-ae659276324e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:05.319991 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49433f-b1f1-4307-85b4-c450f3d9e1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:05.320617 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49433f-b1f1-4307-85b4-c450f3d9e1b3 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:05.320891 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49433f-b1f1-4307-85b4-c450f3d9e1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:05.321158 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49433f-b1f1-4307-85b4-c450f3d9e1b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:05.321897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49433f-b1f1-4307-85b4-c450f3d9e1b3 None admin] RBAC: Adding query filter params (role.id=2165a726b4034e1584166027f2361b5f, scope.project.id=e480e782c4fa403a913ca7179db0843b, user.id=6cdee0584fe045028a44c385d032d2c7) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:05.322193 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49433f-b1f1-4307-85b4-c450f3d9e1b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:05.323814 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49433f-b1f1-4307-85b4-c450f3d9e1b3 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:05.339042 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 318/652] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:19:05 2022] GET /identity/v3/role_assignments?user.id=6cdee0584fe045028a44c385d032d2c7&scope.project.id=e480e782c4fa403a913ca7179db0843b&role.id=2165a726b4034e1584166027f2361b5f => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:05.339042 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49433f-b1f1-4307-85b4-c450f3d9e1b3 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:05.344402 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 335/653] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:19:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:19:05.345337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253872ef-d08e-47e8-9ca1-96c355448ef6 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:05.359799 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:05.476951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49433f-b1f1-4307-85b4-c450f3d9e1b3 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:05.487441 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:05.499600 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253872ef-d08e-47e8-9ca1-96c355448ef6 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:05.524062 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04271d-68cb-4ab8-ba9f-2353215e24e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:05.524717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04271d-68cb-4ab8-ba9f-2353215e24e7 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:05.524986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04271d-68cb-4ab8-ba9f-2353215e24e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:05.525249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04271d-68cb-4ab8-ba9f-2353215e24e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:05.539462 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04271d-68cb-4ab8-ba9f-2353215e24e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:05.541059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04271d-68cb-4ab8-ba9f-2353215e24e7 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:05.541513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a367b-bbbd-42af-9744-220528e9d983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:05.542469 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a367b-bbbd-42af-9744-220528e9d983 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:05.542937 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a367b-bbbd-42af-9744-220528e9d983 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:05.543436 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a367b-bbbd-42af-9744-220528e9d983 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:05.553098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a367b-bbbd-42af-9744-220528e9d983 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:05.555069 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a367b-bbbd-42af-9744-220528e9d983 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:05.557765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-ea04271d-68cb-4ab8-ba9f-2353215e24e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:05.557765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:05.557765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:05.557765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:05.557765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:05.557765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:05.557765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:05.557765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:05.557765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:05.557765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:05.557765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:05.557765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:05.557765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:05.557765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:05.557765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:05.557765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:05.558894 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:05.558894 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:05.558894 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:05.558894 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:05.558894 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:05.558894 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:05.558894 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:05.558894 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:05.558894 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:05.558894 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:05.558894 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:05.558894 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:05.558894 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:05.558894 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:05.558894 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:05.558894 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:05.558894 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:05.560323 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:05.560323 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:05.560323 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:05.560323 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 319/654] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:05.560323 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04271d-68cb-4ab8-ba9f-2353215e24e7 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:05.572732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-4b2a367b-bbbd-42af-9744-220528e9d983 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 16:19:05.572732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:05.572732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:05.572732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:05.572732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:05.572732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:05.572732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:05.572732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:05.572732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:05.572732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:05.572732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:05.572732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:05.572732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:19:05.572732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:19:05.572732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:19:05.572732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:19:05.573859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:05.573859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:05.573859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:19:05.573859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:05.573859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:19:05.573859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:05.573859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:05.573859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:05.573859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:05.573859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:05.573859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:05.573859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:05.573859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:05.573859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:05.573859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:05.573859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:05.573859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:05.573859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:05.574813 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:05.574813 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:05.574813 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:19:05.574813 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:19:05.574813 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:19:05.574813 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:19:05.574813 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:19:05.574813 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:19:05.574813 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 16:19:05.574813 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:05.577356 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 336/655] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:19:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:05.578371 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a367b-bbbd-42af-9744-220528e9d983 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:05.628537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:05.685243 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04271d-68cb-4ab8-ba9f-2353215e24e7 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:05.713046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a367b-bbbd-42af-9744-220528e9d983 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:05.725131 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b533fd7-7ba0-474c-b026-a9cf689590da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:05.725789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b533fd7-7ba0-474c-b026-a9cf689590da None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:05.726053 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b533fd7-7ba0-474c-b026-a9cf689590da None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:05.726304 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b533fd7-7ba0-474c-b026-a9cf689590da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:05.741310 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b533fd7-7ba0-474c-b026-a9cf689590da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:05.742793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b533fd7-7ba0-474c-b026-a9cf689590da None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:05.758416 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-4b533fd7-7ba0-474c-b026-a9cf689590da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:05.758416 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:05.758416 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:05.758416 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:05.758416 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:05.758416 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:05.758416 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:05.758416 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:05.758416 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:05.758416 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:05.758416 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:05.758416 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:05.758416 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:05.758416 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:05.758416 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:05.758416 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:05.759555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:05.759555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:05.759555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:05.759555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:05.759555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:05.759555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:05.759555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:05.759555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:05.759555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:05.759555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:05.759555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:05.759555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:05.759555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:05.759555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:05.759555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:05.759555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:05.759555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:05.761151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:05.761151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:05.761151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:05.761151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 320/656] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:05.761151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b533fd7-7ba0-474c-b026-a9cf689590da None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:05.766688 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79256b-0034-4318-830b-7d36a01e811c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:05.767953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79256b-0034-4318-830b-7d36a01e811c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:05.768439 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79256b-0034-4318-830b-7d36a01e811c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:05.768953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79256b-0034-4318-830b-7d36a01e811c None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:05.769871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79256b-0034-4318-830b-7d36a01e811c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:05.770425 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79256b-0034-4318-830b-7d36a01e811c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:05.773130 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79256b-0034-4318-830b-7d36a01e811c None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:05.791303 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 337/657] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:05.792927 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79256b-0034-4318-830b-7d36a01e811c None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:05.823534 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:05.877915 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b533fd7-7ba0-474c-b026-a9cf689590da None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:05.893714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:05.915147 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52e143-8da7-482c-9d5b-bd3de4c6ed3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:05.915857 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52e143-8da7-482c-9d5b-bd3de4c6ed3c None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:05.916235 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52e143-8da7-482c-9d5b-bd3de4c6ed3c None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:05.916569 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52e143-8da7-482c-9d5b-bd3de4c6ed3c None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:05.917406 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52e143-8da7-482c-9d5b-bd3de4c6ed3c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:05.917772 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52e143-8da7-482c-9d5b-bd3de4c6ed3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:05.919306 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52e143-8da7-482c-9d5b-bd3de4c6ed3c None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:05.935619 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79256b-0034-4318-830b-7d36a01e811c None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:05.942789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 321/658] 10.222.0.55 () {56 vars in 1137 bytes} [Tue Oct 4 16:19:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:05.943872 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52e143-8da7-482c-9d5b-bd3de4c6ed3c None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:05.982671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d28e7f-3012-4dbc-8e9c-5861dd6aaa24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:05.983899 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d28e7f-3012-4dbc-8e9c-5861dd6aaa24 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:05.985265 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d28e7f-3012-4dbc-8e9c-5861dd6aaa24 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:05.985723 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d28e7f-3012-4dbc-8e9c-5861dd6aaa24 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:05.986587 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d28e7f-3012-4dbc-8e9c-5861dd6aaa24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:05.987087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d28e7f-3012-4dbc-8e9c-5861dd6aaa24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:05.988654 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d28e7f-3012-4dbc-8e9c-5861dd6aaa24 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:06.005144 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 338/659] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:06.006550 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d28e7f-3012-4dbc-8e9c-5861dd6aaa24 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:06.054675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52e143-8da7-482c-9d5b-bd3de4c6ed3c None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:06.092555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d4efc-0dec-48a5-b166-20b69beda0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:06.093279 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d4efc-0dec-48a5-b166-20b69beda0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:06.093773 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d4efc-0dec-48a5-b166-20b69beda0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:06.094197 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d4efc-0dec-48a5-b166-20b69beda0e0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:06.104468 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:06.104686 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d4efc-0dec-48a5-b166-20b69beda0e0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:06.107480 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d4efc-0dec-48a5-b166-20b69beda0e0 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:06.124006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-8b7d4efc-0dec-48a5-b166-20b69beda0e0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 16:19:06.124006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:06.124006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:06.124006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:06.124006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:06.124006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:06.124006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:06.124006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:06.124006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:06.124006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:06.124006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:06.124006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:06.124006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:19:06.124006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:19:06.124006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:19:06.124006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:19:06.125049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:06.125049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:06.125049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:19:06.125049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:06.125049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:19:06.125049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:06.125049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:06.125049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:06.125049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:06.125049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:06.125049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:06.125049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:06.125049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:06.125049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:06.125049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:06.125049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:06.125049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:06.125049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:06.126175 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:06.126175 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:06.126175 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:19:06.126175 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:19:06.126175 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:19:06.126175 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:19:06.126175 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:19:06.126175 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:19:06.126175 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 16:19:06.126175 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:06.126175 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 322/660] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Oct 4 16:19:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:06.127062 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d4efc-0dec-48a5-b166-20b69beda0e0 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:06.149079 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d28e7f-3012-4dbc-8e9c-5861dd6aaa24 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:06.170084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:06.198004 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b5e0a-29af-4543-8dc0-e1e4d564e498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:06.199297 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b5e0a-29af-4543-8dc0-e1e4d564e498 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:06.199755 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b5e0a-29af-4543-8dc0-e1e4d564e498 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:06.200446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b5e0a-29af-4543-8dc0-e1e4d564e498 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:06.246632 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d4efc-0dec-48a5-b166-20b69beda0e0 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:06.284454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656eced-2a6a-44e2-b864-76fd9c5a0f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:06.285383 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656eced-2a6a-44e2-b864-76fd9c5a0f94 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:06.286034 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656eced-2a6a-44e2-b864-76fd9c5a0f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:06.286376 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656eced-2a6a-44e2-b864-76fd9c5a0f94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:06.295742 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656eced-2a6a-44e2-b864-76fd9c5a0f94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:06.297265 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656eced-2a6a-44e2-b864-76fd9c5a0f94 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:06.299787 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b5e0a-29af-4543-8dc0-e1e4d564e498 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:06.301448 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b5e0a-29af-4543-8dc0-e1e4d564e498 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:06.310637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-3656eced-2a6a-44e2-b864-76fd9c5a0f94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:06.310637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:06.310637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:06.310637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:06.310637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:06.310637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:06.310637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:06.310637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:06.310637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:06.310637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:06.310637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:06.310637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:06.310637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:19:06.310637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:19:06.310637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:19:06.312309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:19:06.312309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:06.312309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:06.312309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:06.312309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:06.312309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:06.312309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:06.312309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:06.312309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:06.312309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:06.312309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:06.312309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:06.312309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:06.312309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:06.312309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:06.312309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:06.312309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:06.313235 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:19:06.313235 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:19:06.313235 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:19:06.313235 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:19:06.313235 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:19:06.313235 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:19:06.313235 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:06.313235 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:06.313235 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 323/661] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:19:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:06.313235 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656eced-2a6a-44e2-b864-76fd9c5a0f94 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:06.376380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:06.415833 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 339/662] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:19:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:19:06.416025 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:06.416107 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b5e0a-29af-4543-8dc0-e1e4d564e498 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:06.426563 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656eced-2a6a-44e2-b864-76fd9c5a0f94 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:06.460335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e9dd7-983b-4fe0-9b8d-f53752ec937d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:06.460695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e9dd7-983b-4fe0-9b8d-f53752ec937d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:06.460972 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e9dd7-983b-4fe0-9b8d-f53752ec937d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:06.461241 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e9dd7-983b-4fe0-9b8d-f53752ec937d None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:06.462000 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e9dd7-983b-4fe0-9b8d-f53752ec937d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:06.462262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e9dd7-983b-4fe0-9b8d-f53752ec937d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:06.463728 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e9dd7-983b-4fe0-9b8d-f53752ec937d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:06.483902 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 324/663] 10.222.0.55 () {56 vars in 1139 bytes} [Tue Oct 4 16:19:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:06.485551 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08e6cd-dec2-4f08-9dc0-a67b78d3e85f None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:06.486034 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08e6cd-dec2-4f08-9dc0-a67b78d3e85f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:06.486525 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08e6cd-dec2-4f08-9dc0-a67b78d3e85f None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:06.488342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 325/664] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:06.489361 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08e6cd-dec2-4f08-9dc0-a67b78d3e85f None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:06.528062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b5e0a-29af-4543-8dc0-e1e4d564e498 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:06.563421 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e20fb-cbc7-4dd3-9e13-8e682db90c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:06.564597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e20fb-cbc7-4dd3-9e13-8e682db90c32 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:06.564597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e20fb-cbc7-4dd3-9e13-8e682db90c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:06.564597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e20fb-cbc7-4dd3-9e13-8e682db90c32 None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:06.565237 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e20fb-cbc7-4dd3-9e13-8e682db90c32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:06.565538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e20fb-cbc7-4dd3-9e13-8e682db90c32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:06.566962 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e20fb-cbc7-4dd3-9e13-8e682db90c32 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:06.587697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 340/665] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:19:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:06.587697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e20fb-cbc7-4dd3-9e13-8e682db90c32 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:06.599276 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08e6cd-dec2-4f08-9dc0-a67b78d3e85f None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:06.621231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:06.635738 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357797d-368e-4bf9-a925-0b430aac57f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:06.636425 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357797d-368e-4bf9-a925-0b430aac57f6 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:06.636705 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357797d-368e-4bf9-a925-0b430aac57f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:06.636975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357797d-368e-4bf9-a925-0b430aac57f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:06.647592 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357797d-368e-4bf9-a925-0b430aac57f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:06.649053 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357797d-368e-4bf9-a925-0b430aac57f6 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:06.664108 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-9357797d-368e-4bf9-a925-0b430aac57f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:06.664108 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:06.664108 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:06.664108 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:06.664108 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:06.664108 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:06.664108 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:06.664108 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:06.664108 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:06.664108 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:06.664108 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:06.664108 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:06.664108 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:06.664108 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:06.664108 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:06.664108 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:06.665115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:06.665115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:06.665115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:06.665115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:06.665115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:06.665115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:06.665115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:06.665115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:06.665115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:06.665115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:06.665115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:06.665115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:06.665115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:06.665115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:06.665115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:06.665115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:06.665115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:06.666004 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:06.666004 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:06.666004 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:06.666004 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 326/666] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:06.666776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b1139-3a28-4e8a-b67f-c842b2e4d397 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:06.666776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b1139-3a28-4e8a-b67f-c842b2e4d397 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:06.667046 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b1139-3a28-4e8a-b67f-c842b2e4d397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:06.674029 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:06.686948 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-9f2b1139-3a28-4e8a-b67f-c842b2e4d397 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:06.688175 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-9f2b1139-3a28-4e8a-b67f-c842b2e4d397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:06.709760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e20fb-cbc7-4dd3-9e13-8e682db90c32 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:06.747115 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794f154-4a29-461f-8cc2-2b88862d5868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:06.747750 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794f154-4a29-461f-8cc2-2b88862d5868 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:06.748204 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794f154-4a29-461f-8cc2-2b88862d5868 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:06.748337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794f154-4a29-461f-8cc2-2b88862d5868 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:06.763370 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 327/667] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:19:06.763370 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b1139-3a28-4e8a-b67f-c842b2e4d397 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:06.837831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794f154-4a29-461f-8cc2-2b88862d5868 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:06.839805 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794f154-4a29-461f-8cc2-2b88862d5868 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:06.873798 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:06.883919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b1139-3a28-4e8a-b67f-c842b2e4d397 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:06.926345 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:06.932547 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174dbda-ee04-4c46-ad7e-179d226551f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:06.933733 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174dbda-ee04-4c46-ad7e-179d226551f6 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:06.934089 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174dbda-ee04-4c46-ad7e-179d226551f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:06.934434 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174dbda-ee04-4c46-ad7e-179d226551f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:06.935279 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174dbda-ee04-4c46-ad7e-179d226551f6 None admin] RBAC: Adding query filter params (role.id=2165a726b4034e1584166027f2361b5f, scope.project.id=e480e782c4fa403a913ca7179db0843b, user.id=74b3e45a14bd4b539974e9e5e278ee62) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:06.936063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174dbda-ee04-4c46-ad7e-179d226551f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:06.937857 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174dbda-ee04-4c46-ad7e-179d226551f6 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:06.947130 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 328/668] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:19:06 2022] GET /identity/v3/role_assignments?user.id=74b3e45a14bd4b539974e9e5e278ee62&scope.project.id=e480e782c4fa403a913ca7179db0843b&role.id=2165a726b4034e1584166027f2361b5f => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:06.948211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174dbda-ee04-4c46-ad7e-179d226551f6 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:06.978610 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 341/669] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:19:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:19:06.986042 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794f154-4a29-461f-8cc2-2b88862d5868 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:07.117331 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174dbda-ee04-4c46-ad7e-179d226551f6 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:07.131289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794f154-4a29-461f-8cc2-2b88862d5868 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:07.155454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06f428-723a-4d7c-83c2-cf823690bcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:07.156005 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06f428-723a-4d7c-83c2-cf823690bcff None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:07.156287 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06f428-723a-4d7c-83c2-cf823690bcff None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:07.156558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06f428-723a-4d7c-83c2-cf823690bcff None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:07.157595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06f428-723a-4d7c-83c2-cf823690bcff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:07.157907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06f428-723a-4d7c-83c2-cf823690bcff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:07.159407 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06f428-723a-4d7c-83c2-cf823690bcff None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:07.172626 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:07.175384 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 329/670] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:07.176739 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd714e9-cd21-4ec0-89ec-cad5e127ab7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:07.177990 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd714e9-cd21-4ec0-89ec-cad5e127ab7d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:07.178655 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd714e9-cd21-4ec0-89ec-cad5e127ab7d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:07.179152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd714e9-cd21-4ec0-89ec-cad5e127ab7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:07.180144 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06f428-723a-4d7c-83c2-cf823690bcff None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:07.192628 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd714e9-cd21-4ec0-89ec-cad5e127ab7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:07.194429 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd714e9-cd21-4ec0-89ec-cad5e127ab7d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:07.212142 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-4cd714e9-cd21-4ec0-89ec-cad5e127ab7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:07.212142 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:07.212142 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:07.212142 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:07.212142 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:07.212142 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:07.212142 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:07.212142 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:07.212142 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:07.212142 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:07.212142 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:07.212142 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:07.212142 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:07.212142 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:07.212142 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:07.212142 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:07.213207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:07.213207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:07.213207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:07.213207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:07.213207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:07.213207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:07.213207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:07.213207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:07.213207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:07.213207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:07.213207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:07.213207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:07.213207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:07.213207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:07.213207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:07.213207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:07.213207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:07.214135 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:07.214135 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:07.214135 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:07.216077 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 342/671] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:07.217117 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd714e9-cd21-4ec0-89ec-cad5e127ab7d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:07.245169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:07.308011 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06f428-723a-4d7c-83c2-cf823690bcff None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:07.352996 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46150e-aba7-4a0f-9d1b-5555c9c64072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:07.353358 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd714e9-cd21-4ec0-89ec-cad5e127ab7d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:07.354269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46150e-aba7-4a0f-9d1b-5555c9c64072 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:07.354803 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46150e-aba7-4a0f-9d1b-5555c9c64072 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:07.355386 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46150e-aba7-4a0f-9d1b-5555c9c64072 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:07.368471 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46150e-aba7-4a0f-9d1b-5555c9c64072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:19:07.374528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-cf46150e-aba7-4a0f-9d1b-5555c9c64072 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:19:07.374528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:07.374528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:07.374528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:07.374528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:07.374528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:07.374528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:07.374528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:07.374528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:07.374528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:07.374528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:07.374528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:07.374528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:19:07.374528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:19:07.374528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:19:07.374528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:19:07.375571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:19:07.375571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:19:07.375571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:19:07.375571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:19:07.375571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:07.375571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:07.375571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:07.375571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:07.375571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:07.375571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:07.375571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:07.375571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:07.375571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:07.375571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:07.375571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:07.375571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:07.376675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:07.376675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:07.376675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:07.376675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:07.376675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:19:07.376675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:19:07.376675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:19:07.376675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:19:07.376675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:19:07.376675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:19:07.376675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:19:07.376675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:07.376675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 330/672] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Oct 4 16:19:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:07.377382 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46150e-aba7-4a0f-9d1b-5555c9c64072 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:07.402515 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb34d4e-395d-4ea8-9368-84014ffa609e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:07.403738 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb34d4e-395d-4ea8-9368-84014ffa609e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:07.404593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb34d4e-395d-4ea8-9368-84014ffa609e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:07.405044 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb34d4e-395d-4ea8-9368-84014ffa609e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:07.415152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb34d4e-395d-4ea8-9368-84014ffa609e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:07.417509 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb34d4e-395d-4ea8-9368-84014ffa609e None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:07.433618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-ebb34d4e-395d-4ea8-9368-84014ffa609e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:07.433618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:07.433618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:07.433618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:07.433618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:07.433618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:07.433618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:07.433618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:07.433618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:07.433618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:07.433618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:07.433618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:07.433618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:19:07.433618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:19:07.433618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:19:07.434546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:19:07.434546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:07.434546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:07.434546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:07.434546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:07.434546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:07.434546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:07.434546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:07.434546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:07.434546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:07.434546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:07.434546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:07.434546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:07.434546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:07.434546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:07.434546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:07.434546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:07.435499 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:19:07.435499 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:19:07.435499 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:19:07.435499 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:19:07.435499 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:19:07.435499 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:19:07.435499 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:07.435499 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:07.436809 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 343/673] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:19:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:07.437318 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb34d4e-395d-4ea8-9368-84014ffa609e None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:07.502779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:07.503709 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46150e-aba7-4a0f-9d1b-5555c9c64072 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:07.521928 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:07.544905 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292dd86-0376-4f74-9545-e8ceb69ee38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:07.545226 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292dd86-0376-4f74-9545-e8ceb69ee38e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:07.545468 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292dd86-0376-4f74-9545-e8ceb69ee38e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:07.545741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292dd86-0376-4f74-9545-e8ceb69ee38e None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:07.546386 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292dd86-0376-4f74-9545-e8ceb69ee38e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:07.546687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292dd86-0376-4f74-9545-e8ceb69ee38e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:07.548166 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292dd86-0376-4f74-9545-e8ceb69ee38e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:07.560717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 331/674] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:07.561943 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292dd86-0376-4f74-9545-e8ceb69ee38e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:07.592263 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb34d4e-395d-4ea8-9368-84014ffa609e None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:07.629605 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75a450-4a19-4d52-b48d-82015536bbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:07.630239 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75a450-4a19-4d52-b48d-82015536bbe2 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:07.630521 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75a450-4a19-4d52-b48d-82015536bbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:07.630791 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75a450-4a19-4d52-b48d-82015536bbe2 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:07.632984 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75a450-4a19-4d52-b48d-82015536bbe2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:07.632984 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75a450-4a19-4d52-b48d-82015536bbe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:07.633199 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75a450-4a19-4d52-b48d-82015536bbe2 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:07.646785 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 344/675] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Oct 4 16:19:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:07.647771 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75a450-4a19-4d52-b48d-82015536bbe2 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:07.699439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292dd86-0376-4f74-9545-e8ceb69ee38e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:07.734975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c14867-0924-4e28-a8ff-b259c57f8cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:07.735638 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c14867-0924-4e28-a8ff-b259c57f8cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:07.735915 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c14867-0924-4e28-a8ff-b259c57f8cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:07.736187 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c14867-0924-4e28-a8ff-b259c57f8cb1 None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:07.736892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c14867-0924-4e28-a8ff-b259c57f8cb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:07.737193 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c14867-0924-4e28-a8ff-b259c57f8cb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:07.738651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c14867-0924-4e28-a8ff-b259c57f8cb1 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:07.757080 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 332/676] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:19:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:07.758006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c14867-0924-4e28-a8ff-b259c57f8cb1 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:07.772935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75a450-4a19-4d52-b48d-82015536bbe2 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:07.781419 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:07.793430 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:07.818141 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60271b6a-8639-4b1a-9afe-cf356fbf140a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:07.819094 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60271b6a-8639-4b1a-9afe-cf356fbf140a None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:07.819513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60271b6a-8639-4b1a-9afe-cf356fbf140a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:07.820223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60271b6a-8639-4b1a-9afe-cf356fbf140a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:07.829124 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60271b6a-8639-4b1a-9afe-cf356fbf140a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:07.831665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60271b6a-8639-4b1a-9afe-cf356fbf140a None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:07.850603 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-60271b6a-8639-4b1a-9afe-cf356fbf140a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:07.850603 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:07.850603 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:07.850603 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:07.850603 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:07.850603 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:07.850603 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:07.850603 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:07.850603 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:07.850603 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:07.850603 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:07.850603 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:07.850603 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:19:07.850603 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:19:07.850603 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:19:07.851765 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:19:07.851765 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:07.851765 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:07.851765 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:07.851765 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:07.851765 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:07.851765 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:07.851765 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:07.851765 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:07.851765 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:07.851765 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:07.851765 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:07.851765 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:07.851765 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:07.851765 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:07.851765 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:07.851765 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:07.852784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:19:07.852784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:19:07.852784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:19:07.852784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:19:07.852784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:19:07.852784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:19:07.852784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:07.852784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:07.854972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 345/677] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:19:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:07.856545 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60271b6a-8639-4b1a-9afe-cf356fbf140a None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:07.884583 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c14867-0924-4e28-a8ff-b259c57f8cb1 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:07.920799 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a389df3-35ff-44b6-961d-796583043d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:07.921496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a389df3-35ff-44b6-961d-796583043d0e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:07.921776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a389df3-35ff-44b6-961d-796583043d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:07.922047 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a389df3-35ff-44b6-961d-796583043d0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:07.932657 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a389df3-35ff-44b6-961d-796583043d0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:07.934259 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a389df3-35ff-44b6-961d-796583043d0e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:07.949793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-5a389df3-35ff-44b6-961d-796583043d0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:07.949793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:07.949793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:07.949793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:07.949793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:07.949793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:07.949793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:07.949793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:07.949793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:07.949793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:07.949793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:07.949793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:07.949793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:07.949793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:07.949793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:07.949793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:07.950752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:07.950752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:07.950752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:07.950752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:07.950752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:07.950752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:07.950752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:07.950752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:07.950752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:07.950752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:07.950752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:07.950752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:07.950752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:07.950752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:07.950752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:07.950752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:07.950752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:07.951672 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:07.951672 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:07.951672 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:07.956021 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 333/678] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:07.956960 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a389df3-35ff-44b6-961d-796583043d0e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:07.999418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60271b6a-8639-4b1a-9afe-cf356fbf140a None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:08.036750 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a5643-25ed-45e5-a26e-3184a49486b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:08.037510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a5643-25ed-45e5-a26e-3184a49486b7 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:08.037732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a5643-25ed-45e5-a26e-3184a49486b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:08.038005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a5643-25ed-45e5-a26e-3184a49486b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:08.039552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a5643-25ed-45e5-a26e-3184a49486b7 None admin] RBAC: Adding query filter params (role.id=2165a726b4034e1584166027f2361b5f, scope.project.id=e480e782c4fa403a913ca7179db0843b, user.id=7d717575c1d8415fbd09d61d1cbef2d0) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:08.039552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a5643-25ed-45e5-a26e-3184a49486b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:08.040701 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a5643-25ed-45e5-a26e-3184a49486b7 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:08.060188 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 346/679] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:19:07 2022] GET /identity/v3/role_assignments?user.id=7d717575c1d8415fbd09d61d1cbef2d0&scope.project.id=e480e782c4fa403a913ca7179db0843b&role.id=2165a726b4034e1584166027f2361b5f => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:08.060188 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a5643-25ed-45e5-a26e-3184a49486b7 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:08.076008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:08.111057 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:08.118135 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a389df3-35ff-44b6-961d-796583043d0e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:08.205301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7fb34-32a8-48a9-a3fc-ccb4b155d7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:08.205854 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7fb34-32a8-48a9-a3fc-ccb4b155d7ae None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:08.206126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7fb34-32a8-48a9-a3fc-ccb4b155d7ae None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:08.206395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7fb34-32a8-48a9-a3fc-ccb4b155d7ae None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:08.207133 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7fb34-32a8-48a9-a3fc-ccb4b155d7ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:08.207432 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7fb34-32a8-48a9-a3fc-ccb4b155d7ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:08.209586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7fb34-32a8-48a9-a3fc-ccb4b155d7ae None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:08.225679 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 334/680] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:19:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:08.231136 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43e0ef-3e7f-473f-959e-1abc31bfe05a None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:08.231951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43e0ef-3e7f-473f-959e-1abc31bfe05a None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:08.233186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43e0ef-3e7f-473f-959e-1abc31bfe05a None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:08.234910 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 335/681] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:08.240325 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43e0ef-3e7f-473f-959e-1abc31bfe05a None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:08.249005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a5643-25ed-45e5-a26e-3184a49486b7 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:08.290412 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2773f64-ad1b-4e8c-93be-963c16ed0366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:08.291113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2773f64-ad1b-4e8c-93be-963c16ed0366 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:08.291397 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2773f64-ad1b-4e8c-93be-963c16ed0366 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:08.291671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2773f64-ad1b-4e8c-93be-963c16ed0366 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:08.292407 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2773f64-ad1b-4e8c-93be-963c16ed0366 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:08.292712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2773f64-ad1b-4e8c-93be-963c16ed0366 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:08.294105 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2773f64-ad1b-4e8c-93be-963c16ed0366 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:08.307575 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 347/682] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:08.308913 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cde1e-514d-4aa0-a39e-92755a24613b None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:08.309197 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cde1e-514d-4aa0-a39e-92755a24613b None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:08.309470 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cde1e-514d-4aa0-a39e-92755a24613b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:08.330239 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-100cde1e-514d-4aa0-a39e-92755a24613b None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:08.331891 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-100cde1e-514d-4aa0-a39e-92755a24613b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:08.370792 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43e0ef-3e7f-473f-959e-1abc31bfe05a None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:08.414761 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70114b51-2241-4314-b919-5dfad9cdceee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:08.415418 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70114b51-2241-4314-b919-5dfad9cdceee None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:08.415698 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70114b51-2241-4314-b919-5dfad9cdceee None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:08.415972 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70114b51-2241-4314-b919-5dfad9cdceee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:08.416707 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70114b51-2241-4314-b919-5dfad9cdceee None admin] RBAC: Adding query filter params (role.id=2165a726b4034e1584166027f2361b5f, scope.project.id=e480e782c4fa403a913ca7179db0843b, user.id=d6ae980afbfd49dea9bbb0adc02b9031) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:08.417018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70114b51-2241-4314-b919-5dfad9cdceee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:08.417282 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 348/683] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:19:08.418164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100cde1e-514d-4aa0-a39e-92755a24613b None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:08.424501 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70114b51-2241-4314-b919-5dfad9cdceee None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:08.437913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 336/684] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:19:08 2022] GET /identity/v3/role_assignments?user.id=d6ae980afbfd49dea9bbb0adc02b9031&scope.project.id=e480e782c4fa403a913ca7179db0843b&role.id=2165a726b4034e1584166027f2361b5f => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:08.463567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:08.580433 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100cde1e-514d-4aa0-a39e-92755a24613b None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:08.633311 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4831e3a-2c8d-4f66-a907-bdfdd4df2fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:08.633964 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4831e3a-2c8d-4f66-a907-bdfdd4df2fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:08.634241 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4831e3a-2c8d-4f66-a907-bdfdd4df2fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:08.634513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4831e3a-2c8d-4f66-a907-bdfdd4df2fc7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:08.647011 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4831e3a-2c8d-4f66-a907-bdfdd4df2fc7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:08.648474 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4831e3a-2c8d-4f66-a907-bdfdd4df2fc7 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:08.664713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-b4831e3a-2c8d-4f66-a907-bdfdd4df2fc7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 16:19:08.664713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:08.664713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:08.664713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:08.664713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:08.664713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:08.664713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:08.664713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:08.664713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:08.664713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:08.664713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:08.664713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:08.664713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:19:08.664713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:19:08.664713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:19:08.664713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:19:08.665717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:08.665717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:08.665717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:19:08.665717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:08.665717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:19:08.665717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:08.665717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:08.665717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:08.665717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:08.665717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:08.665717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:08.665717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:08.665717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:08.665717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:08.665717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:08.665717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:08.665717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:08.665717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:08.667136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:08.667136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:08.667136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:19:08.667136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:19:08.667136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:19:08.667136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:19:08.667136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:19:08.667136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:19:08.667136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 16:19:08.667136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:08.667136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 349/685] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:19:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:08.673162 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70114b51-2241-4314-b919-5dfad9cdceee None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:08.690024 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:08.747806 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4831e3a-2c8d-4f66-a907-bdfdd4df2fc7 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:08.804285 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70114b51-2241-4314-b919-5dfad9cdceee None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:08.844331 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:08.846529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c25258-7a62-41a3-9506-2fc024177c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:08.847744 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c25258-7a62-41a3-9506-2fc024177c31 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:08.848083 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c25258-7a62-41a3-9506-2fc024177c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:08.848996 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c25258-7a62-41a3-9506-2fc024177c31 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:08.849965 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c25258-7a62-41a3-9506-2fc024177c31 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:08.850371 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c25258-7a62-41a3-9506-2fc024177c31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:08.852045 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c25258-7a62-41a3-9506-2fc024177c31 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:08.864899 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4831e3a-2c8d-4f66-a907-bdfdd4df2fc7 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:08.874372 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 337/686] 10.222.0.55 () {56 vars in 1135 bytes} [Tue Oct 4 16:19:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:08.879834 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c25258-7a62-41a3-9506-2fc024177c31 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:08.915830 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04239e-c1ec-4d6f-a4a1-b04c3ad03224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:08.916912 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04239e-c1ec-4d6f-a4a1-b04c3ad03224 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:08.917289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04239e-c1ec-4d6f-a4a1-b04c3ad03224 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:08.917687 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04239e-c1ec-4d6f-a4a1-b04c3ad03224 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:08.933248 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04239e-c1ec-4d6f-a4a1-b04c3ad03224 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:19:08.939898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-4b04239e-c1ec-4d6f-a4a1-b04c3ad03224 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:19:08.939898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:08.939898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:08.939898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:08.939898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:08.939898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:08.939898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:08.939898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:08.939898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:08.939898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:08.939898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:08.939898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:08.939898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:19:08.939898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:19:08.939898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:19:08.939898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:19:08.940865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:19:08.940865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:19:08.940865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:19:08.940865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:19:08.940865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:08.940865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:08.940865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:08.940865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:08.940865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:08.940865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:08.940865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:08.940865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:08.940865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:08.940865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:08.940865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:08.940865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:08.941904 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:08.941904 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:08.941904 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:08.941904 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:08.941904 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:19:08.941904 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:19:08.941904 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:19:08.941904 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:19:08.941904 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:19:08.941904 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:19:08.941904 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:19:08.941904 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:08.941904 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 350/687] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:19:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:08.950268 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04239e-c1ec-4d6f-a4a1-b04c3ad03224 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:08.978637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:09.044926 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c25258-7a62-41a3-9506-2fc024177c31 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:09.120555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6164e4-f84c-449d-95b9-3f7f6cae58e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:09.121730 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6164e4-f84c-449d-95b9-3f7f6cae58e1 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:09.122372 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6164e4-f84c-449d-95b9-3f7f6cae58e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:09.123864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6164e4-f84c-449d-95b9-3f7f6cae58e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:09.151189 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04239e-c1ec-4d6f-a4a1-b04c3ad03224 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:09.197295 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f48aa6-5d2b-4fe9-a875-eb41dacb131d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:09.197923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f48aa6-5d2b-4fe9-a875-eb41dacb131d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:09.198199 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f48aa6-5d2b-4fe9-a875-eb41dacb131d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:09.198524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f48aa6-5d2b-4fe9-a875-eb41dacb131d None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:09.199805 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f48aa6-5d2b-4fe9-a875-eb41dacb131d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:09.200107 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f48aa6-5d2b-4fe9-a875-eb41dacb131d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:09.201929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f48aa6-5d2b-4fe9-a875-eb41dacb131d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:09.211906 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 351/688] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:19:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:09.217610 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f48aa6-5d2b-4fe9-a875-eb41dacb131d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:09.222586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:09.304590 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6164e4-f84c-449d-95b9-3f7f6cae58e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:09.306447 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6164e4-f84c-449d-95b9-3f7f6cae58e1 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:09.399161 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:09.444547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f48aa6-5d2b-4fe9-a875-eb41dacb131d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:09.446112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 338/689] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:19:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 16:19:09.448692 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43c1de-6cf3-4c7e-8056-8629311d6f0e None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:09.448977 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43c1de-6cf3-4c7e-8056-8629311d6f0e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:09.449247 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43c1de-6cf3-4c7e-8056-8629311d6f0e None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:09.450802 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 339/690] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:09.451532 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43c1de-6cf3-4c7e-8056-8629311d6f0e None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:09.488970 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c8240-fb08-45fe-ae8b-c79de4d14da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:09.489606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c8240-fb08-45fe-ae8b-c79de4d14da5 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:09.489867 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c8240-fb08-45fe-ae8b-c79de4d14da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:09.490136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c8240-fb08-45fe-ae8b-c79de4d14da5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:09.501869 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c8240-fb08-45fe-ae8b-c79de4d14da5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:09.503342 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c8240-fb08-45fe-ae8b-c79de4d14da5 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:09.518640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-650c8240-fb08-45fe-ae8b-c79de4d14da5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:09.518640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:09.518640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:09.518640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:09.518640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:09.518640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:09.518640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:09.518640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:09.518640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:09.518640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:09.518640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:09.518640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:09.518640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:09.518640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:09.518640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:09.518640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:09.519967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:09.519967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:09.519967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:09.519967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:09.519967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:09.519967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:09.519967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:09.519967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:09.519967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:09.519967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:09.519967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:09.519967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:09.519967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:09.519967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:09.519967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:09.519967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:09.519967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:09.522047 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:09.522047 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:09.522047 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:09.522047 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 352/691] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:19:09.522047 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1046c0-5072-4062-90d6-449a3c4184eb None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:09.522047 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1046c0-5072-4062-90d6-449a3c4184eb None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:09.522047 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1046c0-5072-4062-90d6-449a3c4184eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:09.542498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-5e1046c0-5072-4062-90d6-449a3c4184eb None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:09.543727 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-5e1046c0-5072-4062-90d6-449a3c4184eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:09.614897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43c1de-6cf3-4c7e-8056-8629311d6f0e None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:09.616858 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:09.645879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 353/692] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:19:09.648006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1046c0-5072-4062-90d6-449a3c4184eb None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:09.689410 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff14fed-2e5b-413c-9cd4-48f144f27246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:09.690062 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff14fed-2e5b-413c-9cd4-48f144f27246 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:09.690342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff14fed-2e5b-413c-9cd4-48f144f27246 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:09.690590 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff14fed-2e5b-413c-9cd4-48f144f27246 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:09.712703 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff14fed-2e5b-413c-9cd4-48f144f27246 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:09.714238 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff14fed-2e5b-413c-9cd4-48f144f27246 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:09.748757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-8ff14fed-2e5b-413c-9cd4-48f144f27246 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:09.748757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:09.748757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:09.748757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:09.748757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:09.748757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:09.748757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:09.748757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:09.748757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:09.748757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:09.748757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:09.748757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:09.748757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:09.748757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:09.748757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:09.748757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:09.749794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:09.749794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:09.749794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:09.749794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:09.749794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:09.749794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:09.749794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:09.749794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:09.749794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:09.749794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:09.749794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:09.749794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:09.749794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:09.749794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:09.749794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:09.749794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:09.749794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:09.751376 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:09.751376 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:09.751376 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:09.751376 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 340/693] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:09.756494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff14fed-2e5b-413c-9cd4-48f144f27246 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:09.815220 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:09.863696 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1046c0-5072-4062-90d6-449a3c4184eb None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:09.938290 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46fe7e-b769-454c-96cf-04cbce7cae7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:09.938914 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46fe7e-b769-454c-96cf-04cbce7cae7c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:09.939222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46fe7e-b769-454c-96cf-04cbce7cae7c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:09.939487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46fe7e-b769-454c-96cf-04cbce7cae7c None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:09.940131 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46fe7e-b769-454c-96cf-04cbce7cae7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:09.940424 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46fe7e-b769-454c-96cf-04cbce7cae7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:09.941790 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46fe7e-b769-454c-96cf-04cbce7cae7c None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:09.958373 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 354/694] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:09.959316 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46fe7e-b769-454c-96cf-04cbce7cae7c None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:09.968995 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff14fed-2e5b-413c-9cd4-48f144f27246 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:10.015775 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db00c2-9329-4cdb-b56d-7cbb4dc96602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:10.016414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db00c2-9329-4cdb-b56d-7cbb4dc96602 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:10.016662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db00c2-9329-4cdb-b56d-7cbb4dc96602 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:10.016932 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db00c2-9329-4cdb-b56d-7cbb4dc96602 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:10.017589 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db00c2-9329-4cdb-b56d-7cbb4dc96602 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:10.017891 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db00c2-9329-4cdb-b56d-7cbb4dc96602 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:10.020112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db00c2-9329-4cdb-b56d-7cbb4dc96602 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:10.043063 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:10.055066 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 341/695] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:10.056308 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db00c2-9329-4cdb-b56d-7cbb4dc96602 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:10.112522 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46fe7e-b769-454c-96cf-04cbce7cae7c None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:10.149963 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712d1f1-b2c1-4530-a4b4-0632b490c309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:10.150846 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712d1f1-b2c1-4530-a4b4-0632b490c309 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:10.151303 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712d1f1-b2c1-4530-a4b4-0632b490c309 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:10.151801 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712d1f1-b2c1-4530-a4b4-0632b490c309 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:10.163832 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712d1f1-b2c1-4530-a4b4-0632b490c309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:10.165614 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712d1f1-b2c1-4530-a4b4-0632b490c309 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:10.167584 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:10.184050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-0712d1f1-b2c1-4530-a4b4-0632b490c309 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:10.184050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:10.184050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:10.184050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:10.184050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:10.184050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:10.184050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:10.184050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:10.184050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:10.184050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:10.184050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:10.184050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:10.184050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:10.184050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:10.184050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:10.184050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:10.185093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:10.185093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:10.185093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:10.185093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:10.185093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:10.185093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:10.185093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:10.185093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:10.185093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:10.185093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:10.185093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:10.185093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:10.185093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:10.185093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:10.185093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:10.185093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:10.185093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:10.186070 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:10.186070 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:10.186070 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:10.188225 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 355/696] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:10.189257 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712d1f1-b2c1-4530-a4b4-0632b490c309 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:10.190597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db00c2-9329-4cdb-b56d-7cbb4dc96602 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:10.232548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3392f4c-03be-4655-8a00-173c6d81c167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:10.233643 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3392f4c-03be-4655-8a00-173c6d81c167 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:10.234133 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3392f4c-03be-4655-8a00-173c6d81c167 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:10.234639 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3392f4c-03be-4655-8a00-173c6d81c167 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:10.243972 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3392f4c-03be-4655-8a00-173c6d81c167 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:10.245919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3392f4c-03be-4655-8a00-173c6d81c167 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:10.259884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-a3392f4c-03be-4655-8a00-173c6d81c167 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 16:19:10.259884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:10.259884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:10.259884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:10.259884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:10.259884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:10.259884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:10.259884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:10.259884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:10.259884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:10.259884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:10.259884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:10.259884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:19:10.259884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:19:10.259884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:19:10.259884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:19:10.261171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:10.261171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:10.261171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:19:10.261171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:10.261171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:19:10.261171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:10.261171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:10.261171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:10.261171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:10.261171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:10.261171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:10.261171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:10.261171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:10.261171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:10.261171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:10.261171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:10.261171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:10.261171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:10.262304 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:10.262304 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:10.262304 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:19:10.262304 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:19:10.262304 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:19:10.262304 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:19:10.262304 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:19:10.262304 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:19:10.262304 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 16:19:10.262304 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:10.269359 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 342/697] 10.222.0.55 () {56 vars in 1093 bytes} [Tue Oct 4 16:19:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:10.270726 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3392f4c-03be-4655-8a00-173c6d81c167 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:10.312988 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:10.319743 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712d1f1-b2c1-4530-a4b4-0632b490c309 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:10.364978 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925eef07-1cef-4438-b689-d6dd84c9a504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:10.364978 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eef07-1cef-4438-b689-d6dd84c9a504 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:10.364978 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eef07-1cef-4438-b689-d6dd84c9a504 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:10.364978 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eef07-1cef-4438-b689-d6dd84c9a504 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:10.372898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925eef07-1cef-4438-b689-d6dd84c9a504 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:10.373859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925eef07-1cef-4438-b689-d6dd84c9a504 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:10.390999 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-925eef07-1cef-4438-b689-d6dd84c9a504 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:10.390999 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:10.390999 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:10.390999 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:10.390999 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:10.390999 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:10.390999 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:10.390999 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:10.390999 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:10.390999 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:10.390999 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:10.390999 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:10.390999 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:19:10.390999 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:19:10.390999 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:19:10.391972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:19:10.391972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:10.391972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:10.391972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:10.391972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:10.391972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:10.391972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:10.391972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:10.391972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:10.391972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:10.391972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:10.391972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:10.391972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:10.391972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:10.391972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:10.391972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:10.391972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:10.392884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:19:10.392884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:19:10.392884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:19:10.392884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:19:10.392884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:19:10.392884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:19:10.392884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:10.392884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:10.395419 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 356/698] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:19:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:10.396534 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925eef07-1cef-4438-b689-d6dd84c9a504 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:10.416309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3392f4c-03be-4655-8a00-173c6d81c167 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:10.455105 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2129bb4-d0aa-45f6-bddb-e1e70dccbc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:10.455815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2129bb4-d0aa-45f6-bddb-e1e70dccbc89 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:10.456087 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2129bb4-d0aa-45f6-bddb-e1e70dccbc89 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:10.456350 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2129bb4-d0aa-45f6-bddb-e1e70dccbc89 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:10.456998 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2129bb4-d0aa-45f6-bddb-e1e70dccbc89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:10.457294 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2129bb4-d0aa-45f6-bddb-e1e70dccbc89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:10.458667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2129bb4-d0aa-45f6-bddb-e1e70dccbc89 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:10.472562 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 343/699] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:10.473537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2129bb4-d0aa-45f6-bddb-e1e70dccbc89 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:10.476283 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:10.522685 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925eef07-1cef-4438-b689-d6dd84c9a504 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:10.560619 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7f1b9-9bc2-4ca1-84e2-6046de3a77bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:10.561670 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7f1b9-9bc2-4ca1-84e2-6046de3a77bd None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:10.562171 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7f1b9-9bc2-4ca1-84e2-6046de3a77bd None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:10.562638 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7f1b9-9bc2-4ca1-84e2-6046de3a77bd None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:10.563648 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7f1b9-9bc2-4ca1-84e2-6046de3a77bd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:10.564185 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7f1b9-9bc2-4ca1-84e2-6046de3a77bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:10.565856 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7f1b9-9bc2-4ca1-84e2-6046de3a77bd None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:10.592624 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2129bb4-d0aa-45f6-bddb-e1e70dccbc89 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:10.593032 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 357/700] 10.222.0.55 () {56 vars in 1133 bytes} [Tue Oct 4 16:19:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:10.594302 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7f1b9-9bc2-4ca1-84e2-6046de3a77bd None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:10.612709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:10.629864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2a58a-31e7-49da-8787-aa59f26d86d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:10.630477 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2a58a-31e7-49da-8787-aa59f26d86d5 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:10.630749 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2a58a-31e7-49da-8787-aa59f26d86d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:10.631043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2a58a-31e7-49da-8787-aa59f26d86d5 None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:10.631739 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2a58a-31e7-49da-8787-aa59f26d86d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:10.632060 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2a58a-31e7-49da-8787-aa59f26d86d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:10.633471 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2a58a-31e7-49da-8787-aa59f26d86d5 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:10.651155 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 344/701] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:19:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:10.652430 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2a58a-31e7-49da-8787-aa59f26d86d5 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:10.712508 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7f1b9-9bc2-4ca1-84e2-6046de3a77bd None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:10.717933 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:10.749847 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d56c94-cba9-4e40-85d7-a7916d06020b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:10.750462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d56c94-cba9-4e40-85d7-a7916d06020b None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:10.750732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d56c94-cba9-4e40-85d7-a7916d06020b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:10.751026 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d56c94-cba9-4e40-85d7-a7916d06020b None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:10.751769 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d56c94-cba9-4e40-85d7-a7916d06020b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:10.753135 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d56c94-cba9-4e40-85d7-a7916d06020b None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:10.767888 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2a58a-31e7-49da-8787-aa59f26d86d5 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:10.778610 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 358/702] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Oct 4 16:19:10 2022] POST /identity/v3/users => generated 254 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:19:10.779824 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d56c94-cba9-4e40-85d7-a7916d06020b None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:10.826246 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c3f52-7093-45eb-85f9-5c71b7edf44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:10.827088 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c3f52-7093-45eb-85f9-5c71b7edf44e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:10.827437 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c3f52-7093-45eb-85f9-5c71b7edf44e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:10.827765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c3f52-7093-45eb-85f9-5c71b7edf44e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:10.916888 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c3f52-7093-45eb-85f9-5c71b7edf44e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:10.918535 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c3f52-7093-45eb-85f9-5c71b7edf44e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:10.921443 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:10.964910 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d56c94-cba9-4e40-85d7-a7916d06020b None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:11.006629 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fa8a5-b20d-40c4-b41c-ff6420a56efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:11.007305 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fa8a5-b20d-40c4-b41c-ff6420a56efe None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:11.007579 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fa8a5-b20d-40c4-b41c-ff6420a56efe None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:11.007844 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fa8a5-b20d-40c4-b41c-ff6420a56efe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:11.008596 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:11.008771 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1fa8a5-b20d-40c4-b41c-ff6420a56efe None admin] RBAC: Adding query filter params (role.id=2165a726b4034e1584166027f2361b5f, scope.project.id=e480e782c4fa403a913ca7179db0843b, user.id=6590cb6c1c964039b9dea771a647bdac) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:11.009045 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1fa8a5-b20d-40c4-b41c-ff6420a56efe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:11.010838 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1fa8a5-b20d-40c4-b41c-ff6420a56efe None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:11.021416 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 359/703] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:19:10 2022] GET /identity/v3/role_assignments?user.id=6590cb6c1c964039b9dea771a647bdac&scope.project.id=e480e782c4fa403a913ca7179db0843b&role.id=2165a726b4034e1584166027f2361b5f => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:11.022442 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05509a5-3e71-41cd-bcd3-a9ba8d28acb1 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:11.022721 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05509a5-3e71-41cd-bcd3-a9ba8d28acb1 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:11.023025 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05509a5-3e71-41cd-bcd3-a9ba8d28acb1 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:11.024567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 360/704] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:11.030910 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190ae54-8227-43c6-9df8-808e021ca01d None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:11.031208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190ae54-8227-43c6-9df8-808e021ca01d None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:11.031509 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190ae54-8227-43c6-9df8-808e021ca01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:11.058846 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-7190ae54-8227-43c6-9df8-808e021ca01d None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:11.060115 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-7190ae54-8227-43c6-9df8-808e021ca01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:11.077738 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 345/705] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:19:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:19:11.088313 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c3f52-7093-45eb-85f9-5c71b7edf44e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:11.157541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 361/706] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:19:11.230104 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c3f52-7093-45eb-85f9-5c71b7edf44e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:11.268322 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18027d-27e8-4e69-84b1-a5cdda730ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:11.269335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18027d-27e8-4e69-84b1-a5cdda730ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:11.269836 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18027d-27e8-4e69-84b1-a5cdda730ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:11.270285 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18027d-27e8-4e69-84b1-a5cdda730ea7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:11.282715 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18027d-27e8-4e69-84b1-a5cdda730ea7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:11.284628 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18027d-27e8-4e69-84b1-a5cdda730ea7 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:11.298567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fd360-8188-41df-850a-91f29822dcca None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:11.299221 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fd360-8188-41df-850a-91f29822dcca None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:11.299728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fd360-8188-41df-850a-91f29822dcca None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:11.301552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 362/707] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:11.307115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-0b18027d-27e8-4e69-84b1-a5cdda730ea7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:11.307115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:11.307115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:11.307115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:11.307115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:11.307115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:11.307115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:11.307115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:11.307115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:11.307115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:11.307115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:11.307115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:11.307115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:11.307115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:11.307115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:11.307115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:11.308224 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:11.308224 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:11.308224 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:11.308224 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:11.308224 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:11.308224 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:11.308224 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:11.308224 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:11.308224 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:11.308224 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:11.308224 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:11.308224 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:11.308224 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:11.308224 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:11.308224 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:11.308224 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:11.308224 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:11.309128 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:11.309128 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:11.309128 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:11.309128 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 346/708] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:19:11.312571 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fd360-8188-41df-850a-91f29822dcca None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:11.327490 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ffc93-ab6e-48ef-8c5b-e40e36672b94 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:11.327893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ffc93-ab6e-48ef-8c5b-e40e36672b94 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:11.328063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ffc93-ab6e-48ef-8c5b-e40e36672b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:11.380860 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-441ffc93-ab6e-48ef-8c5b-e40e36672b94 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:11.382467 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-441ffc93-ab6e-48ef-8c5b-e40e36672b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:11.402857 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:11.403352 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:11.446409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fd360-8188-41df-850a-91f29822dcca None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:11.490479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 347/709] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:19:11.491388 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ffc93-ab6e-48ef-8c5b-e40e36672b94 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:11.505949 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8b8a0-00f9-490b-97e7-0fefe266d9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:11.507073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8b8a0-00f9-490b-97e7-0fefe266d9e4 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:11.507603 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8b8a0-00f9-490b-97e7-0fefe266d9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:11.508109 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8b8a0-00f9-490b-97e7-0fefe266d9e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:11.509291 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8b8a0-00f9-490b-97e7-0fefe266d9e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:11.509800 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8b8a0-00f9-490b-97e7-0fefe266d9e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:11.512442 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8b8a0-00f9-490b-97e7-0fefe266d9e4 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:11.546546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 363/710] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:11.548239 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8b8a0-00f9-490b-97e7-0fefe266d9e4 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:11.661577 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8b8a0-00f9-490b-97e7-0fefe266d9e4 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:11.689241 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:11.695350 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ffc93-ab6e-48ef-8c5b-e40e36672b94 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:11.702571 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a090e-afcd-4133-a3f8-a0696021704c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:11.703599 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a090e-afcd-4133-a3f8-a0696021704c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:11.704080 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a090e-afcd-4133-a3f8-a0696021704c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:11.704545 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a090e-afcd-4133-a3f8-a0696021704c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:11.713860 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a090e-afcd-4133-a3f8-a0696021704c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:11.715817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a090e-afcd-4133-a3f8-a0696021704c None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:11.729470 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-659a090e-afcd-4133-a3f8-a0696021704c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:11.729470 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:11.729470 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:11.729470 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:11.729470 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:11.729470 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:11.729470 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:11.729470 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:11.729470 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:11.729470 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:11.729470 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:11.729470 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:11.729470 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:19:11.729470 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:19:11.729470 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:19:11.730547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:19:11.730547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:11.730547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:11.730547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:11.730547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:11.730547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:11.730547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:11.730547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:11.730547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:11.730547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:11.730547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:11.730547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:11.730547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:11.730547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:11.730547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:11.730547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:11.730547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:11.731561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:19:11.731561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:19:11.731561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:19:11.731561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:19:11.731561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:19:11.731561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:19:11.731561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:11.731561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:11.734057 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 364/711] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:19:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:11.739921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a090e-afcd-4133-a3f8-a0696021704c None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:11.765633 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638fb93-724f-403e-ae2e-45a3c6866c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:11.767394 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638fb93-724f-403e-ae2e-45a3c6866c09 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:11.767868 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638fb93-724f-403e-ae2e-45a3c6866c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:11.768331 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638fb93-724f-403e-ae2e-45a3c6866c09 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:11.769744 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638fb93-724f-403e-ae2e-45a3c6866c09 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:11.774131 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638fb93-724f-403e-ae2e-45a3c6866c09 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:11.800378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-8638fb93-724f-403e-ae2e-45a3c6866c09 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 16:19:11.800378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:11.800378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 16:19:11.800378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 16:19:11.800378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 16:19:11.800378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 16:19:11.800378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 16:19:11.800378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:11.800378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 16:19:11.800378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:11.800378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:19:11.800378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:11.800378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:11.800378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:11.800378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:11.800378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:11.800378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:11.801496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:11.801496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:11.801496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:11.801496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:11.801496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:11.801496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:11.801496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 16:19:11.801496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 16:19:11.801496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 16:19:11.801496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 16:19:11.801496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:11.801496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:11.801496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:11.801496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:11.801496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:11.801496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:11.802342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:11.802342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:11.802342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:11.802342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:11.802342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:11.802342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:11.802342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:11.802342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:11.802342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:11.802342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:11.802342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 16:19:11.802342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:11.802342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 16:19:11.802342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:11.803222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 348/712] 10.222.0.55 () {56 vars in 1129 bytes} [Tue Oct 4 16:19:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:11.810178 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638fb93-724f-403e-ae2e-45a3c6866c09 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:11.833853 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:11.893971 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a090e-afcd-4133-a3f8-a0696021704c None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:11.934915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e410a-b3a4-4a78-b3f1-ffbacbe58066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:11.936358 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e410a-b3a4-4a78-b3f1-ffbacbe58066 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:11.936829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e410a-b3a4-4a78-b3f1-ffbacbe58066 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:11.937389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e410a-b3a4-4a78-b3f1-ffbacbe58066 None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:11.938111 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e410a-b3a4-4a78-b3f1-ffbacbe58066 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:11.938413 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e410a-b3a4-4a78-b3f1-ffbacbe58066 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:11.939896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e410a-b3a4-4a78-b3f1-ffbacbe58066 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:11.959015 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 365/713] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:19:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:19:11.959015 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e410a-b3a4-4a78-b3f1-ffbacbe58066 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:11.986065 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638fb93-724f-403e-ae2e-45a3c6866c09 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:12.008989 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:12.027820 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1054044-b005-462b-9ee9-9658c3213d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:12.028387 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1054044-b005-462b-9ee9-9658c3213d98 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:12.028653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1054044-b005-462b-9ee9-9658c3213d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:12.028940 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1054044-b005-462b-9ee9-9658c3213d98 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:12.029565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1054044-b005-462b-9ee9-9658c3213d98 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:12.029864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1054044-b005-462b-9ee9-9658c3213d98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:12.031322 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1054044-b005-462b-9ee9-9658c3213d98 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:12.042495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 349/714] 10.222.0.55 () {56 vars in 1124 bytes} [Tue Oct 4 16:19:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:12.042495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1054044-b005-462b-9ee9-9658c3213d98 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:12.089935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e410a-b3a4-4a78-b3f1-ffbacbe58066 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:12.133674 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef541e-1725-4e30-ab56-21dde35d4e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:12.134762 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef541e-1725-4e30-ab56-21dde35d4e18 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:12.135319 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef541e-1725-4e30-ab56-21dde35d4e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:12.135831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef541e-1725-4e30-ab56-21dde35d4e18 None admin] PATH_INFO: `/v3/services/network` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:12.136708 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef541e-1725-4e30-ab56-21dde35d4e18 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:12.138316 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef541e-1725-4e30-ab56-21dde35d4e18 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:12.150491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-d4ef541e-1725-4e30-ab56-21dde35d4e18 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 16:19:12.150491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:12.150491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 16:19:12.150491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 16:19:12.150491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 16:19:12.150491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 16:19:12.150491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 16:19:12.150491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:12.150491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 16:19:12.150491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:12.150491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:19:12.150491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:12.150491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:12.150491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:12.150491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:12.150491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:12.150491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:12.151616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:12.151616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:12.151616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:12.151616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:12.151616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:12.151616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:12.151616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 16:19:12.151616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 16:19:12.151616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 16:19:12.151616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 16:19:12.151616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:12.151616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:12.151616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:12.151616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:12.151616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:12.151616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:12.152481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:12.152481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:12.152481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:12.152481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:12.152481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:12.152481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:12.152481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:12.152481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:12.152481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:12.152481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:12.152481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 16:19:12.152481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:12.152481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 16:19:12.152481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:12.155432 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 366/715] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:19:11 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:12.156556 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef541e-1725-4e30-ab56-21dde35d4e18 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:12.162533 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:12.200602 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1054044-b005-462b-9ee9-9658c3213d98 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:12.246247 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af3461-e5b7-4e97-be08-dae89654db26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:12.246869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af3461-e5b7-4e97-be08-dae89654db26 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:12.247170 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af3461-e5b7-4e97-be08-dae89654db26 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:12.247442 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af3461-e5b7-4e97-be08-dae89654db26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:12.248178 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af3461-e5b7-4e97-be08-dae89654db26 None admin] RBAC: Adding query filter params (role.id=066f46534195417295e63a5316632eae, scope.project.id=e480e782c4fa403a913ca7179db0843b, user.id=6cdee0584fe045028a44c385d032d2c7) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:12.248521 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af3461-e5b7-4e97-be08-dae89654db26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:12.250648 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af3461-e5b7-4e97-be08-dae89654db26 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:12.266265 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 350/716] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:19:12 2022] GET /identity/v3/role_assignments?user.id=6cdee0584fe045028a44c385d032d2c7&scope.project.id=e480e782c4fa403a913ca7179db0843b&role.id=066f46534195417295e63a5316632eae => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:12.266265 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af3461-e5b7-4e97-be08-dae89654db26 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:12.357345 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef541e-1725-4e30-ab56-21dde35d4e18 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:12.381768 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:12.395766 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af3461-e5b7-4e97-be08-dae89654db26 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:12.440711 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb1084-6b4c-46f7-ad13-71377403ea19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:12.441658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb1084-6b4c-46f7-ad13-71377403ea19 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:12.442089 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb1084-6b4c-46f7-ad13-71377403ea19 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:12.442594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb1084-6b4c-46f7-ad13-71377403ea19 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:12.444265 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb1084-6b4c-46f7-ad13-71377403ea19 None admin] RBAC: Adding query filter params (name=network) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:12.444780 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb1084-6b4c-46f7-ad13-71377403ea19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:12.446667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb1084-6b4c-46f7-ad13-71377403ea19 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:12.449320 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:12.453858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 351/717] 10.222.0.55 () {56 vars in 1112 bytes} [Tue Oct 4 16:19:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:12.460045 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb1084-6b4c-46f7-ad13-71377403ea19 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:12.483948 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c258f-24f5-4ceb-9222-b2b9bcadf2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:12.484943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c258f-24f5-4ceb-9222-b2b9bcadf2f4 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:12.485423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c258f-24f5-4ceb-9222-b2b9bcadf2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:12.485871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c258f-24f5-4ceb-9222-b2b9bcadf2f4 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:12.487014 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c258f-24f5-4ceb-9222-b2b9bcadf2f4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:12.487501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c258f-24f5-4ceb-9222-b2b9bcadf2f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:12.489392 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c258f-24f5-4ceb-9222-b2b9bcadf2f4 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:12.511907 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 367/718] 10.222.0.55 () {56 vars in 1124 bytes} [Tue Oct 4 16:19:12 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:12.585592 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb1084-6b4c-46f7-ad13-71377403ea19 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:12.624671 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10dcdd-a30a-4efa-82d6-7da88842d2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:12.625229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10dcdd-a30a-4efa-82d6-7da88842d2d5 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:12.625509 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10dcdd-a30a-4efa-82d6-7da88842d2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:12.625779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10dcdd-a30a-4efa-82d6-7da88842d2d5 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:12.626432 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10dcdd-a30a-4efa-82d6-7da88842d2d5 None admin] RBAC: Adding query filter params (type=network) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:12.626734 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10dcdd-a30a-4efa-82d6-7da88842d2d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:12.628212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10dcdd-a30a-4efa-82d6-7da88842d2d5 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:12.639490 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 352/719] 10.222.0.55 () {56 vars in 1112 bytes} [Tue Oct 4 16:19:12 2022] GET /identity/v3/services?type=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:19:13.591279 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558b6d6-0c70-4962-97ca-ae1165783eb4 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:13.592157 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558b6d6-0c70-4962-97ca-ae1165783eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:13.592157 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558b6d6-0c70-4962-97ca-ae1165783eb4 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:13.593420 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 368/720] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:13.599007 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b593f9-e3f0-42a5-a2f3-a5c0e3d769df None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:13.599738 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b593f9-e3f0-42a5-a2f3-a5c0e3d769df None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:13.599738 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b593f9-e3f0-42a5-a2f3-a5c0e3d769df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:13.619093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-f3b593f9-e3f0-42a5-a2f3-a5c0e3d769df None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:13.620357 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f3b593f9-e3f0-42a5-a2f3-a5c0e3d769df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:13.685378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:13.700320 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 353/721] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 16:19:14.005434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558b6d6-0c70-4962-97ca-ae1165783eb4 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:14.111908 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558b6d6-0c70-4962-97ca-ae1165783eb4 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:14.147028 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ac482-7c29-422a-a593-ee66a90d7afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:14.147745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ac482-7c29-422a-a593-ee66a90d7afc None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:14.148020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ac482-7c29-422a-a593-ee66a90d7afc None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:14.148301 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ac482-7c29-422a-a593-ee66a90d7afc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:14.161479 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ac482-7c29-422a-a593-ee66a90d7afc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:19:14.167231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-eb1ac482-7c29-422a-a593-ee66a90d7afc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:19:14.167231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:14.167231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:14.167231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:14.167231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:14.167231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:14.167231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:14.167231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:14.167231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:14.167231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:14.167231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:14.167231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:14.167231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:19:14.167231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:19:14.167231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:19:14.167231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:19:14.168383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:19:14.168383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:19:14.168383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:19:14.168383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:19:14.168383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:14.168383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:14.168383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:14.168383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:14.168383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:14.168383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:14.168383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:14.168383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:14.168383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:14.168383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:14.168383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:14.168383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:14.169291 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:14.169291 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:14.169291 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:14.169291 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:14.169291 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:19:14.169291 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:19:14.169291 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:19:14.169291 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:19:14.169291 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:19:14.169291 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:19:14.169291 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:19:14.169291 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:14.172872 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 369/722] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Oct 4 16:19:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:14.189067 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b593f9-e3f0-42a5-a2f3-a5c0e3d769df None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:14.291575 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cfbf5-974e-4573-be47-61bd89d1b3d5 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:14.291781 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cfbf5-974e-4573-be47-61bd89d1b3d5 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:14.292036 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cfbf5-974e-4573-be47-61bd89d1b3d5 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:14.293982 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 370/723] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:19:14.300437 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d6f45-812a-4de1-ac48-ed9ffef20ab1 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:14.300789 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d6f45-812a-4de1-ac48-ed9ffef20ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:14.300986 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d6f45-812a-4de1-ac48-ed9ffef20ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:14.321301 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-440d6f45-812a-4de1-ac48-ed9ffef20ab1 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:14.322554 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-440d6f45-812a-4de1-ac48-ed9ffef20ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:14.363375 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:14.434939 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 371/724] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 16:19:14.483438 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b593f9-e3f0-42a5-a2f3-a5c0e3d769df None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:14.532601 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2a4c6-9e30-43a6-b0e4-4ed7fddb110c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:14.533220 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2a4c6-9e30-43a6-b0e4-4ed7fddb110c None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:14.533497 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2a4c6-9e30-43a6-b0e4-4ed7fddb110c None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:14.533989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2a4c6-9e30-43a6-b0e4-4ed7fddb110c None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:14.534921 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2a4c6-9e30-43a6-b0e4-4ed7fddb110c None admin] RBAC: Adding query filter params (name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:14.535252 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2a4c6-9e30-43a6-b0e4-4ed7fddb110c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:14.536644 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2a4c6-9e30-43a6-b0e4-4ed7fddb110c None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:14.551075 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 354/725] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Oct 4 16:19:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:14.556750 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d6f45-812a-4de1-ac48-ed9ffef20ab1 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:14.701895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d6f45-812a-4de1-ac48-ed9ffef20ab1 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:14.763873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86582c0-d002-4b41-86ca-de668767375d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:14.764520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86582c0-d002-4b41-86ca-de668767375d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:14.764788 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86582c0-d002-4b41-86ca-de668767375d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:14.765065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86582c0-d002-4b41-86ca-de668767375d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:14.780387 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86582c0-d002-4b41-86ca-de668767375d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:14.781859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86582c0-d002-4b41-86ca-de668767375d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:14.804760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-a86582c0-d002-4b41-86ca-de668767375d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:14.804760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:14.804760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:14.804760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:14.804760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:14.804760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:14.804760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:14.804760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:14.804760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:14.804760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:14.804760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:14.804760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:14.804760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:14.804760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:14.804760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:14.804760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:14.806584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:14.806584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:14.806584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:14.806584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:14.806584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:14.806584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:14.806584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:14.806584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:14.806584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:14.806584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:14.806584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:14.806584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:14.806584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:14.806584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:14.806584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:14.806584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:14.806584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:14.808491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:14.808491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:14.808491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:14.808491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 372/726] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:14.815678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2a4c6-9e30-43a6-b0e4-4ed7fddb110c None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:14.829553 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86582c0-d002-4b41-86ca-de668767375d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:14.862962 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:14.942733 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:14.987972 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2a4c6-9e30-43a6-b0e4-4ed7fddb110c None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:15.012348 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86582c0-d002-4b41-86ca-de668767375d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:15.023442 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1eb54d-6fbc-4484-be14-d2026771290f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:15.024070 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eb54d-6fbc-4484-be14-d2026771290f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:15.024346 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eb54d-6fbc-4484-be14-d2026771290f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:15.024623 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eb54d-6fbc-4484-be14-d2026771290f None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:15.025476 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1eb54d-6fbc-4484-be14-d2026771290f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:15.025839 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1eb54d-6fbc-4484-be14-d2026771290f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:15.027389 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1eb54d-6fbc-4484-be14-d2026771290f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:15.040866 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 355/727] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:15.048230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1eb54d-6fbc-4484-be14-d2026771290f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:15.095345 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298ba58-8c83-4083-9e03-129078530284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:15.095900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298ba58-8c83-4083-9e03-129078530284 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:15.096175 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298ba58-8c83-4083-9e03-129078530284 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:15.096444 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298ba58-8c83-4083-9e03-129078530284 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:15.122540 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298ba58-8c83-4083-9e03-129078530284 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:19:15.129897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-8298ba58-8c83-4083-9e03-129078530284 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:19:15.129897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:15.129897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:15.129897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:15.129897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:15.129897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:15.129897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:15.129897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:15.129897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:15.129897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:15.129897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:15.129897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:15.129897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:19:15.129897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:19:15.129897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:19:15.129897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:19:15.130879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:19:15.130879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:19:15.130879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:19:15.130879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:19:15.130879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:15.130879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:15.130879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:15.130879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:15.130879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:15.130879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:15.130879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:15.130879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:15.130879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:15.130879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:15.130879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:15.130879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:15.131753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:15.131753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:15.131753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:15.131753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:15.131753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:19:15.131753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:19:15.131753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:19:15.131753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:19:15.131753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:19:15.131753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:19:15.131753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:19:15.131753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:15.131753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 373/728] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:19:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:15.137127 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298ba58-8c83-4083-9e03-129078530284 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:15.251358 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:15.269582 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1eb54d-6fbc-4484-be14-d2026771290f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:15.275781 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298ba58-8c83-4083-9e03-129078530284 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:15.304915 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:15.337814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262b6a1-ec77-4e63-b781-6a482944483c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:15.338437 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262b6a1-ec77-4e63-b781-6a482944483c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:15.338713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262b6a1-ec77-4e63-b781-6a482944483c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:15.339031 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262b6a1-ec77-4e63-b781-6a482944483c None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:15.339746 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262b6a1-ec77-4e63-b781-6a482944483c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:15.340044 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262b6a1-ec77-4e63-b781-6a482944483c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:15.342888 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262b6a1-ec77-4e63-b781-6a482944483c None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:15.346297 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92a782-32e6-410b-a78a-68abdff96b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:15.346884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92a782-32e6-410b-a78a-68abdff96b1c None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:15.347190 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92a782-32e6-410b-a78a-68abdff96b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:15.347456 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92a782-32e6-410b-a78a-68abdff96b1c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:15.362036 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 374/729] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:19:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:15.362388 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92a782-32e6-410b-a78a-68abdff96b1c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:15.363752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92a782-32e6-410b-a78a-68abdff96b1c None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:15.367934 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262b6a1-ec77-4e63-b781-6a482944483c None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:15.386006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-fa92a782-32e6-410b-a78a-68abdff96b1c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 16:19:15.386006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:15.386006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:15.386006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:15.386006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:15.386006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:15.386006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:15.386006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:15.386006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:15.386006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:15.386006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:15.386006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:15.386006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:19:15.386006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:19:15.386006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:19:15.386006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:19:15.387081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:15.387081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:15.387081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:19:15.387081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:15.387081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:19:15.387081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:15.387081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:15.387081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:15.387081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:15.387081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:15.387081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:15.387081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:15.387081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:15.387081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:15.387081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:15.387081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:15.387081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:15.387081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:15.388261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:15.388261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:15.388261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:19:15.388261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:19:15.388261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:19:15.388261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:19:15.388261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:19:15.388261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:19:15.388261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 16:19:15.388261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:15.388261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 356/730] 10.222.0.55 () {56 vars in 1117 bytes} [Tue Oct 4 16:19:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:15.395303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92a782-32e6-410b-a78a-68abdff96b1c None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:15.499697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262b6a1-ec77-4e63-b781-6a482944483c None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:15.522636 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92a782-32e6-410b-a78a-68abdff96b1c None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:15.536373 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ceb03-6aa3-4ff2-ab67-f2bfbb6354d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:15.537119 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ceb03-6aa3-4ff2-ab67-f2bfbb6354d6 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:15.537674 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ceb03-6aa3-4ff2-ab67-f2bfbb6354d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:15.537995 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ceb03-6aa3-4ff2-ab67-f2bfbb6354d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:15.541763 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:15.551018 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ceb03-6aa3-4ff2-ab67-f2bfbb6354d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:15.552473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ceb03-6aa3-4ff2-ab67-f2bfbb6354d6 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:15.567837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-970ceb03-6aa3-4ff2-ab67-f2bfbb6354d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:15.567837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:15.567837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:15.567837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:15.567837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:15.567837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:15.567837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:15.567837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:15.567837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:15.567837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:15.567837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:15.567837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:15.567837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:15.567837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:15.567837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:15.567837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:15.568865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:15.568865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:15.568865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:15.568865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:15.568865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:15.568865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:15.568865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:15.568865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:15.568865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:15.568865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:15.568865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:15.568865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:15.568865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:15.568865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:15.568865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:15.568865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:15.568865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:15.569806 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:15.569806 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:15.569806 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:15.569806 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 375/731] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:15.570706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28068a5e-2d27-48b4-be72-1425d02d2208 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:15.570706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28068a5e-2d27-48b4-be72-1425d02d2208 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:15.570706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28068a5e-2d27-48b4-be72-1425d02d2208 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:15.578205 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 376/732] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:15.578205 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4242db-2e4a-4a65-873b-75d3418a7df4 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:15.578205 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4242db-2e4a-4a65-873b-75d3418a7df4 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:15.578205 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4242db-2e4a-4a65-873b-75d3418a7df4 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:15.578205 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 377/733] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:15.578205 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4242db-2e4a-4a65-873b-75d3418a7df4 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:15.588361 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87670b26-52ab-4822-924c-8271ca1002b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:15.589457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87670b26-52ab-4822-924c-8271ca1002b0 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:15.590536 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87670b26-52ab-4822-924c-8271ca1002b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:15.590818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87670b26-52ab-4822-924c-8271ca1002b0 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:15.591594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87670b26-52ab-4822-924c-8271ca1002b0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:15.591900 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87670b26-52ab-4822-924c-8271ca1002b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:15.593941 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87670b26-52ab-4822-924c-8271ca1002b0 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:15.612908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 357/734] 10.222.0.55 () {56 vars in 1149 bytes} [Tue Oct 4 16:19:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:15.614247 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de53110-d056-4a0b-870b-dc6c5da29870 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:15.614529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de53110-d056-4a0b-870b-dc6c5da29870 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:15.614816 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de53110-d056-4a0b-870b-dc6c5da29870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:15.632526 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-5de53110-d056-4a0b-870b-dc6c5da29870 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:15.633753 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-5de53110-d056-4a0b-870b-dc6c5da29870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:15.663357 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:15.685460 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4242db-2e4a-4a65-873b-75d3418a7df4 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:15.707346 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 358/735] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:19:15.709040 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c0190-d684-4841-93e8-ab5ca641a335 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:15.709321 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c0190-d684-4841-93e8-ab5ca641a335 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:15.709590 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c0190-d684-4841-93e8-ab5ca641a335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:15.731394 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241ba70-3bc0-47a2-87fc-6e29b53d10d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:15.732122 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241ba70-3bc0-47a2-87fc-6e29b53d10d1 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:15.732306 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241ba70-3bc0-47a2-87fc-6e29b53d10d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:15.732555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241ba70-3bc0-47a2-87fc-6e29b53d10d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:15.733200 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241ba70-3bc0-47a2-87fc-6e29b53d10d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:15.733499 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241ba70-3bc0-47a2-87fc-6e29b53d10d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:15.734909 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241ba70-3bc0-47a2-87fc-6e29b53d10d1 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:15.739556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-ed4c0190-d684-4841-93e8-ab5ca641a335 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:15.740948 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ed4c0190-d684-4841-93e8-ab5ca641a335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:15.747763 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 378/736] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:15.749099 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bce0e-fd05-49e4-a229-06190c07f24c None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:15.749384 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bce0e-fd05-49e4-a229-06190c07f24c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:15.749653 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bce0e-fd05-49e4-a229-06190c07f24c None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:15.750858 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 379/737] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:15.751636 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bce0e-fd05-49e4-a229-06190c07f24c None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:15.804256 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:15.820612 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 359/738] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:19:15.821475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c0190-d684-4841-93e8-ab5ca641a335 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:15.879735 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bce0e-fd05-49e4-a229-06190c07f24c None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:15.926429 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0102ff-112b-4f9e-8619-758987747a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:15.928306 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0102ff-112b-4f9e-8619-758987747a31 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:15.929622 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0102ff-112b-4f9e-8619-758987747a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:15.930047 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0102ff-112b-4f9e-8619-758987747a31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:15.949502 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:15.959558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c0190-d684-4841-93e8-ab5ca641a335 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:15.996222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297dcd6-77f8-44f6-8165-af211f3471fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:15.996862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297dcd6-77f8-44f6-8165-af211f3471fd None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:15.997140 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297dcd6-77f8-44f6-8165-af211f3471fd None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:15.997411 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297dcd6-77f8-44f6-8165-af211f3471fd None admin] PATH_INFO: `/v3/users/swift` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:16.004757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297dcd6-77f8-44f6-8165-af211f3471fd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:16.006207 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297dcd6-77f8-44f6-8165-af211f3471fd None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:16.017929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0102ff-112b-4f9e-8619-758987747a31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:16.018272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-9297dcd6-77f8-44f6-8165-af211f3471fd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 16:19:16.018272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:16.018272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:16.018272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:16.018272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:16.018272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:16.018272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:16.018272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:16.018272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:16.018272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:16.018272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:16.018272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:16.018272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:19:16.018272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:19:16.018272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:19:16.018272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:19:16.019421 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:16.019421 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:16.019421 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:19:16.019421 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:16.019421 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:19:16.019421 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:16.019421 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:16.019421 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:16.019421 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:16.019421 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:16.019421 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:16.019421 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:16.019421 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:16.019421 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:16.019421 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:16.019421 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:16.019421 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:16.019421 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:16.020399 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:16.020399 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:16.020399 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:19:16.020399 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:19:16.020399 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:19:16.020399 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:19:16.020399 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:19:16.020399 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:19:16.020399 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 16:19:16.020399 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:16.020399 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 360/739] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:19:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:16.021013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d140864-9eeb-46c8-b72d-aef773a7aa4a None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:16.021221 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d140864-9eeb-46c8-b72d-aef773a7aa4a None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:16.021497 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d140864-9eeb-46c8-b72d-aef773a7aa4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:16.022790 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0102ff-112b-4f9e-8619-758987747a31 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:16.040284 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-2d140864-9eeb-46c8-b72d-aef773a7aa4a None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:16.041485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-2d140864-9eeb-46c8-b72d-aef773a7aa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:16.078643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:16.118061 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 361/740] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 16:19:16.119033 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d140864-9eeb-46c8-b72d-aef773a7aa4a None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:16.149177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 380/741] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:19:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:19:16.149938 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0102ff-112b-4f9e-8619-758987747a31 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:16.209597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:16.235309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d140864-9eeb-46c8-b72d-aef773a7aa4a None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:16.263175 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0102ff-112b-4f9e-8619-758987747a31 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:16.290057 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38b3b5-0fc7-4707-ab8d-e02b9df0b434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:16.290699 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38b3b5-0fc7-4707-ab8d-e02b9df0b434 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:16.290972 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38b3b5-0fc7-4707-ab8d-e02b9df0b434 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:16.291269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38b3b5-0fc7-4707-ab8d-e02b9df0b434 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:16.303875 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a38b3b5-0fc7-4707-ab8d-e02b9df0b434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:19:16.306033 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963afe82-a787-45e1-826f-e13b1d732d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:16.306878 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963afe82-a787-45e1-826f-e13b1d732d1b None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:16.307329 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963afe82-a787-45e1-826f-e13b1d732d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:16.307814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963afe82-a787-45e1-826f-e13b1d732d1b None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:16.308811 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963afe82-a787-45e1-826f-e13b1d732d1b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:16.309520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963afe82-a787-45e1-826f-e13b1d732d1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:16.309682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-0a38b3b5-0fc7-4707-ab8d-e02b9df0b434 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:19:16.309682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:16.309682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:16.309682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:16.309682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:16.309682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:16.309682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:16.309682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:16.309682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:16.309682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:16.309682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:16.309682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:16.309682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:19:16.309682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:19:16.309682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:19:16.309682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:19:16.311426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:19:16.311426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:19:16.311426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:19:16.311426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:19:16.311426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:16.311426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:16.311426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:16.311426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:16.311426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:16.311426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:16.311426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:16.311426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:16.311426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:16.311426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:16.311426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:16.311426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:16.313302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:16.313302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:16.313302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:16.313302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:16.313302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:19:16.313302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:19:16.313302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:19:16.313302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:19:16.313302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:19:16.313302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:19:16.313302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:19:16.313302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:16.313302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 362/742] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:19:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:16.314392 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963afe82-a787-45e1-826f-e13b1d732d1b None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:16.314604 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38b3b5-0fc7-4707-ab8d-e02b9df0b434 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:16.337963 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 381/743] 10.222.0.55 () {56 vars in 1135 bytes} [Tue Oct 4 16:19:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:16.338835 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963afe82-a787-45e1-826f-e13b1d732d1b None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:16.349923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:16.428175 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38b3b5-0fc7-4707-ab8d-e02b9df0b434 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:16.463703 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55165d1-b823-42bb-a4b1-def1e3945a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:16.464398 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55165d1-b823-42bb-a4b1-def1e3945a8f None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:16.464669 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55165d1-b823-42bb-a4b1-def1e3945a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:16.464930 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55165d1-b823-42bb-a4b1-def1e3945a8f None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:16.465567 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55165d1-b823-42bb-a4b1-def1e3945a8f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:16.466933 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55165d1-b823-42bb-a4b1-def1e3945a8f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:16.467093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963afe82-a787-45e1-826f-e13b1d732d1b None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:16.484499 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 363/744] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Oct 4 16:19:16 2022] POST /identity/v3/services => generated 251 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:19:16.485345 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55165d1-b823-42bb-a4b1-def1e3945a8f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:16.489357 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:16.525113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66469f33-8573-4bcc-8be2-963eceec2c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:16.525810 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66469f33-8573-4bcc-8be2-963eceec2c72 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:16.526049 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66469f33-8573-4bcc-8be2-963eceec2c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:16.526314 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66469f33-8573-4bcc-8be2-963eceec2c72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:16.538823 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66469f33-8573-4bcc-8be2-963eceec2c72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:16.540360 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66469f33-8573-4bcc-8be2-963eceec2c72 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:16.556577 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-66469f33-8573-4bcc-8be2-963eceec2c72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:16.556577 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:16.556577 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:16.556577 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:16.556577 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:16.556577 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:16.556577 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:16.556577 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:16.556577 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:16.556577 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:16.556577 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:16.556577 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:16.556577 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:16.556577 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:16.556577 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:16.556577 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:16.557658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:16.557658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:16.557658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:16.557658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:16.557658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:16.557658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:16.557658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:16.557658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:16.557658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:16.557658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:16.557658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:16.557658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:16.557658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:16.557658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:16.557658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:16.557658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:16.557658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:16.558629 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:16.558629 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:16.558629 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:16.558629 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 382/745] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:16.558629 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66469f33-8573-4bcc-8be2-963eceec2c72 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:16.624164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:16.630552 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55165d1-b823-42bb-a4b1-def1e3945a8f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:16.673064 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b368586-fa19-48dc-81a1-cfc4fa07375a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:16.674052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b368586-fa19-48dc-81a1-cfc4fa07375a None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:16.674052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b368586-fa19-48dc-81a1-cfc4fa07375a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:16.674239 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b368586-fa19-48dc-81a1-cfc4fa07375a None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:16.675024 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b368586-fa19-48dc-81a1-cfc4fa07375a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:16.675252 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b368586-fa19-48dc-81a1-cfc4fa07375a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:16.676638 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b368586-fa19-48dc-81a1-cfc4fa07375a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:16.684777 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66469f33-8573-4bcc-8be2-963eceec2c72 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:16.685455 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 364/746] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:19:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:16.686396 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b368586-fa19-48dc-81a1-cfc4fa07375a None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:16.728677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb4134-6c90-4634-b6fe-115873ea6636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:16.729723 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb4134-6c90-4634-b6fe-115873ea6636 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:16.730208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb4134-6c90-4634-b6fe-115873ea6636 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:16.730661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb4134-6c90-4634-b6fe-115873ea6636 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:16.759538 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:16.798041 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b368586-fa19-48dc-81a1-cfc4fa07375a None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:16.815482 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb4134-6c90-4634-b6fe-115873ea6636 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:16.816967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb4134-6c90-4634-b6fe-115873ea6636 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:16.835496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bb4a2-ec5f-4e2e-9dfa-2b60810b237a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:16.836725 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bb4a2-ec5f-4e2e-9dfa-2b60810b237a None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:16.837145 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bb4a2-ec5f-4e2e-9dfa-2b60810b237a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:16.837571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bb4a2-ec5f-4e2e-9dfa-2b60810b237a None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:16.838375 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647bb4a2-ec5f-4e2e-9dfa-2b60810b237a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:16.840033 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647bb4a2-ec5f-4e2e-9dfa-2b60810b237a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:16.856573 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 365/747] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Oct 4 16:19:16 2022] POST /identity/v3/services => generated 240 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:19:16.857099 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bb4a2-ec5f-4e2e-9dfa-2b60810b237a None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:16.895297 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:16.961896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 383/748] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:19:16 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 16:19:16.963338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb4134-6c90-4634-b6fe-115873ea6636 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:16.991822 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bb4a2-ec5f-4e2e-9dfa-2b60810b237a None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:17.018811 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:17.035389 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57d963-9aca-49fe-a882-1d4fba0a92e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:17.036153 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57d963-9aca-49fe-a882-1d4fba0a92e2 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:17.036489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57d963-9aca-49fe-a882-1d4fba0a92e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:17.036827 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57d963-9aca-49fe-a882-1d4fba0a92e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:17.037552 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57d963-9aca-49fe-a882-1d4fba0a92e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:17.037967 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57d963-9aca-49fe-a882-1d4fba0a92e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:17.039505 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57d963-9aca-49fe-a882-1d4fba0a92e2 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:17.053777 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 366/749] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:17.055516 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57d963-9aca-49fe-a882-1d4fba0a92e2 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:17.100515 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb4134-6c90-4634-b6fe-115873ea6636 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:17.147718 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea669e-47d5-4a69-a9ef-f1a1b6b79c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:17.148660 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea669e-47d5-4a69-a9ef-f1a1b6b79c7a None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:17.149080 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea669e-47d5-4a69-a9ef-f1a1b6b79c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:17.149489 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea669e-47d5-4a69-a9ef-f1a1b6b79c7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:17.160852 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea669e-47d5-4a69-a9ef-f1a1b6b79c7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:17.162685 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea669e-47d5-4a69-a9ef-f1a1b6b79c7a None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:17.180155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-0dea669e-47d5-4a69-a9ef-f1a1b6b79c7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:17.180155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:17.180155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:17.180155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:17.180155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:17.180155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:17.180155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:17.180155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:17.180155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:17.180155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:17.180155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:17.180155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:17.180155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:17.180155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:17.180155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:17.180155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:17.181884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:17.181884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:17.181884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:17.181884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:17.181884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:17.181884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:17.181884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:17.181884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:17.181884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:17.181884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:17.181884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:17.181884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:17.181884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:17.181884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:17.181884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:17.181884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:17.181884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:17.183563 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:17.183563 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:17.183563 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:17.183563 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 384/750] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:17.183563 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea669e-47d5-4a69-a9ef-f1a1b6b79c7a None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:17.201127 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:17.208892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57d963-9aca-49fe-a882-1d4fba0a92e2 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:17.251097 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f308b2-dcbf-4100-b63c-9e16fefe812f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:17.252289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f308b2-dcbf-4100-b63c-9e16fefe812f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:17.252819 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f308b2-dcbf-4100-b63c-9e16fefe812f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:17.253285 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f308b2-dcbf-4100-b63c-9e16fefe812f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:17.267072 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f308b2-dcbf-4100-b63c-9e16fefe812f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:17.269855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f308b2-dcbf-4100-b63c-9e16fefe812f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:17.292978 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-e0f308b2-dcbf-4100-b63c-9e16fefe812f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:17.292978 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:17.292978 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:17.292978 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:17.292978 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:17.292978 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:17.292978 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:17.292978 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:17.292978 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:17.292978 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:17.292978 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:17.292978 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:17.292978 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:17.292978 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:17.292978 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:17.292978 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:17.294019 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:17.294019 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:17.294019 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:17.294019 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:17.294019 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:17.294019 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:17.294019 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:17.294019 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:17.294019 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:17.294019 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:17.294019 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:17.294019 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:17.294019 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:17.294019 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:17.294019 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:17.294019 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:17.294019 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:17.295393 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:17.295393 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:17.295393 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:17.298535 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 367/751] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:17.299932 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f308b2-dcbf-4100-b63c-9e16fefe812f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:17.313156 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea669e-47d5-4a69-a9ef-f1a1b6b79c7a None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:17.353315 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b62858-c40c-471e-9512-90790845d71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:17.354417 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b62858-c40c-471e-9512-90790845d71f None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:17.354872 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b62858-c40c-471e-9512-90790845d71f None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:17.355271 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b62858-c40c-471e-9512-90790845d71f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:17.363412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:17.363940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b62858-c40c-471e-9512-90790845d71f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:17.365707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b62858-c40c-471e-9512-90790845d71f None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:17.379326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-29b62858-c40c-471e-9512-90790845d71f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:17.379326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:17.379326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:17.379326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:17.379326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:17.379326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:17.379326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:17.379326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:17.379326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:17.379326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:17.379326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:17.379326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:17.379326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:19:17.379326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:19:17.379326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:19:17.380458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:19:17.380458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:17.380458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:17.380458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:17.380458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:17.380458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:17.380458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:17.380458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:17.380458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:17.380458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:17.380458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:17.380458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:17.380458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:17.380458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:17.380458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:17.380458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:17.380458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:17.381560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:19:17.381560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:19:17.381560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:19:17.381560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:19:17.381560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:19:17.381560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:19:17.381560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:17.381560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:17.388199 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 385/752] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:19:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:17.389607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b62858-c40c-471e-9512-90790845d71f None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:17.429301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f308b2-dcbf-4100-b63c-9e16fefe812f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:17.469792 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b38c2-2a14-427e-8c81-09e524d056c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:17.470662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b38c2-2a14-427e-8c81-09e524d056c7 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:17.471163 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b38c2-2a14-427e-8c81-09e524d056c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:17.471565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b38c2-2a14-427e-8c81-09e524d056c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:17.472372 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b38c2-2a14-427e-8c81-09e524d056c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:17.472813 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b38c2-2a14-427e-8c81-09e524d056c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:17.474329 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b38c2-2a14-427e-8c81-09e524d056c7 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:17.492519 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:17.492800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 368/753] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:17.493898 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b38c2-2a14-427e-8c81-09e524d056c7 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:17.530878 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b62858-c40c-471e-9512-90790845d71f None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:17.590814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a5beb-4ab2-4b79-ad07-1974b40192dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:17.591728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a5beb-4ab2-4b79-ad07-1974b40192dc None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:17.592168 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a5beb-4ab2-4b79-ad07-1974b40192dc None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:17.592584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a5beb-4ab2-4b79-ad07-1974b40192dc None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:17.593368 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a5beb-4ab2-4b79-ad07-1974b40192dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:17.593805 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a5beb-4ab2-4b79-ad07-1974b40192dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:17.595385 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a5beb-4ab2-4b79-ad07-1974b40192dc None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:17.613493 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 386/754] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:17.614631 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a5beb-4ab2-4b79-ad07-1974b40192dc None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:17.620216 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:17.629335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b38c2-2a14-427e-8c81-09e524d056c7 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:17.677960 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8baab48-0ebf-4523-b3bf-8b234b4c17e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:17.678898 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8baab48-0ebf-4523-b3bf-8b234b4c17e5 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:17.679326 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8baab48-0ebf-4523-b3bf-8b234b4c17e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:17.679995 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8baab48-0ebf-4523-b3bf-8b234b4c17e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:17.681103 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8baab48-0ebf-4523-b3bf-8b234b4c17e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:17.681508 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8baab48-0ebf-4523-b3bf-8b234b4c17e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:17.683905 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8baab48-0ebf-4523-b3bf-8b234b4c17e5 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:17.704893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 369/755] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:19:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:17.704893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8baab48-0ebf-4523-b3bf-8b234b4c17e5 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:17.739151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a5beb-4ab2-4b79-ad07-1974b40192dc None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:17.772371 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:17.784440 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558a158-56b5-4ae9-a892-d6341bb9ccda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:17.785154 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558a158-56b5-4ae9-a892-d6341bb9ccda None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:17.785532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558a158-56b5-4ae9-a892-d6341bb9ccda None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:17.785900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558a158-56b5-4ae9-a892-d6341bb9ccda None admin] PATH_INFO: `/v3/users/nova` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:17.796396 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558a158-56b5-4ae9-a892-d6341bb9ccda None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:17.798923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558a158-56b5-4ae9-a892-d6341bb9ccda None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:17.814644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-5558a158-56b5-4ae9-a892-d6341bb9ccda None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 16:19:17.814644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:17.814644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:17.814644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:17.814644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:17.814644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:17.814644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:17.814644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:17.814644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:17.814644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:17.814644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:17.814644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:17.814644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:19:17.814644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:19:17.814644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:19:17.814644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:19:17.816232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:17.816232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:17.816232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:19:17.816232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:17.816232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:19:17.816232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:17.816232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:17.816232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:17.816232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:17.816232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:17.816232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:17.816232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:17.816232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:17.816232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:17.816232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:17.816232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:17.816232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:17.816232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:17.817196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:17.817196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:17.817196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:19:17.817196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:19:17.817196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:19:17.817196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:19:17.817196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:19:17.817196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:19:17.817196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 16:19:17.817196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:17.817196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 387/756] 10.222.0.55 () {56 vars in 1093 bytes} [Tue Oct 4 16:19:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:17.817196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558a158-56b5-4ae9-a892-d6341bb9ccda None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:17.820330 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8baab48-0ebf-4523-b3bf-8b234b4c17e5 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:17.856986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ee462-2cc2-448d-b3bb-d473d8a665de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:17.858399 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ee462-2cc2-448d-b3bb-d473d8a665de None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:17.858850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ee462-2cc2-448d-b3bb-d473d8a665de None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:17.859312 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ee462-2cc2-448d-b3bb-d473d8a665de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:17.866735 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ee462-2cc2-448d-b3bb-d473d8a665de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:17.868579 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ee462-2cc2-448d-b3bb-d473d8a665de None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:17.881287 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-040ee462-2cc2-448d-b3bb-d473d8a665de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:17.881287 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:17.881287 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:17.881287 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:17.881287 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:17.881287 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:17.881287 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:17.881287 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:17.881287 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:17.881287 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:17.881287 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:17.881287 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:17.881287 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:19:17.881287 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:19:17.881287 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:19:17.882311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:19:17.882311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:17.882311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:17.882311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:17.882311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:17.882311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:17.882311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:17.882311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:17.882311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:17.882311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:17.882311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:17.882311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:17.882311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:17.882311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:17.882311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:17.882311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:17.882311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:17.883245 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:19:17.883245 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:19:17.883245 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:19:17.883245 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:19:17.883245 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:19:17.883245 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:19:17.883245 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:17.883245 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:17.890590 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 370/757] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:19:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:17.891951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ee462-2cc2-448d-b3bb-d473d8a665de None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:17.911987 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:17.949949 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558a158-56b5-4ae9-a892-d6341bb9ccda None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:17.990110 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3363f-ee81-4f76-a079-bec45ff5a097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:17.991125 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3363f-ee81-4f76-a079-bec45ff5a097 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:17.991552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3363f-ee81-4f76-a079-bec45ff5a097 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:17.991968 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3363f-ee81-4f76-a079-bec45ff5a097 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:17.992858 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3363f-ee81-4f76-a079-bec45ff5a097 None admin] RBAC: Adding query filter params (role.id=2165a726b4034e1584166027f2361b5f, scope.project.id=e480e782c4fa403a913ca7179db0843b, user.id=05cfc9d62a244701a5df524d1c26f107) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:17.993311 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3363f-ee81-4f76-a079-bec45ff5a097 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:17.994896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3363f-ee81-4f76-a079-bec45ff5a097 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:18.002106 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 388/758] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:19:17 2022] GET /identity/v3/role_assignments?user.id=05cfc9d62a244701a5df524d1c26f107&scope.project.id=e480e782c4fa403a913ca7179db0843b&role.id=2165a726b4034e1584166027f2361b5f => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:18.003159 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3363f-ee81-4f76-a079-bec45ff5a097 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:18.037463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ee462-2cc2-448d-b3bb-d473d8a665de None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:18.062063 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:18.111880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb6c65-ee43-4cd9-b26a-76e2afa799b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:18.112682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb6c65-ee43-4cd9-b26a-76e2afa799b7 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:18.113342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb6c65-ee43-4cd9-b26a-76e2afa799b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:18.113342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb6c65-ee43-4cd9-b26a-76e2afa799b7 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:18.114330 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb6c65-ee43-4cd9-b26a-76e2afa799b7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:18.114713 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb6c65-ee43-4cd9-b26a-76e2afa799b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:18.116375 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb6c65-ee43-4cd9-b26a-76e2afa799b7 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:18.122910 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3363f-ee81-4f76-a079-bec45ff5a097 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:18.150946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 371/759] 10.222.0.55 () {56 vars in 1133 bytes} [Tue Oct 4 16:19:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:18.156816 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb6c65-ee43-4cd9-b26a-76e2afa799b7 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:18.167024 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbdde0-a189-4684-aedc-3e2e5468f5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:18.168036 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbdde0-a189-4684-aedc-3e2e5468f5c6 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:18.168492 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbdde0-a189-4684-aedc-3e2e5468f5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:18.168959 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbdde0-a189-4684-aedc-3e2e5468f5c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:18.170261 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbdde0-a189-4684-aedc-3e2e5468f5c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:18.170746 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbdde0-a189-4684-aedc-3e2e5468f5c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:18.173442 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbdde0-a189-4684-aedc-3e2e5468f5c6 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:18.188638 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 389/760] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:19:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:18.204223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbdde0-a189-4684-aedc-3e2e5468f5c6 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:18.301885 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:18.365556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb6c65-ee43-4cd9-b26a-76e2afa799b7 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:18.369159 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbdde0-a189-4684-aedc-3e2e5468f5c6 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:18.388878 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:18.427319 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e85ee-e479-4bc4-9817-d441eca3a3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:18.427968 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e85ee-e479-4bc4-9817-d441eca3a3da None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:18.428241 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e85ee-e479-4bc4-9817-d441eca3a3da None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:18.428507 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e85ee-e479-4bc4-9817-d441eca3a3da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:18.432112 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1470cf-1c40-4afe-9527-742a56cc61d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:18.432822 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1470cf-1c40-4afe-9527-742a56cc61d5 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:18.433072 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1470cf-1c40-4afe-9527-742a56cc61d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:18.433338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1470cf-1c40-4afe-9527-742a56cc61d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:18.434065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1470cf-1c40-4afe-9527-742a56cc61d5 None admin] RBAC: Adding query filter params (role.id=066f46534195417295e63a5316632eae, scope.project.id=e480e782c4fa403a913ca7179db0843b, user.id=6590cb6c1c964039b9dea771a647bdac) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:18.434365 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1470cf-1c40-4afe-9527-742a56cc61d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:18.437407 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1470cf-1c40-4afe-9527-742a56cc61d5 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:18.462700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e85ee-e479-4bc4-9817-d441eca3a3da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:18.469764 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e85ee-e479-4bc4-9817-d441eca3a3da None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:18.470496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 390/761] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:19:18 2022] GET /identity/v3/role_assignments?user.id=6590cb6c1c964039b9dea771a647bdac&scope.project.id=e480e782c4fa403a913ca7179db0843b&role.id=066f46534195417295e63a5316632eae => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:18.516522 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-015e85ee-e479-4bc4-9817-d441eca3a3da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:18.516522 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:18.516522 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:18.516522 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:18.516522 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:18.516522 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:18.516522 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:18.516522 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:18.516522 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:18.516522 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:18.516522 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:18.516522 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:18.516522 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:18.516522 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:18.516522 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:18.516522 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:18.517565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:18.517565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:18.517565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:18.517565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:18.517565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:18.517565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:18.517565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:18.517565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:18.517565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:18.517565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:18.517565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:18.517565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:18.517565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:18.517565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:18.517565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:18.517565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:18.517565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:18.518451 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:18.518451 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:18.518451 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:18.519070 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 372/762] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:19:18.527442 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1470cf-1c40-4afe-9527-742a56cc61d5 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:18.723328 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1470cf-1c40-4afe-9527-742a56cc61d5 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:18.773643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e58aec-e4a9-4796-9ac6-7db034402450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:18.774444 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e58aec-e4a9-4796-9ac6-7db034402450 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:18.774719 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e58aec-e4a9-4796-9ac6-7db034402450 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:18.775022 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e58aec-e4a9-4796-9ac6-7db034402450 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:18.775656 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e58aec-e4a9-4796-9ac6-7db034402450 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:18.775953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e58aec-e4a9-4796-9ac6-7db034402450 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:18.777374 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e58aec-e4a9-4796-9ac6-7db034402450 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:18.792029 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 391/763] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:18.798298 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e85ee-e479-4bc4-9817-d441eca3a3da None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:18.957216 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf133bdf-5825-4946-88a1-4629e9f7b111 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:18.957742 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf133bdf-5825-4946-88a1-4629e9f7b111 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:18.957742 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf133bdf-5825-4946-88a1-4629e9f7b111 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:18.959295 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 392/764] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:19:18.964688 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c40b0-dfb6-4c9a-8627-fcf29751068a None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:18.964962 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c40b0-dfb6-4c9a-8627-fcf29751068a None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:18.965232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c40b0-dfb6-4c9a-8627-fcf29751068a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:18.983633 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e85ee-e479-4bc4-9817-d441eca3a3da None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:19.005354 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-059c40b0-dfb6-4c9a-8627-fcf29751068a None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:19.006575 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-059c40b0-dfb6-4c9a-8627-fcf29751068a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:19.016155 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:19.024869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89228472-56fa-4d2e-9cf8-8c2c4ef2a528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:19.026240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89228472-56fa-4d2e-9cf8-8c2c4ef2a528 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:19.026960 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89228472-56fa-4d2e-9cf8-8c2c4ef2a528 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:19.027608 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89228472-56fa-4d2e-9cf8-8c2c4ef2a528 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:19.036917 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89228472-56fa-4d2e-9cf8-8c2c4ef2a528 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:19.042463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89228472-56fa-4d2e-9cf8-8c2c4ef2a528 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:19.062693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-89228472-56fa-4d2e-9cf8-8c2c4ef2a528 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:19.062693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:19.062693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:19.062693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:19.062693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:19.062693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:19.062693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:19.062693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:19.062693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:19.062693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:19.062693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:19.062693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:19.062693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:19:19.062693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:19:19.062693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:19:19.063869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:19:19.063869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:19.063869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:19.063869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:19.063869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:19.063869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:19.063869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:19.063869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:19.063869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:19.063869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:19.063869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:19.063869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:19.063869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:19.063869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:19.063869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:19.063869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:19.063869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:19.065077 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:19:19.065077 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:19:19.065077 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:19:19.065077 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:19:19.065077 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:19:19.065077 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:19:19.065077 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:19.065077 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:19.068597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 373/765] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:19:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:19.072223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:19.074577 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89228472-56fa-4d2e-9cf8-8c2c4ef2a528 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:19.127179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 393/766] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 16:19:19.259073 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89228472-56fa-4d2e-9cf8-8c2c4ef2a528 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:19.307760 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350aa57-6fb0-475a-b6b1-179dca0bb3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:19.308558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350aa57-6fb0-475a-b6b1-179dca0bb3fa None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:19.308834 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350aa57-6fb0-475a-b6b1-179dca0bb3fa None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:19.309101 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350aa57-6fb0-475a-b6b1-179dca0bb3fa None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:19.309805 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350aa57-6fb0-475a-b6b1-179dca0bb3fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:19.310094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350aa57-6fb0-475a-b6b1-179dca0bb3fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:19.311564 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350aa57-6fb0-475a-b6b1-179dca0bb3fa None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:19.328323 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 374/767] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:19:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:19.334372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c40b0-dfb6-4c9a-8627-fcf29751068a None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:19.443597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350aa57-6fb0-475a-b6b1-179dca0bb3fa None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:19.511442 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:19.538107 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c40b0-dfb6-4c9a-8627-fcf29751068a None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:19.602328 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350aa57-6fb0-475a-b6b1-179dca0bb3fa None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:19.614697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bcdf1-ae57-4ef2-bc1b-e620b915eb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:19.615421 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bcdf1-ae57-4ef2-bc1b-e620b915eb06 None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:19.615689 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bcdf1-ae57-4ef2-bc1b-e620b915eb06 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:19.615948 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bcdf1-ae57-4ef2-bc1b-e620b915eb06 None admin] PATH_INFO: `/v3/projects/e480e782c4fa403a913ca7179db0843b/users/6cdee0584fe045028a44c385d032d2c7/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:19.617960 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bcdf1-ae57-4ef2-bc1b-e620b915eb06 None admin] RBAC: Authorizing `identity:create_grant(project_id=e480e782c4fa403a913ca7179db0843b, user_id=6cdee0584fe045028a44c385d032d2c7, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:19.619419 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bcdf1-ae57-4ef2-bc1b-e620b915eb06 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:19.639659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 394/768] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Oct 4 16:19:19 2022] PUT /identity/v3/projects/e480e782c4fa403a913ca7179db0843b/users/6cdee0584fe045028a44c385d032d2c7/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:19:19.679354 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d03eb-d210-454e-9c7b-02272a106315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:19.680058 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d03eb-d210-454e-9c7b-02272a106315 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:19.680338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d03eb-d210-454e-9c7b-02272a106315 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:19.680608 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d03eb-d210-454e-9c7b-02272a106315 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:19.681255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d03eb-d210-454e-9c7b-02272a106315 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:19.682779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d03eb-d210-454e-9c7b-02272a106315 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:19.693741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-2f3d03eb-d210-454e-9c7b-02272a106315 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 16:19:19.693741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:19.693741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 16:19:19.693741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 16:19:19.693741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 16:19:19.693741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 16:19:19.693741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 16:19:19.693741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:19.693741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 16:19:19.693741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:19.693741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:19:19.693741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:19.693741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:19.693741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:19.693741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:19.693741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:19.693741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:19.694944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:19.694944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:19.694944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:19.694944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:19.694944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:19.694944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:19.694944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 16:19:19.694944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 16:19:19.694944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 16:19:19.694944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 16:19:19.694944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:19.694944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:19.694944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:19.694944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:19.694944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:19.694944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:19.696427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:19.696427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:19.696427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:19.696427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:19.696427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:19.696427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:19.696427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:19.696427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:19.696427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:19.696427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:19.696427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 16:19:19.696427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:19.696427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 16:19:19.696427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:19.696427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 375/769] 10.222.0.55 () {56 vars in 1129 bytes} [Tue Oct 4 16:19:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:19:19.701458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bcdf1-ae57-4ef2-bc1b-e620b915eb06 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:19.733803 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:19.819395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90267a1-8e69-4d4c-9029-c2df7dbe9453 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:19.819934 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90267a1-8e69-4d4c-9029-c2df7dbe9453 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:19.820374 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90267a1-8e69-4d4c-9029-c2df7dbe9453 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:19.821872 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 376/770] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:19:19.829938 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02b0dd-abc3-4a7f-ab0c-2882712ca80c None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:19.830417 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02b0dd-abc3-4a7f-ab0c-2882712ca80c None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:19.830881 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02b0dd-abc3-4a7f-ab0c-2882712ca80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:19.850313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bcdf1-ae57-4ef2-bc1b-e620b915eb06 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:19.871173 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-9e02b0dd-abc3-4a7f-ab0c-2882712ca80c None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:19.873869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-9e02b0dd-abc3-4a7f-ab0c-2882712ca80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:19.911565 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f8a4e-62c9-4d25-9c7a-5e60c6ef8c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:19.912476 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f8a4e-62c9-4d25-9c7a-5e60c6ef8c0b None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:19.912915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f8a4e-62c9-4d25-9c7a-5e60c6ef8c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:19.913330 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f8a4e-62c9-4d25-9c7a-5e60c6ef8c0b None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:19.914095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f8a4e-62c9-4d25-9c7a-5e60c6ef8c0b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:19.914637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f8a4e-62c9-4d25-9c7a-5e60c6ef8c0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:19.916176 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f8a4e-62c9-4d25-9c7a-5e60c6ef8c0b None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:19.922175 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 395/771] 10.222.0.55 () {56 vars in 1124 bytes} [Tue Oct 4 16:19:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:19.928030 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f8a4e-62c9-4d25-9c7a-5e60c6ef8c0b None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:20.000627 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 377/772] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:19:20.043497 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:20.062476 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f8a4e-62c9-4d25-9c7a-5e60c6ef8c0b None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:20.114350 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b9f64-850e-4b1d-bfa4-7f37df1f9836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:20.114900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b9f64-850e-4b1d-bfa4-7f37df1f9836 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:20.115199 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b9f64-850e-4b1d-bfa4-7f37df1f9836 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:20.115464 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b9f64-850e-4b1d-bfa4-7f37df1f9836 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:20.116100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b9f64-850e-4b1d-bfa4-7f37df1f9836 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:20.116397 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b9f64-850e-4b1d-bfa4-7f37df1f9836 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:20.117765 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b9f64-850e-4b1d-bfa4-7f37df1f9836 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:20.127427 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 396/773] 10.222.0.55 () {56 vars in 1124 bytes} [Tue Oct 4 16:19:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:19:20.133379 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02b0dd-abc3-4a7f-ab0c-2882712ca80c None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:20.197639 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:20.272682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02b0dd-abc3-4a7f-ab0c-2882712ca80c None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:20.309246 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a8529-1281-4b4f-ae6d-dd0ada5a7327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:20.309877 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a8529-1281-4b4f-ae6d-dd0ada5a7327 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:20.310155 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a8529-1281-4b4f-ae6d-dd0ada5a7327 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:20.310434 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a8529-1281-4b4f-ae6d-dd0ada5a7327 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:20.311169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a8529-1281-4b4f-ae6d-dd0ada5a7327 None admin] RBAC: Adding query filter params (interface=public, service_id=c5f3f443f0bc4b69a0baf400f9eb5ccf, region_id=RegionOne) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:20.311545 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a8529-1281-4b4f-ae6d-dd0ada5a7327 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:20.312937 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a8529-1281-4b4f-ae6d-dd0ada5a7327 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:20.322242 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 378/774] 10.222.0.55 () {56 vars in 1251 bytes} [Tue Oct 4 16:19:20 2022] GET /identity/v3/endpoints?service_id=c5f3f443f0bc4b69a0baf400f9eb5ccf&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:20.328002 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b9f64-850e-4b1d-bfa4-7f37df1f9836 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:20.340552 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a8529-1281-4b4f-ae6d-dd0ada5a7327 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:20.508758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b9f64-850e-4b1d-bfa4-7f37df1f9836 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:20.525625 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a8529-1281-4b4f-ae6d-dd0ada5a7327 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:20.531556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:20.583083 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9663caa-8a3b-4c4f-9e44-e3fb28005923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:20.583083 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9663caa-8a3b-4c4f-9e44-e3fb28005923 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:20.583083 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9663caa-8a3b-4c4f-9e44-e3fb28005923 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:20.583083 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9663caa-8a3b-4c4f-9e44-e3fb28005923 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:20.583434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9663caa-8a3b-4c4f-9e44-e3fb28005923 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:20.584536 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9663caa-8a3b-4c4f-9e44-e3fb28005923 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:20.593933 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 397/775] 10.222.0.55 () {56 vars in 1087 bytes} [Tue Oct 4 16:19:20 2022] GET /identity/v3/services => generated 772 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:20.599985 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec06b1-6871-43d1-a438-aa8e19abf2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:20.600770 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec06b1-6871-43d1-a438-aa8e19abf2ce None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:20.601043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec06b1-6871-43d1-a438-aa8e19abf2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:20.601314 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec06b1-6871-43d1-a438-aa8e19abf2ce None admin] PATH_INFO: `/v3/services/network` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:20.601913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec06b1-6871-43d1-a438-aa8e19abf2ce None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:20.603333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec06b1-6871-43d1-a438-aa8e19abf2ce None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:20.616556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-49ec06b1-6871-43d1-a438-aa8e19abf2ce None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 16:19:20.616556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:20.616556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 16:19:20.616556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 16:19:20.616556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 16:19:20.616556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 16:19:20.616556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 16:19:20.616556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:20.616556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 16:19:20.616556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:20.616556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:19:20.616556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:20.616556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:20.616556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:20.616556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:20.616556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:20.616556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:20.617625 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:20.617625 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:20.617625 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:20.617625 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:20.617625 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:20.617625 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:20.617625 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 16:19:20.617625 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 16:19:20.617625 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 16:19:20.617625 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 16:19:20.617625 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:20.617625 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:20.617625 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:20.617625 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:20.617625 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:20.617625 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:20.618470 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:20.618470 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:20.618470 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:20.618470 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:20.618470 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:20.618470 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:20.618470 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:20.618470 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:20.618470 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:20.618470 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:20.618470 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 16:19:20.618470 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:20.618470 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 16:19:20.618470 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:20.618470 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 379/776] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:19:20 2022] GET /identity/v3/services/network => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:19:20.628330 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9663caa-8a3b-4c4f-9e44-e3fb28005923 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:20.664955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:20.800226 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9663caa-8a3b-4c4f-9e44-e3fb28005923 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:20.846087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1428e01-56f8-4139-872c-202b526c4583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:20.846765 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1428e01-56f8-4139-872c-202b526c4583 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:20.847070 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1428e01-56f8-4139-872c-202b526c4583 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:20.847339 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1428e01-56f8-4139-872c-202b526c4583 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:20.848033 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1428e01-56f8-4139-872c-202b526c4583 None admin] RBAC: Adding query filter params (name=network) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:20.848332 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1428e01-56f8-4139-872c-202b526c4583 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:20.849764 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1428e01-56f8-4139-872c-202b526c4583 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:20.855742 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 398/777] 10.222.0.55 () {56 vars in 1112 bytes} [Tue Oct 4 16:19:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:20.860836 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd773f0a-97cc-4341-9dec-982d125fc926 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:20.861178 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd773f0a-97cc-4341-9dec-982d125fc926 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:20.861375 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd773f0a-97cc-4341-9dec-982d125fc926 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:20.862923 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 380/778] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:20.865832 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1428e01-56f8-4139-872c-202b526c4583 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:20.869643 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dce1fb-8864-444c-9667-8419f60ec701 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:20.869956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dce1fb-8864-444c-9667-8419f60ec701 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:20.870297 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dce1fb-8864-444c-9667-8419f60ec701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:20.911014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-58dce1fb-8864-444c-9667-8419f60ec701 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:20.912277 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-58dce1fb-8864-444c-9667-8419f60ec701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:20.971567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:20.987130 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1428e01-56f8-4139-872c-202b526c4583 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:21.028699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021a24e-7da5-493b-aa2e-0272d38d9046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:21.029507 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021a24e-7da5-493b-aa2e-0272d38d9046 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:21.029890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021a24e-7da5-493b-aa2e-0272d38d9046 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:21.030203 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021a24e-7da5-493b-aa2e-0272d38d9046 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:21.031039 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021a24e-7da5-493b-aa2e-0272d38d9046 None admin] RBAC: Adding query filter params (type=network) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:21.031430 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021a24e-7da5-493b-aa2e-0272d38d9046 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:21.033140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021a24e-7da5-493b-aa2e-0272d38d9046 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:21.040572 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 399/779] 10.222.0.55 () {56 vars in 1112 bytes} [Tue Oct 4 16:19:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:21.048182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021a24e-7da5-493b-aa2e-0272d38d9046 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:21.062121 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 381/780] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:19:21.163667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba79279-255f-4a43-8f06-f3ef5932ba8f None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:21.164106 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba79279-255f-4a43-8f06-f3ef5932ba8f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:21.164531 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba79279-255f-4a43-8f06-f3ef5932ba8f None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:21.166724 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021a24e-7da5-493b-aa2e-0272d38d9046 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:21.171114 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 382/781] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:19:21.173616 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb192159-e44a-45d8-b8c4-75a037d51448 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:21.173899 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb192159-e44a-45d8-b8c4-75a037d51448 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:21.174158 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb192159-e44a-45d8-b8c4-75a037d51448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:21.193794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-bb192159-e44a-45d8-b8c4-75a037d51448 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:21.195073 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-bb192159-e44a-45d8-b8c4-75a037d51448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:21.206466 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48aa71-526b-4bb7-9b5a-12b372ce3b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:21.207131 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48aa71-526b-4bb7-9b5a-12b372ce3b26 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:21.207415 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48aa71-526b-4bb7-9b5a-12b372ce3b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:21.207659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48aa71-526b-4bb7-9b5a-12b372ce3b26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:21.208346 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48aa71-526b-4bb7-9b5a-12b372ce3b26 None admin] RBAC: Adding query filter params (interface=public, service_id=d62e8c9116134dc8ab6dbbafd371f9f7, region_id=RegionOne) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:21.208644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48aa71-526b-4bb7-9b5a-12b372ce3b26 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:21.210375 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48aa71-526b-4bb7-9b5a-12b372ce3b26 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:21.223098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 400/782] 10.222.0.55 () {56 vars in 1251 bytes} [Tue Oct 4 16:19:21 2022] GET /identity/v3/endpoints?service_id=d62e8c9116134dc8ab6dbbafd371f9f7&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:21.225945 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48aa71-526b-4bb7-9b5a-12b372ce3b26 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:21.243395 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:21.314784 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 383/783] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 16:19:21.396464 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48aa71-526b-4bb7-9b5a-12b372ce3b26 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:21.418780 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb192159-e44a-45d8-b8c4-75a037d51448 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:21.452060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35966bf-f3a2-461a-9401-b3aeb1beab1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:21.455068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35966bf-f3a2-461a-9401-b3aeb1beab1c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:21.455411 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35966bf-f3a2-461a-9401-b3aeb1beab1c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:21.455735 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35966bf-f3a2-461a-9401-b3aeb1beab1c None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:21.456512 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35966bf-f3a2-461a-9401-b3aeb1beab1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:21.464338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35966bf-f3a2-461a-9401-b3aeb1beab1c None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:21.474662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 401/784] 10.222.0.55 () {56 vars in 1087 bytes} [Tue Oct 4 16:19:21 2022] GET /identity/v3/services => generated 772 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:21.482360 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:21.578138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb192159-e44a-45d8-b8c4-75a037d51448 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:21.628325 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7082f-df56-46a7-8165-9f78b475a0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:21.628992 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7082f-df56-46a7-8165-9f78b475a0af None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:21.629265 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7082f-df56-46a7-8165-9f78b475a0af None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:21.629534 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7082f-df56-46a7-8165-9f78b475a0af None admin] PATH_INFO: `/v3/roles/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:21.642247 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7082f-df56-46a7-8165-9f78b475a0af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:19:21.647448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-29b7082f-df56-46a7-8165-9f78b475a0af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:19:21.647448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:21.647448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:21.647448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:21.647448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:21.647448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:21.647448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:21.647448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:21.647448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:21.647448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:21.647448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:21.647448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:21.647448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:19:21.647448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:19:21.647448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:19:21.647448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:19:21.648440 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:19:21.648440 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:19:21.648440 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:19:21.648440 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:19:21.648440 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:21.648440 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:21.648440 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:21.648440 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:21.648440 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:21.648440 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:21.648440 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:21.648440 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:21.648440 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:21.648440 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:21.648440 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:21.648440 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:21.649305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:21.649305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:21.649305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:21.649305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:21.649305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:19:21.649305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:19:21.649305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:19:21.649305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:19:21.649305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:19:21.649305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:19:21.649305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:19:21.649305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:21.649305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 384/785] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Oct 4 16:19:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:21.656545 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35966bf-f3a2-461a-9401-b3aeb1beab1c None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:21.681558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7082f-df56-46a7-8165-9f78b475a0af None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:21.767791 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:21.802642 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:21.807655 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35966bf-f3a2-461a-9401-b3aeb1beab1c None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:21.822540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7082f-df56-46a7-8165-9f78b475a0af None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:21.844737 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858cbfc-77e7-4991-aa83-a357975b0a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:21.845280 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858cbfc-77e7-4991-aa83-a357975b0a38 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:21.845560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858cbfc-77e7-4991-aa83-a357975b0a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:21.845833 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858cbfc-77e7-4991-aa83-a357975b0a38 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:21.846511 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858cbfc-77e7-4991-aa83-a357975b0a38 None admin] RBAC: Adding query filter params (name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:21.846813 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858cbfc-77e7-4991-aa83-a357975b0a38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:21.848236 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858cbfc-77e7-4991-aa83-a357975b0a38 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:21.858460 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 402/786] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Oct 4 16:19:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:21.867009 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858cbfc-77e7-4991-aa83-a357975b0a38 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:21.877350 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7dd6a-ae55-474f-acc6-541676ab7753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:21.878417 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7dd6a-ae55-474f-acc6-541676ab7753 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:21.878921 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7dd6a-ae55-474f-acc6-541676ab7753 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:21.879486 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7dd6a-ae55-474f-acc6-541676ab7753 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:21.904940 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7dd6a-ae55-474f-acc6-541676ab7753 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:19:21.910400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-d1c7dd6a-ae55-474f-acc6-541676ab7753 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:19:21.910400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:21.910400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:21.910400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:21.910400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:21.910400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:21.910400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:21.910400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:21.910400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:21.910400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:21.910400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:21.910400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:21.910400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:19:21.910400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:19:21.910400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:19:21.910400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:19:21.911433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:19:21.911433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:19:21.911433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:19:21.911433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:19:21.911433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:21.911433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:21.911433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:21.911433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:21.911433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:21.911433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:21.911433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:21.911433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:21.911433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:21.911433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:21.911433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:21.911433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:21.912306 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:21.912306 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:21.912306 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:21.912306 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:21.912306 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:19:21.912306 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:19:21.912306 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:19:21.912306 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:19:21.912306 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:19:21.912306 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:19:21.912306 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:19:21.912306 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:21.923009 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 385/787] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:19:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:21.924467 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7dd6a-ae55-474f-acc6-541676ab7753 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:22.013606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858cbfc-77e7-4991-aa83-a357975b0a38 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:22.049058 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2e1a2-aa3f-422b-963f-ce7dc0b4cfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:22.049698 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2e1a2-aa3f-422b-963f-ce7dc0b4cfde None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:22.050026 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2e1a2-aa3f-422b-963f-ce7dc0b4cfde None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:22.050301 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2e1a2-aa3f-422b-963f-ce7dc0b4cfde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:22.052678 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:22.063552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2e1a2-aa3f-422b-963f-ce7dc0b4cfde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:22.065159 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2e1a2-aa3f-422b-963f-ce7dc0b4cfde None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:22.084812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-f0d2e1a2-aa3f-422b-963f-ce7dc0b4cfde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:22.084812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:22.084812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:22.084812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:22.084812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:22.084812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:22.084812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:22.084812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:22.084812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:22.084812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:22.084812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:22.084812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:22.084812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:22.084812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:22.084812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:22.084812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:22.085980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:22.085980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:22.085980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:22.085980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:22.085980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:22.085980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:22.085980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:22.085980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:22.085980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:22.085980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:22.085980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:22.085980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:22.085980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:22.085980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:22.085980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:22.085980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:22.085980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:22.087145 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:22.087145 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:22.087145 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:22.095090 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 403/788] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:22.097093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2e1a2-aa3f-422b-963f-ce7dc0b4cfde None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:22.129625 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7dd6a-ae55-474f-acc6-541676ab7753 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:22.200730 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982cfc8-c5e5-4c1c-8f79-1616f7fffd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:22.201358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982cfc8-c5e5-4c1c-8f79-1616f7fffd82 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:22.201634 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982cfc8-c5e5-4c1c-8f79-1616f7fffd82 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:22.201907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982cfc8-c5e5-4c1c-8f79-1616f7fffd82 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:22.202589 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982cfc8-c5e5-4c1c-8f79-1616f7fffd82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:22.202888 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982cfc8-c5e5-4c1c-8f79-1616f7fffd82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:22.204321 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982cfc8-c5e5-4c1c-8f79-1616f7fffd82 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:22.224168 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 386/789] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:19:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:22.230729 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982cfc8-c5e5-4c1c-8f79-1616f7fffd82 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:22.250118 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:22.262020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2e1a2-aa3f-422b-963f-ce7dc0b4cfde None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:22.323086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b6d05-5bdc-4937-8e14-3275e939a249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:22.323086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b6d05-5bdc-4937-8e14-3275e939a249 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:22.323086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b6d05-5bdc-4937-8e14-3275e939a249 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:22.323086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b6d05-5bdc-4937-8e14-3275e939a249 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:22.323640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b6d05-5bdc-4937-8e14-3275e939a249 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:22.323640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b6d05-5bdc-4937-8e14-3275e939a249 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:22.323640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b6d05-5bdc-4937-8e14-3275e939a249 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:22.337735 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 404/790] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:22.343456 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b6d05-5bdc-4937-8e14-3275e939a249 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:22.399900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:22.460339 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b6d05-5bdc-4937-8e14-3275e939a249 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:22.474623 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982cfc8-c5e5-4c1c-8f79-1616f7fffd82 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:22.498936 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c678d-f858-4173-b63e-43db91270ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:22.499630 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c678d-f858-4173-b63e-43db91270ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:22.499908 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c678d-f858-4173-b63e-43db91270ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:22.500179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c678d-f858-4173-b63e-43db91270ea5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:22.512042 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c678d-f858-4173-b63e-43db91270ea5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:22.514484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c678d-f858-4173-b63e-43db91270ea5 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:22.536915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-dd9c678d-f858-4173-b63e-43db91270ea5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 16:19:22.536915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:22.536915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:22.536915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:22.536915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:22.536915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:22.536915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:22.536915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:22.536915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:22.536915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:22.536915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:22.536915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:22.536915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:19:22.536915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:19:22.536915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:19:22.536915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:19:22.537943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:22.537943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:22.537943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:19:22.537943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:22.537943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:19:22.537943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:22.537943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:22.537943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:22.537943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:22.537943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:22.537943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:22.537943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:22.537943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:22.537943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:22.537943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:22.537943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:22.537943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:22.537943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:22.538890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:22.538890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:22.538890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:19:22.538890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:19:22.538890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:19:22.538890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:19:22.538890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:19:22.538890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:19:22.538890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 16:19:22.538890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:22.544759 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 405/791] 10.222.0.55 () {56 vars in 1117 bytes} [Tue Oct 4 16:19:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:19:22.552805 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c678d-f858-4173-b63e-43db91270ea5 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:22.568204 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07c81e-d06d-45a1-8f60-a5fbfc7eb2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:22.568864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07c81e-d06d-45a1-8f60-a5fbfc7eb2ba None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:22.569141 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07c81e-d06d-45a1-8f60-a5fbfc7eb2ba None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:22.569411 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07c81e-d06d-45a1-8f60-a5fbfc7eb2ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:22.587440 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07c81e-d06d-45a1-8f60-a5fbfc7eb2ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:22.589223 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07c81e-d06d-45a1-8f60-a5fbfc7eb2ba None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:22.605473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-1f07c81e-d06d-45a1-8f60-a5fbfc7eb2ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:22.605473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:22.605473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:22.605473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:22.605473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:22.605473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:22.605473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:22.605473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:22.605473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:22.605473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:22.605473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:22.605473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:22.605473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:22.605473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:22.605473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:22.605473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:22.606732 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:22.606732 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:22.606732 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:22.606732 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:22.606732 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:22.606732 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:22.606732 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:22.606732 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:22.606732 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:22.606732 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:22.606732 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:22.606732 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:22.606732 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:22.606732 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:22.606732 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:22.606732 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:22.606732 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:22.607890 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:22.607890 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:22.607890 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:22.609670 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 387/792] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:22.611124 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd94929-ae7a-44a8-a3eb-64da83e9ea26 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:22.611580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd94929-ae7a-44a8-a3eb-64da83e9ea26 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:22.612014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd94929-ae7a-44a8-a3eb-64da83e9ea26 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:22.613699 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 388/793] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:22.615644 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd94929-ae7a-44a8-a3eb-64da83e9ea26 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:22.684053 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:22.694307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c678d-f858-4173-b63e-43db91270ea5 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:22.703871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:22.730676 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd94929-ae7a-44a8-a3eb-64da83e9ea26 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:22.738262 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023b9e5-bcd9-4d46-a25e-52f56e106051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:22.739144 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023b9e5-bcd9-4d46-a25e-52f56e106051 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:22.739557 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023b9e5-bcd9-4d46-a25e-52f56e106051 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:22.740593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023b9e5-bcd9-4d46-a25e-52f56e106051 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:22.741505 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023b9e5-bcd9-4d46-a25e-52f56e106051 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:22.742398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023b9e5-bcd9-4d46-a25e-52f56e106051 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:22.744434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023b9e5-bcd9-4d46-a25e-52f56e106051 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:22.771419 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d4add-4188-4048-99ab-1ceb8dbe5f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:22.772170 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d4add-4188-4048-99ab-1ceb8dbe5f0a None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:22.772553 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d4add-4188-4048-99ab-1ceb8dbe5f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:22.772855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d4add-4188-4048-99ab-1ceb8dbe5f0a None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:22.773620 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d4add-4188-4048-99ab-1ceb8dbe5f0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:22.773932 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d4add-4188-4048-99ab-1ceb8dbe5f0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:22.775548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d4add-4188-4048-99ab-1ceb8dbe5f0a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:22.775765 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 406/794] 10.222.0.55 () {56 vars in 1149 bytes} [Tue Oct 4 16:19:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:22.777475 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ea3ad-623b-46d9-af0d-eea8d587240b None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:22.778166 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ea3ad-623b-46d9-af0d-eea8d587240b None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:22.778792 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ea3ad-623b-46d9-af0d-eea8d587240b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:22.802965 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 389/795] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:22.802965 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d4add-4188-4048-99ab-1ceb8dbe5f0a None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:22.814254 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-fe4ea3ad-623b-46d9-af0d-eea8d587240b None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:22.816031 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-fe4ea3ad-623b-46d9-af0d-eea8d587240b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:22.905390 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 407/796] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:19:22.905390 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ea3ad-623b-46d9-af0d-eea8d587240b None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:22.919858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d4add-4188-4048-99ab-1ceb8dbe5f0a None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:22.955554 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:22.974404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411cead-4759-4787-9020-2a23c46d41ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:22.975104 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411cead-4759-4787-9020-2a23c46d41ce None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:22.975381 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411cead-4759-4787-9020-2a23c46d41ce None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:22.975653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411cead-4759-4787-9020-2a23c46d41ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:22.996240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411cead-4759-4787-9020-2a23c46d41ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:22.997718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411cead-4759-4787-9020-2a23c46d41ce None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:23.021230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-7411cead-4759-4787-9020-2a23c46d41ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:23.021230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:23.021230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:23.021230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:23.021230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:23.021230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:23.021230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:23.021230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:23.021230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:23.021230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:23.021230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:23.021230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:23.021230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:23.021230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:23.021230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:23.021230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:23.022303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:23.022303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:23.022303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:23.022303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:23.022303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:23.022303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:23.022303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:23.022303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:23.022303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:23.022303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:23.022303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:23.022303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:23.022303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:23.022303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:23.022303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:23.022303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:23.022303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:23.023233 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:23.023233 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:23.023233 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:23.025520 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 390/797] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:23.035012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411cead-4759-4787-9020-2a23c46d41ce None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:23.122461 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:23.131980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ea3ad-623b-46d9-af0d-eea8d587240b None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:23.211880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411cead-4759-4787-9020-2a23c46d41ce None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:23.243766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b66e3-49e2-4854-b87f-1d5de52113f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:23.244858 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b66e3-49e2-4854-b87f-1d5de52113f7 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:23.245382 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b66e3-49e2-4854-b87f-1d5de52113f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:23.245841 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b66e3-49e2-4854-b87f-1d5de52113f7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:23.257364 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8757e-20b0-474a-bb10-5806f683ae2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:23.257982 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8757e-20b0-474a-bb10-5806f683ae2b None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:23.258259 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8757e-20b0-474a-bb10-5806f683ae2b None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:23.258612 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8757e-20b0-474a-bb10-5806f683ae2b None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:23.259302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8757e-20b0-474a-bb10-5806f683ae2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:23.259604 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8757e-20b0-474a-bb10-5806f683ae2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:23.261081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8757e-20b0-474a-bb10-5806f683ae2b None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:23.261453 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b66e3-49e2-4854-b87f-1d5de52113f7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:23.263130 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b66e3-49e2-4854-b87f-1d5de52113f7 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:23.276190 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 391/798] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:19:23.277184 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8757e-20b0-474a-bb10-5806f683ae2b None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:23.322152 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:23.406481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8757e-20b0-474a-bb10-5806f683ae2b None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:23.409510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-b59b66e3-49e2-4854-b87f-1d5de52113f7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 16:19:23.409510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:23.409510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:23.409510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:23.409510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:23.409510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:23.409510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:23.409510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:23.409510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:23.409510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:23.409510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:23.409510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:23.409510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:19:23.409510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:19:23.409510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:19:23.409510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:19:23.410463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:23.410463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:23.410463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:19:23.410463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:23.410463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:19:23.410463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:23.410463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:23.410463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:23.410463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:23.410463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:23.410463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:23.410463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:23.410463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:23.410463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:23.410463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:23.410463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:23.410463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:23.410463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:23.411524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:23.411524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:23.411524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:19:23.411524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:19:23.411524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:19:23.411524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:19:23.411524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:19:23.411524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:19:23.411524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 16:19:23.411524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:23.418883 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 408/799] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:19:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 510 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:23.420563 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b66e3-49e2-4854-b87f-1d5de52113f7 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:23.450918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6cf7d-5b2b-40f6-af4d-325e46c0539c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:23.451661 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6cf7d-5b2b-40f6-af4d-325e46c0539c None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:23.452398 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6cf7d-5b2b-40f6-af4d-325e46c0539c None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:23.452686 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6cf7d-5b2b-40f6-af4d-325e46c0539c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:23.464208 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6cf7d-5b2b-40f6-af4d-325e46c0539c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:19:23.469059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-88d6cf7d-5b2b-40f6-af4d-325e46c0539c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:19:23.469059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:23.469059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:23.469059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:23.469059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:23.469059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:23.469059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:23.469059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:23.469059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:23.469059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:23.469059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:23.469059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:23.469059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:19:23.469059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:19:23.469059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:19:23.469059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:19:23.470011 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:19:23.470011 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:19:23.470011 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:19:23.470011 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:19:23.470011 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:23.470011 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:23.470011 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:23.470011 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:23.470011 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:23.470011 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:23.470011 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:23.470011 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:23.470011 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:23.470011 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:23.470011 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:23.470011 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:23.470873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:23.470873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:23.470873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:23.470873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:23.470873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:19:23.470873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:19:23.470873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:19:23.470873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:19:23.470873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:19:23.470873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:19:23.470873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:19:23.470873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:23.475181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 392/800] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:19:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:23.476059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6cf7d-5b2b-40f6-af4d-325e46c0539c None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:23.550664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b66e3-49e2-4854-b87f-1d5de52113f7 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:23.583861 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:23.593578 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6cf7d-5b2b-40f6-af4d-325e46c0539c None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:23.600075 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8679a-1b98-4cd0-83fb-083d0b88d764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:23.600721 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8679a-1b98-4cd0-83fb-083d0b88d764 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:23.600992 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8679a-1b98-4cd0-83fb-083d0b88d764 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:23.601460 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8679a-1b98-4cd0-83fb-083d0b88d764 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:23.608829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8679a-1b98-4cd0-83fb-083d0b88d764 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:23.610272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8679a-1b98-4cd0-83fb-083d0b88d764 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:23.623198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-a2f8679a-1b98-4cd0-83fb-083d0b88d764 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:23.623198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:23.623198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:23.623198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:23.623198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:23.623198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:23.623198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:23.623198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:23.623198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:23.623198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:23.623198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:23.623198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:23.623198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:19:23.623198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:19:23.623198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:19:23.624177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:19:23.624177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:23.624177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:23.624177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:23.624177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:23.624177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:23.624177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:23.624177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:23.624177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:23.624177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:23.624177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:23.624177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:23.624177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:23.624177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:23.624177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:23.624177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:23.624177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:23.625075 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:19:23.625075 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:19:23.625075 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:19:23.625075 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:19:23.625075 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:19:23.625075 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:19:23.625075 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:23.625075 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:23.625075 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 409/801] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:19:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:23.625564 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a9d49-de62-4685-b7f8-444b6a970b57 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:23.626546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a9d49-de62-4685-b7f8-444b6a970b57 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:23.626546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a9d49-de62-4685-b7f8-444b6a970b57 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:23.632044 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 410/802] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:23.632893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a9d49-de62-4685-b7f8-444b6a970b57 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:23.639845 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a69071-3b41-43fe-a7df-1c4422996c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:23.640469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a69071-3b41-43fe-a7df-1c4422996c4e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:23.640776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a69071-3b41-43fe-a7df-1c4422996c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:23.641020 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a69071-3b41-43fe-a7df-1c4422996c4e None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:23.641734 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a69071-3b41-43fe-a7df-1c4422996c4e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:23.642509 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a69071-3b41-43fe-a7df-1c4422996c4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:23.644408 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a69071-3b41-43fe-a7df-1c4422996c4e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:23.649886 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:23.675789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 393/803] 10.222.0.55 () {56 vars in 1135 bytes} [Tue Oct 4 16:19:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:23.675789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b4a1d-d1c1-48f7-b96e-edbd8ff5b88b None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:23.675789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b4a1d-d1c1-48f7-b96e-edbd8ff5b88b None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:23.675789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b4a1d-d1c1-48f7-b96e-edbd8ff5b88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:23.692754 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-299b4a1d-d1c1-48f7-b96e-edbd8ff5b88b None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:23.694669 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-299b4a1d-d1c1-48f7-b96e-edbd8ff5b88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:23.772378 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a9d49-de62-4685-b7f8-444b6a970b57 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:23.786444 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 394/804] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:19:23.787151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b4a1d-d1c1-48f7-b96e-edbd8ff5b88b None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:23.829477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851e558-c7d7-4008-a9b5-7af01b803459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:23.831522 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851e558-c7d7-4008-a9b5-7af01b803459 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:23.831522 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851e558-c7d7-4008-a9b5-7af01b803459 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:23.831801 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851e558-c7d7-4008-a9b5-7af01b803459 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:23.832441 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851e558-c7d7-4008-a9b5-7af01b803459 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:23.834526 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851e558-c7d7-4008-a9b5-7af01b803459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:23.835878 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851e558-c7d7-4008-a9b5-7af01b803459 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:23.853870 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 411/805] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:19:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:23.853870 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851e558-c7d7-4008-a9b5-7af01b803459 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:23.918846 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:23.942003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:23.950404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b4a1d-d1c1-48f7-b96e-edbd8ff5b88b None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:23.967220 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851e558-c7d7-4008-a9b5-7af01b803459 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:23.995994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52b2eb-d57a-4f98-911f-38d36c96f303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:23.996615 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52b2eb-d57a-4f98-911f-38d36c96f303 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:23.996887 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52b2eb-d57a-4f98-911f-38d36c96f303 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:23.997153 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52b2eb-d57a-4f98-911f-38d36c96f303 None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:23.997848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52b2eb-d57a-4f98-911f-38d36c96f303 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:23.998152 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52b2eb-d57a-4f98-911f-38d36c96f303 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:23.999664 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52b2eb-d57a-4f98-911f-38d36c96f303 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:24.017102 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 395/806] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:19:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:24.017102 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52b2eb-d57a-4f98-911f-38d36c96f303 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:24.036190 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978a3b7-82c1-4e57-8b68-6196bd7dd2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:24.038951 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978a3b7-82c1-4e57-8b68-6196bd7dd2d3 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:24.040371 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978a3b7-82c1-4e57-8b68-6196bd7dd2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:24.041146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978a3b7-82c1-4e57-8b68-6196bd7dd2d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:24.060045 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978a3b7-82c1-4e57-8b68-6196bd7dd2d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:24.062743 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978a3b7-82c1-4e57-8b68-6196bd7dd2d3 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:24.081561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-0978a3b7-82c1-4e57-8b68-6196bd7dd2d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:24.081561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:24.081561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:24.081561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:24.081561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:24.081561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:24.081561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:24.081561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:24.081561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:24.081561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:24.081561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:24.081561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:24.081561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:24.081561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:24.081561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:24.081561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:24.082915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:24.082915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:24.082915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:24.082915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:24.082915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:24.082915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:24.082915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:24.082915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:24.082915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:24.082915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:24.082915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:24.082915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:24.082915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:24.082915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:24.082915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:24.082915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:24.082915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:24.084180 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:24.084180 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:24.084180 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:24.084180 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 412/807] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:24.084180 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978a3b7-82c1-4e57-8b68-6196bd7dd2d3 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:24.148902 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52b2eb-d57a-4f98-911f-38d36c96f303 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:24.188798 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6dffc-519b-4ec8-88fb-a10ea017c11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:24.189450 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6dffc-519b-4ec8-88fb-a10ea017c11a None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:24.189736 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6dffc-519b-4ec8-88fb-a10ea017c11a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:24.190003 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6dffc-519b-4ec8-88fb-a10ea017c11a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:24.199791 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:24.200039 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978a3b7-82c1-4e57-8b68-6196bd7dd2d3 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:24.202602 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6dffc-519b-4ec8-88fb-a10ea017c11a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:24.204659 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6dffc-519b-4ec8-88fb-a10ea017c11a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:24.220275 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-d4f6dffc-519b-4ec8-88fb-a10ea017c11a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:24.220275 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:24.220275 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:24.220275 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:24.220275 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:24.220275 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:24.220275 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:24.220275 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:24.220275 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:24.220275 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:24.220275 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:24.220275 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:24.220275 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:24.220275 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:24.220275 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:24.220275 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:24.221776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:24.221776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:24.221776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:24.221776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:24.221776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:24.221776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:24.221776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:24.221776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:24.221776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:24.221776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:24.221776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:24.221776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:24.221776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:24.221776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:24.221776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:24.221776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:24.221776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:24.222824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:24.222824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:24.222824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:24.222824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 396/808] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:24.222824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6dffc-519b-4ec8-88fb-a10ea017c11a None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:24.232167 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:24.245024 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb539840-4f05-41e5-9681-d69be2d4980d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:24.245726 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb539840-4f05-41e5-9681-d69be2d4980d None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:24.246003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb539840-4f05-41e5-9681-d69be2d4980d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:24.246270 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb539840-4f05-41e5-9681-d69be2d4980d None admin] PATH_INFO: `/v3/projects/e480e782c4fa403a913ca7179db0843b/users/05cfc9d62a244701a5df524d1c26f107/roles/2165a726b4034e1584166027f2361b5f` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:24.262217 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb539840-4f05-41e5-9681-d69be2d4980d None admin] RBAC: Authorizing `identity:create_grant(project_id=e480e782c4fa403a913ca7179db0843b, user_id=05cfc9d62a244701a5df524d1c26f107, role_id=2165a726b4034e1584166027f2361b5f)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:24.263655 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb539840-4f05-41e5-9681-d69be2d4980d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:24.278602 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 413/809] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Oct 4 16:19:24 2022] PUT /identity/v3/projects/e480e782c4fa403a913ca7179db0843b/users/05cfc9d62a244701a5df524d1c26f107/roles/2165a726b4034e1584166027f2361b5f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:19:24.280348 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb539840-4f05-41e5-9681-d69be2d4980d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:24.351181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6dffc-519b-4ec8-88fb-a10ea017c11a None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:24.397322 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e5043-c706-4ad7-9421-6f70ca2c550f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:24.397978 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e5043-c706-4ad7-9421-6f70ca2c550f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:24.398257 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e5043-c706-4ad7-9421-6f70ca2c550f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:24.398578 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e5043-c706-4ad7-9421-6f70ca2c550f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:24.399205 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e5043-c706-4ad7-9421-6f70ca2c550f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:24.400586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e5043-c706-4ad7-9421-6f70ca2c550f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:24.413862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-d37e5043-c706-4ad7-9421-6f70ca2c550f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 16:19:24.413862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:24.413862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 16:19:24.413862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 16:19:24.413862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 16:19:24.413862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 16:19:24.413862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 16:19:24.413862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:24.413862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 16:19:24.413862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:24.413862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:19:24.413862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:24.413862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:24.413862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:24.413862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:24.413862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:24.413862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:24.414956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:24.414956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:24.414956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:24.414956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:24.414956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:24.414956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:24.414956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 16:19:24.414956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 16:19:24.414956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 16:19:24.414956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 16:19:24.414956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:24.414956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:24.414956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:24.414956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:24.414956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:24.414956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:24.415842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:24.415842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:24.415842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:24.415842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:24.415842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:24.415842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:24.415842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:24.415842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:24.415842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:24.415842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:24.415842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 16:19:24.415842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:24.415842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 16:19:24.415842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:24.415842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 397/810] 10.222.0.55 () {56 vars in 1129 bytes} [Tue Oct 4 16:19:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:24.416726 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d5904-fc8b-4d65-aae8-95d0e785f070 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:24.416726 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d5904-fc8b-4d65-aae8-95d0e785f070 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:24.416893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d5904-fc8b-4d65-aae8-95d0e785f070 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:24.423362 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 398/811] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:24.424797 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d5904-fc8b-4d65-aae8-95d0e785f070 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:24.439107 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb539840-4f05-41e5-9681-d69be2d4980d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:24.482928 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7316b05-a0de-4aa4-a0d7-ac9b14ae8c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:24.483686 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7316b05-a0de-4aa4-a0d7-ac9b14ae8c3a None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:24.483911 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7316b05-a0de-4aa4-a0d7-ac9b14ae8c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:24.484177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7316b05-a0de-4aa4-a0d7-ac9b14ae8c3a None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:24.484833 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7316b05-a0de-4aa4-a0d7-ac9b14ae8c3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:24.485584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7316b05-a0de-4aa4-a0d7-ac9b14ae8c3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:24.487937 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7316b05-a0de-4aa4-a0d7-ac9b14ae8c3a None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:24.501164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 414/812] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:24.502044 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7316b05-a0de-4aa4-a0d7-ac9b14ae8c3a None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:24.507755 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:24.561650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:24.570633 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d5904-fc8b-4d65-aae8-95d0e785f070 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:24.620414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497407a-d7f0-4d55-8d53-de93033985a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:24.621210 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497407a-d7f0-4d55-8d53-de93033985a5 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:24.621479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497407a-d7f0-4d55-8d53-de93033985a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:24.621919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497407a-d7f0-4d55-8d53-de93033985a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:24.622406 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497407a-d7f0-4d55-8d53-de93033985a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:24.622704 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497407a-d7f0-4d55-8d53-de93033985a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:24.624431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497407a-d7f0-4d55-8d53-de93033985a5 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:24.641996 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 399/813] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:24.641996 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25101c3-d9d2-4514-a0fd-f03043b760e6 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:24.641996 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25101c3-d9d2-4514-a0fd-f03043b760e6 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:24.641996 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25101c3-d9d2-4514-a0fd-f03043b760e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:24.645662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7316b05-a0de-4aa4-a0d7-ac9b14ae8c3a None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:24.659118 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-b25101c3-d9d2-4514-a0fd-f03043b760e6 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:24.662320 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-b25101c3-d9d2-4514-a0fd-f03043b760e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:24.705196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb332098-796f-46a6-a309-ed61a6070ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:24.706475 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb332098-796f-46a6-a309-ed61a6070ffd None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:24.706475 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb332098-796f-46a6-a309-ed61a6070ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:24.706888 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb332098-796f-46a6-a309-ed61a6070ffd None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:24.707967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb332098-796f-46a6-a309-ed61a6070ffd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:24.708483 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb332098-796f-46a6-a309-ed61a6070ffd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:24.710801 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb332098-796f-46a6-a309-ed61a6070ffd None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:24.718678 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 415/814] 10.222.0.55 () {56 vars in 1124 bytes} [Tue Oct 4 16:19:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:24.720169 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb332098-796f-46a6-a309-ed61a6070ffd None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:24.762834 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 400/815] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:19:24.764104 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25101c3-d9d2-4514-a0fd-f03043b760e6 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:24.834269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:24.848718 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb332098-796f-46a6-a309-ed61a6070ffd None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:24.851202 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:24.893948 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680cf99-5493-41bb-bbe8-dc16959e3671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:24.894927 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680cf99-5493-41bb-bbe8-dc16959e3671 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:24.895437 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680cf99-5493-41bb-bbe8-dc16959e3671 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:24.895901 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680cf99-5493-41bb-bbe8-dc16959e3671 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:24.903316 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680cf99-5493-41bb-bbe8-dc16959e3671 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:24.903512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25101c3-d9d2-4514-a0fd-f03043b760e6 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:24.905254 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680cf99-5493-41bb-bbe8-dc16959e3671 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:24.917671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-7680cf99-5493-41bb-bbe8-dc16959e3671 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:24.917671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:24.917671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:24.917671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:24.917671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:24.917671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:24.917671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:24.917671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:24.917671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:24.917671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:24.917671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:24.917671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:24.917671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:19:24.917671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:19:24.917671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:19:24.918646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:19:24.918646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:24.918646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:24.918646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:24.918646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:24.918646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:24.918646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:24.918646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:24.918646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:24.918646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:24.918646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:24.918646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:24.918646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:24.918646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:24.918646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:24.918646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:24.918646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:24.919977 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:19:24.919977 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:19:24.919977 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:19:24.919977 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:19:24.919977 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:19:24.919977 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:19:24.919977 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:24.919977 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:24.922422 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 416/816] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:19:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:24.923887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680cf99-5493-41bb-bbe8-dc16959e3671 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:24.947152 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768977b-5249-43cc-8948-4ba9b02d2de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:24.947807 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768977b-5249-43cc-8948-4ba9b02d2de5 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:24.948082 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768977b-5249-43cc-8948-4ba9b02d2de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:24.948427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768977b-5249-43cc-8948-4ba9b02d2de5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:24.957406 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768977b-5249-43cc-8948-4ba9b02d2de5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:24.958873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768977b-5249-43cc-8948-4ba9b02d2de5 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:24.976824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-9768977b-5249-43cc-8948-4ba9b02d2de5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 16:19:24.976824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:24.976824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:24.976824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:24.976824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:24.976824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:24.976824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:24.976824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:24.976824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:24.976824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:24.976824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:24.976824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:24.976824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:19:24.976824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:19:24.976824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:19:24.976824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:19:24.977858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:24.977858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:24.977858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:19:24.977858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:24.977858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:19:24.977858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:24.977858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:24.977858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:24.977858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:24.977858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:24.977858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:24.977858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:24.977858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:24.977858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:24.977858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:24.977858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:24.977858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:24.977858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:24.978785 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:24.978785 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:24.978785 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:19:24.978785 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:19:24.978785 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:19:24.978785 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:19:24.978785 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:19:24.978785 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:19:24.978785 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 16:19:24.978785 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:24.982504 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 401/817] 10.222.0.55 () {56 vars in 1093 bytes} [Tue Oct 4 16:19:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:24.983430 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768977b-5249-43cc-8948-4ba9b02d2de5 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:25.052380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680cf99-5493-41bb-bbe8-dc16959e3671 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:25.091146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76365cd6-bac8-4be3-962a-5d4651819995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:25.091769 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76365cd6-bac8-4be3-962a-5d4651819995 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:25.092039 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76365cd6-bac8-4be3-962a-5d4651819995 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:25.092303 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76365cd6-bac8-4be3-962a-5d4651819995 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:25.092957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76365cd6-bac8-4be3-962a-5d4651819995 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:25.093252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76365cd6-bac8-4be3-962a-5d4651819995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:25.094624 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76365cd6-bac8-4be3-962a-5d4651819995 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:25.100349 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 417/818] 10.222.0.55 () {56 vars in 1124 bytes} [Tue Oct 4 16:19:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:25.101661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76365cd6-bac8-4be3-962a-5d4651819995 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:25.123924 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768977b-5249-43cc-8948-4ba9b02d2de5 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:25.131748 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:25.133757 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:25.176150 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3eae0-f68f-4541-a11b-5b205396a40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:25.177333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3eae0-f68f-4541-a11b-5b205396a40e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:25.177956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3eae0-f68f-4541-a11b-5b205396a40e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:25.178429 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3eae0-f68f-4541-a11b-5b205396a40e None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:25.179433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3eae0-f68f-4541-a11b-5b205396a40e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:25.180109 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3eae0-f68f-4541-a11b-5b205396a40e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:25.182109 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3eae0-f68f-4541-a11b-5b205396a40e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:25.196512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 402/819] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:19:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:25.197284 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3eae0-f68f-4541-a11b-5b205396a40e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:25.223326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76365cd6-bac8-4be3-962a-5d4651819995 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:25.276447 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bac03f-1397-4b2b-9600-06975b97a8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:25.277061 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bac03f-1397-4b2b-9600-06975b97a8ef None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:25.277326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bac03f-1397-4b2b-9600-06975b97a8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:25.277594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bac03f-1397-4b2b-9600-06975b97a8ef None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:25.278332 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bac03f-1397-4b2b-9600-06975b97a8ef None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:25.278633 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bac03f-1397-4b2b-9600-06975b97a8ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:25.280217 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bac03f-1397-4b2b-9600-06975b97a8ef None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:25.306947 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 418/820] 10.222.0.55 () {56 vars in 1133 bytes} [Tue Oct 4 16:19:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:25.307978 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bac03f-1397-4b2b-9600-06975b97a8ef None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:25.319211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3eae0-f68f-4541-a11b-5b205396a40e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:25.355573 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4964dd8-c5e6-4075-a96f-c0f1d52169a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:25.356221 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4964dd8-c5e6-4075-a96f-c0f1d52169a3 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:25.356496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4964dd8-c5e6-4075-a96f-c0f1d52169a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:25.356762 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4964dd8-c5e6-4075-a96f-c0f1d52169a3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:25.357349 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4964dd8-c5e6-4075-a96f-c0f1d52169a3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:25.358727 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4964dd8-c5e6-4075-a96f-c0f1d52169a3 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:25.368151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-e4964dd8-c5e6-4075-a96f-c0f1d52169a3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 16:19:25.368151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:25.368151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 16:19:25.368151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 16:19:25.368151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 16:19:25.368151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 16:19:25.368151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 16:19:25.368151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:25.368151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 16:19:25.368151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:25.368151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:19:25.368151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:25.368151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:25.368151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:25.368151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:25.368151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:25.368151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:25.369301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:25.369301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:25.369301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:25.369301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:25.369301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:25.369301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:25.369301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 16:19:25.369301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 16:19:25.369301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 16:19:25.369301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 16:19:25.369301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:25.369301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:25.369301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:25.369301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:25.369301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:25.369301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:25.370301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:25.370301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:25.370301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:25.370301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:25.370301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:25.370301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:25.370301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:25.370301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:25.370301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:25.370301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:25.370301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 16:19:25.370301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:25.370301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 16:19:25.370301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:25.370301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 403/821] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:19:25 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:25.371268 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4964dd8-c5e6-4075-a96f-c0f1d52169a3 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:25.410423 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:25.425772 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:25.443950 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bac03f-1397-4b2b-9600-06975b97a8ef None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:25.487908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4964dd8-c5e6-4075-a96f-c0f1d52169a3 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:25.495163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70a6a7-4636-413e-b0c5-d83e96c6c438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:25.496499 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70a6a7-4636-413e-b0c5-d83e96c6c438 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:25.496749 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70a6a7-4636-413e-b0c5-d83e96c6c438 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:25.497138 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70a6a7-4636-413e-b0c5-d83e96c6c438 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:25.498429 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70a6a7-4636-413e-b0c5-d83e96c6c438 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:25.500199 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70a6a7-4636-413e-b0c5-d83e96c6c438 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:25.525584 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d59c1-b062-4f5f-8e6d-3f9d82e4f4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:25.527046 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d59c1-b062-4f5f-8e6d-3f9d82e4f4f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:25.527476 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d59c1-b062-4f5f-8e6d-3f9d82e4f4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:25.527756 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d59c1-b062-4f5f-8e6d-3f9d82e4f4f2 None admin] PATH_INFO: `/v3/projects/e480e782c4fa403a913ca7179db0843b/users/6590cb6c1c964039b9dea771a647bdac/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:25.530076 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d59c1-b062-4f5f-8e6d-3f9d82e4f4f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=e480e782c4fa403a913ca7179db0843b, user_id=6590cb6c1c964039b9dea771a647bdac, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:25.539362 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 419/822] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:19:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:19:25.539590 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d59c1-b062-4f5f-8e6d-3f9d82e4f4f2 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:25.539695 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70a6a7-4636-413e-b0c5-d83e96c6c438 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:25.548417 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 404/823] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Oct 4 16:19:25 2022] PUT /identity/v3/projects/e480e782c4fa403a913ca7179db0843b/users/6590cb6c1c964039b9dea771a647bdac/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:19:25.549487 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d59c1-b062-4f5f-8e6d-3f9d82e4f4f2 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:25.791059 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70a6a7-4636-413e-b0c5-d83e96c6c438 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:25.809894 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:25.826731 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d59c1-b062-4f5f-8e6d-3f9d82e4f4f2 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:25.841277 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963d6d3-994a-41fd-96c2-ce38a85dc585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:25.841895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963d6d3-994a-41fd-96c2-ce38a85dc585 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:25.842180 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963d6d3-994a-41fd-96c2-ce38a85dc585 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:25.842456 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963d6d3-994a-41fd-96c2-ce38a85dc585 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:25.851285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:25.890259 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8f276-8efa-4739-adc5-b59451a0b7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:25.892059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8f276-8efa-4739-adc5-b59451a0b7a3 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:25.892743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8f276-8efa-4739-adc5-b59451a0b7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:25.893279 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8f276-8efa-4739-adc5-b59451a0b7a3 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:25.894139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8f276-8efa-4739-adc5-b59451a0b7a3 None admin] RBAC: Adding query filter params (name=network) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:25.894808 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8f276-8efa-4739-adc5-b59451a0b7a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:25.897098 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8f276-8efa-4739-adc5-b59451a0b7a3 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:25.904277 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 405/824] 10.222.0.55 () {56 vars in 1112 bytes} [Tue Oct 4 16:19:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:25.916425 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8f276-8efa-4739-adc5-b59451a0b7a3 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:25.956173 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963d6d3-994a-41fd-96c2-ce38a85dc585 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:25.957735 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963d6d3-994a-41fd-96c2-ce38a85dc585 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:26.114493 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 420/825] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:19:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 16:19:26.120290 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963d6d3-994a-41fd-96c2-ce38a85dc585 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:26.163004 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8f276-8efa-4739-adc5-b59451a0b7a3 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:26.188593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:26.241671 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2592cd-ba54-49d8-ac41-6957dd398420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:26.242308 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2592cd-ba54-49d8-ac41-6957dd398420 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:26.242581 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2592cd-ba54-49d8-ac41-6957dd398420 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:26.242846 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2592cd-ba54-49d8-ac41-6957dd398420 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:26.243519 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2592cd-ba54-49d8-ac41-6957dd398420 None admin] RBAC: Adding query filter params (type=network) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:26.244028 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2592cd-ba54-49d8-ac41-6957dd398420 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:26.245622 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2592cd-ba54-49d8-ac41-6957dd398420 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:26.254329 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 406/826] 10.222.0.55 () {56 vars in 1112 bytes} [Tue Oct 4 16:19:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:26.260613 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2592cd-ba54-49d8-ac41-6957dd398420 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:26.304308 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:26.308681 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963d6d3-994a-41fd-96c2-ce38a85dc585 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:26.358069 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcf73a-2359-41d2-a6f0-f65f4a284e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:26.358716 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcf73a-2359-41d2-a6f0-f65f4a284e0d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:26.359005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcf73a-2359-41d2-a6f0-f65f4a284e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:26.359268 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcf73a-2359-41d2-a6f0-f65f4a284e0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:26.388239 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dcf73a-2359-41d2-a6f0-f65f4a284e0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:26.389646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dcf73a-2359-41d2-a6f0-f65f4a284e0d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:26.417584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-84dcf73a-2359-41d2-a6f0-f65f4a284e0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:26.417584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:26.417584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:26.417584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:26.417584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:26.417584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:26.417584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:26.417584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:26.417584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:26.417584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:26.417584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:26.417584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:26.417584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:26.417584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:26.417584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:26.417584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:26.418616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:26.418616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:26.418616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:26.418616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:26.418616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:26.418616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:26.418616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:26.418616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:26.418616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:26.418616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:26.418616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:26.418616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:26.418616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:26.418616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:26.418616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:26.418616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:26.418616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:26.419947 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:26.419947 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:26.419947 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:26.425159 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 421/827] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:26.426147 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcf73a-2359-41d2-a6f0-f65f4a284e0d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:26.429929 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2592cd-ba54-49d8-ac41-6957dd398420 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:26.472284 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caad41b-e6d2-47f9-b881-cd659423c438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:26.472913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caad41b-e6d2-47f9-b881-cd659423c438 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:26.473174 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caad41b-e6d2-47f9-b881-cd659423c438 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:26.473441 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caad41b-e6d2-47f9-b881-cd659423c438 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:26.474140 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caad41b-e6d2-47f9-b881-cd659423c438 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:26.475573 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caad41b-e6d2-47f9-b881-cd659423c438 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:26.523485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 407/828] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:19:26 2022] POST /identity/v3/endpoints => generated 337 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:19:26.603744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:26.625833 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcf73a-2359-41d2-a6f0-f65f4a284e0d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:26.688361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de802e-0bf5-4e73-a0a0-19e6f02b5cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:26.688901 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de802e-0bf5-4e73-a0a0-19e6f02b5cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:26.689173 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de802e-0bf5-4e73-a0a0-19e6f02b5cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:26.689437 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de802e-0bf5-4e73-a0a0-19e6f02b5cf0 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:26.690121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de802e-0bf5-4e73-a0a0-19e6f02b5cf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:26.690418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de802e-0bf5-4e73-a0a0-19e6f02b5cf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:26.691937 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de802e-0bf5-4e73-a0a0-19e6f02b5cf0 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:26.710696 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 422/829] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:19:26.717893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caad41b-e6d2-47f9-b881-cd659423c438 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:26.780451 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cc6cc-0404-482c-8551-1c7739ed4d18 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:26.780812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cc6cc-0404-482c-8551-1c7739ed4d18 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:26.780994 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cc6cc-0404-482c-8551-1c7739ed4d18 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:26.784602 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 423/830] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:19:26.788931 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf54669-df4f-4ef6-8b7a-55d0e0e67842 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:26.789289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf54669-df4f-4ef6-8b7a-55d0e0e67842 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:26.789481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf54669-df4f-4ef6-8b7a-55d0e0e67842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:26.815828 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-dcf54669-df4f-4ef6-8b7a-55d0e0e67842 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:26.817178 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-dcf54669-df4f-4ef6-8b7a-55d0e0e67842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:26.820925 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:26.852798 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caad41b-e6d2-47f9-b881-cd659423c438 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:26.897216 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8a760-b889-4b3e-9b71-1847d43f16bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:26.898173 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8a760-b889-4b3e-9b71-1847d43f16bb None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:26.898610 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8a760-b889-4b3e-9b71-1847d43f16bb None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:26.898967 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8a760-b889-4b3e-9b71-1847d43f16bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:26.908896 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8a760-b889-4b3e-9b71-1847d43f16bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:26.912969 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8a760-b889-4b3e-9b71-1847d43f16bb None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:26.929378 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 424/831] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 16:19:26.929720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-32b8a760-b889-4b3e-9b71-1847d43f16bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:26.929720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:26.929720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:26.929720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:26.929720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:26.929720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:26.929720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:26.929720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:26.929720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:26.929720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:26.929720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:26.929720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:26.929720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:19:26.929720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:19:26.929720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:19:26.930594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:19:26.930594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:26.930594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:26.930594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:26.930594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:26.930594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:26.930594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:26.930594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:26.930594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:26.930594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:26.930594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:26.930594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:26.930594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:26.930594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:26.930594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:26.930594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:26.930594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:26.933907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:19:26.933907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:19:26.933907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:19:26.933907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:19:26.933907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:19:26.933907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:19:26.933907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:26.933907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:26.935260 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 408/832] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:19:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:26.941071 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf54669-df4f-4ef6-8b7a-55d0e0e67842 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:27.028307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:27.065286 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf54669-df4f-4ef6-8b7a-55d0e0e67842 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:27.108452 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604d073-82be-416e-a6a0-6b758d1c535a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:27.109961 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604d073-82be-416e-a6a0-6b758d1c535a None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:27.110798 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604d073-82be-416e-a6a0-6b758d1c535a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:27.111514 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604d073-82be-416e-a6a0-6b758d1c535a None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:27.112421 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604d073-82be-416e-a6a0-6b758d1c535a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:27.112943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604d073-82be-416e-a6a0-6b758d1c535a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:27.114577 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604d073-82be-416e-a6a0-6b758d1c535a None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:27.130743 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 425/833] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:19:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:27.139613 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8a760-b889-4b3e-9b71-1847d43f16bb None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:27.247182 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8a760-b889-4b3e-9b71-1847d43f16bb None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:27.267618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604d073-82be-416e-a6a0-6b758d1c535a None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:27.286491 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea7bf4-63eb-407b-948d-8fdcfab66a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:27.287160 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea7bf4-63eb-407b-948d-8fdcfab66a7b None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:27.287482 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea7bf4-63eb-407b-948d-8fdcfab66a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:27.287752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea7bf4-63eb-407b-948d-8fdcfab66a7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:27.288623 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea7bf4-63eb-407b-948d-8fdcfab66a7b None admin] RBAC: Adding query filter params (role.id=066f46534195417295e63a5316632eae, scope.project.id=e480e782c4fa403a913ca7179db0843b, user.id=6cdee0584fe045028a44c385d032d2c7) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:27.288929 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea7bf4-63eb-407b-948d-8fdcfab66a7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:27.290476 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea7bf4-63eb-407b-948d-8fdcfab66a7b None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:27.292519 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:27.303081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 409/834] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:19:27 2022] GET /identity/v3/role_assignments?user.id=6cdee0584fe045028a44c385d032d2c7&scope.project.id=e480e782c4fa403a913ca7179db0843b&role.id=066f46534195417295e63a5316632eae => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:27.403089 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604d073-82be-416e-a6a0-6b758d1c535a None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:27.440517 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76a3e2-1a74-4716-9afa-58d917b4e678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:27.441178 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76a3e2-1a74-4716-9afa-58d917b4e678 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:27.441465 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76a3e2-1a74-4716-9afa-58d917b4e678 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:27.441715 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76a3e2-1a74-4716-9afa-58d917b4e678 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:27.443927 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:27.455012 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76a3e2-1a74-4716-9afa-58d917b4e678 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:19:27.460644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-6d76a3e2-1a74-4716-9afa-58d917b4e678 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:19:27.460644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:27.460644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:27.460644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:27.460644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:27.460644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:27.460644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:27.460644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:27.460644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:27.460644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:27.460644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:27.460644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:27.460644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:19:27.460644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:19:27.460644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:19:27.460644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:19:27.461678 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:19:27.461678 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:19:27.461678 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:19:27.461678 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:19:27.461678 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:27.461678 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:27.461678 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:27.461678 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:27.461678 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:27.461678 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:27.461678 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:27.461678 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:27.461678 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:27.461678 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:27.461678 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:27.461678 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:27.462520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:27.462520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:27.462520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:27.462520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:27.462520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:19:27.462520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:19:27.462520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:19:27.462520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:19:27.462520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:19:27.462520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:19:27.462520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:19:27.462520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:27.462520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 426/835] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Oct 4 16:19:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:19:27.468215 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea7bf4-63eb-407b-948d-8fdcfab66a7b None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:27.603944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea7bf4-63eb-407b-948d-8fdcfab66a7b None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:27.647564 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95267c-efda-4225-9311-a05781ad84f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:27.648189 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95267c-efda-4225-9311-a05781ad84f6 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:27.648463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95267c-efda-4225-9311-a05781ad84f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:27.648731 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95267c-efda-4225-9311-a05781ad84f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:27.649413 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95267c-efda-4225-9311-a05781ad84f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:27.649707 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95267c-efda-4225-9311-a05781ad84f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:27.651125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95267c-efda-4225-9311-a05781ad84f6 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:27.663604 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 410/836] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Oct 4 16:19:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:27.668540 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76a3e2-1a74-4716-9afa-58d917b4e678 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:27.776256 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76a3e2-1a74-4716-9afa-58d917b4e678 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:27.815017 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82357b-20a9-4046-ba7d-cc9271e1b9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:27.816116 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82357b-20a9-4046-ba7d-cc9271e1b9db None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:27.816591 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82357b-20a9-4046-ba7d-cc9271e1b9db None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:27.816876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82357b-20a9-4046-ba7d-cc9271e1b9db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:27.828781 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82357b-20a9-4046-ba7d-cc9271e1b9db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:27.830152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82357b-20a9-4046-ba7d-cc9271e1b9db None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:27.844903 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-8c82357b-20a9-4046-ba7d-cc9271e1b9db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:27.844903 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:27.844903 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:27.844903 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:27.844903 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:27.844903 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:27.844903 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:27.844903 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:27.844903 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:27.844903 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:27.844903 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:27.844903 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:27.844903 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:27.844903 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:27.844903 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:27.844903 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:27.845928 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:27.845928 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:27.845928 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:27.845928 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:27.845928 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:27.845928 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:27.845928 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:27.845928 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:27.845928 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:27.845928 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:27.845928 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:27.845928 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:27.845928 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:27.845928 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:27.845928 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:27.845928 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:27.845928 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:27.847539 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:27.847539 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:27.847539 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:27.847539 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 427/837] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:27.852079 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95267c-efda-4225-9311-a05781ad84f6 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:27.919652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:27.974706 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95267c-efda-4225-9311-a05781ad84f6 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:28.013354 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcca8c4-b09c-4061-a6f1-c5b8f2e4e949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:28.014371 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcca8c4-b09c-4061-a6f1-c5b8f2e4e949 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:28.014858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcca8c4-b09c-4061-a6f1-c5b8f2e4e949 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:28.015359 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcca8c4-b09c-4061-a6f1-c5b8f2e4e949 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:28.016224 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcca8c4-b09c-4061-a6f1-c5b8f2e4e949 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:28.016796 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcca8c4-b09c-4061-a6f1-c5b8f2e4e949 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:28.018560 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcca8c4-b09c-4061-a6f1-c5b8f2e4e949 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:28.034664 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 411/838] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:28.040238 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82357b-20a9-4046-ba7d-cc9271e1b9db None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:28.094614 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:28.151605 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82357b-20a9-4046-ba7d-cc9271e1b9db None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:28.174472 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d969bcd-2eb2-4c5e-820a-de503e73905e None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:28.174813 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d969bcd-2eb2-4c5e-820a-de503e73905e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:28.175052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d969bcd-2eb2-4c5e-820a-de503e73905e None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:28.176737 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 412/839] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:19:28.182377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22315391-85f1-4fc5-87b2-3bdebfe3185b None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:28.182761 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22315391-85f1-4fc5-87b2-3bdebfe3185b None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:28.183012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22315391-85f1-4fc5-87b2-3bdebfe3185b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:28.194145 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ec97a-d3fc-46e3-8fb5-cf5e4ab40587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:28.194795 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ec97a-d3fc-46e3-8fb5-cf5e4ab40587 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:28.195101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ec97a-d3fc-46e3-8fb5-cf5e4ab40587 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:28.195370 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ec97a-d3fc-46e3-8fb5-cf5e4ab40587 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:28.202844 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-22315391-85f1-4fc5-87b2-3bdebfe3185b None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:28.204122 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ec97a-d3fc-46e3-8fb5-cf5e4ab40587 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:28.204669 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-22315391-85f1-4fc5-87b2-3bdebfe3185b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:28.205619 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ec97a-d3fc-46e3-8fb5-cf5e4ab40587 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:28.217697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-958ec97a-d3fc-46e3-8fb5-cf5e4ab40587 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 16:19:28.217697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:28.217697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:28.217697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:28.217697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:28.217697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:28.217697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:28.217697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:28.217697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:28.217697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:28.217697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:28.217697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:28.217697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:19:28.217697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:19:28.217697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:19:28.217697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:19:28.218778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:28.218778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:28.218778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:19:28.218778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:28.218778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:19:28.218778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:28.218778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:28.218778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:28.218778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:28.218778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:28.218778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:28.218778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:28.218778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:28.218778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:28.218778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:28.218778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:28.218778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:28.218778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:28.220916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:28.220916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:28.220916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:19:28.220916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:19:28.220916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:19:28.220916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:19:28.220916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:19:28.220916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:19:28.220916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 16:19:28.220916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:28.222130 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 428/840] 10.222.0.55 () {56 vars in 1117 bytes} [Tue Oct 4 16:19:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:28.223881 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd34d7-9647-407c-8c89-c1fb6e560ea3 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:28.224565 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd34d7-9647-407c-8c89-c1fb6e560ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:28.224829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd34d7-9647-407c-8c89-c1fb6e560ea3 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:28.226797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 429/841] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:28.230663 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd34d7-9647-407c-8c89-c1fb6e560ea3 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:28.284454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 413/842] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 16:19:28.286911 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0cc3e-9665-44c8-9875-4f58627ad7bc None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:28.288020 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0cc3e-9665-44c8-9875-4f58627ad7bc None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:28.288703 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0cc3e-9665-44c8-9875-4f58627ad7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:28.322718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-15a0cc3e-9665-44c8-9875-4f58627ad7bc None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:28.324321 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-15a0cc3e-9665-44c8-9875-4f58627ad7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:28.377987 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd34d7-9647-407c-8c89-c1fb6e560ea3 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:28.389142 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:28.389847 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:28.427044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 414/843] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:19:28.441291 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd13a82-ad00-4c37-b74c-d4534633562f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:28.441980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd13a82-ad00-4c37-b74c-d4534633562f None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:28.442242 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd13a82-ad00-4c37-b74c-d4534633562f None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:28.442521 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd13a82-ad00-4c37-b74c-d4534633562f None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:28.443325 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd13a82-ad00-4c37-b74c-d4534633562f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:28.443634 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd13a82-ad00-4c37-b74c-d4534633562f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:28.445205 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd13a82-ad00-4c37-b74c-d4534633562f None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:28.473829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 430/844] 10.222.0.55 () {56 vars in 1149 bytes} [Tue Oct 4 16:19:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:28.480357 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0cc3e-9665-44c8-9875-4f58627ad7bc None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:28.605302 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd13a82-ad00-4c37-b74c-d4534633562f None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:28.611554 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0cc3e-9665-44c8-9875-4f58627ad7bc None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:28.656263 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135388b2-fafd-45dd-9289-28bb15ca87e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:28.656819 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135388b2-fafd-45dd-9289-28bb15ca87e2 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:28.657094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135388b2-fafd-45dd-9289-28bb15ca87e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:28.657363 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135388b2-fafd-45dd-9289-28bb15ca87e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:28.732550 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:28.736581 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd13a82-ad00-4c37-b74c-d4534633562f None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:28.755666 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135388b2-fafd-45dd-9289-28bb15ca87e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:28.757134 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135388b2-fafd-45dd-9289-28bb15ca87e2 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:28.779444 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf37331-324b-41fb-96b0-69e9ce0019b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:28.780207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf37331-324b-41fb-96b0-69e9ce0019b1 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:28.780526 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf37331-324b-41fb-96b0-69e9ce0019b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:28.780807 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf37331-324b-41fb-96b0-69e9ce0019b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:28.792723 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf37331-324b-41fb-96b0-69e9ce0019b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:19:28.798073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-7bf37331-324b-41fb-96b0-69e9ce0019b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:19:28.798073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:28.798073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:28.798073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:28.798073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:28.798073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:28.798073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:28.798073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:28.798073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:28.798073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:28.798073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:28.798073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:28.798073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:19:28.798073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:19:28.798073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:19:28.798073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:19:28.799887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:19:28.799887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:19:28.799887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:19:28.799887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:19:28.799887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:28.799887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:28.799887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:28.799887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:28.799887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:28.799887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:28.799887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:28.799887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:28.799887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:28.799887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:28.799887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:28.799887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:28.800751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:28.800751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:28.800751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:28.800751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:28.800751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:19:28.800751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:19:28.800751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:19:28.800751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:19:28.800751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:19:28.800751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:19:28.800751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:19:28.800751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:28.800751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 431/845] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:19:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:19:28.800751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf37331-324b-41fb-96b0-69e9ce0019b1 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:28.834201 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:28.888612 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 415/846] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:19:28 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 16:19:28.888612 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135388b2-fafd-45dd-9289-28bb15ca87e2 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:28.935930 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf37331-324b-41fb-96b0-69e9ce0019b1 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:28.984405 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:28.987517 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06b861-8e6f-4476-9f31-e40a319feb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:28.988259 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06b861-8e6f-4476-9f31-e40a319feb5d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:28.988598 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06b861-8e6f-4476-9f31-e40a319feb5d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:28.988940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06b861-8e6f-4476-9f31-e40a319feb5d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:28.989535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06b861-8e6f-4476-9f31-e40a319feb5d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:28.990895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06b861-8e6f-4476-9f31-e40a319feb5d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:29.005003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-4c06b861-8e6f-4476-9f31-e40a319feb5d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 16:19:29.005003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:29.005003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 16:19:29.005003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 16:19:29.005003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 16:19:29.005003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 16:19:29.005003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 16:19:29.005003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:29.005003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 16:19:29.005003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:29.005003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:19:29.005003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:29.005003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:29.005003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:29.005003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:29.005003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:29.005003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:29.006086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:29.006086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:29.006086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:29.006086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:29.006086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:29.006086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:29.006086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 16:19:29.006086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 16:19:29.006086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 16:19:29.006086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 16:19:29.006086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:29.006086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:29.006086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:29.006086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:29.006086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:29.006086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:29.006917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:29.006917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:29.006917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:29.006917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:29.006917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:29.006917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:29.006917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:29.006917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:29.006917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:29.006917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:29.006917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 16:19:29.006917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:29.006917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 16:19:29.006917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:29.006917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 432/847] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Oct 4 16:19:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:29.007956 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06b861-8e6f-4476-9f31-e40a319feb5d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:29.021151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135388b2-fafd-45dd-9289-28bb15ca87e2 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:29.068059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59293c-a166-44ba-9f16-628b217efabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:29.068674 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59293c-a166-44ba-9f16-628b217efabc None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:29.068943 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59293c-a166-44ba-9f16-628b217efabc None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:29.069639 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59293c-a166-44ba-9f16-628b217efabc None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:29.069881 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb59293c-a166-44ba-9f16-628b217efabc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:29.070160 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb59293c-a166-44ba-9f16-628b217efabc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:29.071677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb59293c-a166-44ba-9f16-628b217efabc None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:29.080565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 416/848] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:19:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:29.081407 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59293c-a166-44ba-9f16-628b217efabc None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:29.121014 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:29.138363 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06b861-8e6f-4476-9f31-e40a319feb5d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:29.179362 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10736f5f-af38-43ec-bdf4-095816f2d23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:29.180376 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10736f5f-af38-43ec-bdf4-095816f2d23a None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:29.180972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10736f5f-af38-43ec-bdf4-095816f2d23a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:29.181402 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10736f5f-af38-43ec-bdf4-095816f2d23a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:29.193106 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59293c-a166-44ba-9f16-628b217efabc None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:29.196624 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10736f5f-af38-43ec-bdf4-095816f2d23a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:29.198146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10736f5f-af38-43ec-bdf4-095816f2d23a None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:29.215255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-10736f5f-af38-43ec-bdf4-095816f2d23a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:29.215255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:29.215255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:29.215255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:29.215255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:29.215255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:29.215255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:29.215255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:29.215255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:29.215255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:29.215255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:29.215255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:29.215255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:29.215255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:29.215255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:29.215255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:29.216389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:29.216389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:29.216389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:29.216389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:29.216389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:29.216389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:29.216389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:29.216389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:29.216389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:29.216389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:29.216389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:29.216389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:29.216389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:29.216389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:29.216389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:29.216389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:29.216389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:29.217997 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:29.217997 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:29.217997 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:29.217997 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 433/849] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:29.217997 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10736f5f-af38-43ec-bdf4-095816f2d23a None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:29.239229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8b36e-0f38-430b-a4fe-a8096fd8b7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:29.239852 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8b36e-0f38-430b-a4fe-a8096fd8b7ab None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:29.240132 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8b36e-0f38-430b-a4fe-a8096fd8b7ab None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:29.240404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8b36e-0f38-430b-a4fe-a8096fd8b7ab None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:29.241041 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8b36e-0f38-430b-a4fe-a8096fd8b7ab None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:29.241342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8b36e-0f38-430b-a4fe-a8096fd8b7ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:29.242722 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8b36e-0f38-430b-a4fe-a8096fd8b7ab None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:29.252179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 417/850] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Oct 4 16:19:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:29.252179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8b36e-0f38-430b-a4fe-a8096fd8b7ab None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:29.260282 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:29.345617 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10736f5f-af38-43ec-bdf4-095816f2d23a None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:29.371055 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8b36e-0f38-430b-a4fe-a8096fd8b7ab None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:29.385703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc61b31-32ac-4beb-9c30-cd6d3a92c1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:29.386367 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc61b31-32ac-4beb-9c30-cd6d3a92c1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:29.386638 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc61b31-32ac-4beb-9c30-cd6d3a92c1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:29.386906 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc61b31-32ac-4beb-9c30-cd6d3a92c1d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:29.400541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:29.403639 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc61b31-32ac-4beb-9c30-cd6d3a92c1d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:29.405179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc61b31-32ac-4beb-9c30-cd6d3a92c1d1 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:29.412689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2002d-26db-4cd6-a9fd-7676e3573fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:29.413675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2002d-26db-4cd6-a9fd-7676e3573fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:29.413675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2002d-26db-4cd6-a9fd-7676e3573fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:29.413873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2002d-26db-4cd6-a9fd-7676e3573fb5 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:29.414509 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2002d-26db-4cd6-a9fd-7676e3573fb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:29.414803 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2002d-26db-4cd6-a9fd-7676e3573fb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:29.416228 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2002d-26db-4cd6-a9fd-7676e3573fb5 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:29.424532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-8bc61b31-32ac-4beb-9c30-cd6d3a92c1d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:29.424532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:29.424532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:29.424532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:29.424532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:29.424532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:29.424532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:29.424532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:29.424532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:29.424532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:29.424532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:29.424532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:29.424532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:29.424532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:29.424532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:29.424532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:29.425596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:29.425596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:29.425596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:29.425596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:29.425596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:29.425596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:29.425596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:29.425596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:29.425596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:29.425596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:29.425596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:29.425596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:29.425596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:29.425596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:29.425596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:29.425596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:29.425596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:29.426522 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:29.426522 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:29.426522 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:29.426522 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 434/851] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:29.426522 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc61b31-32ac-4beb-9c30-cd6d3a92c1d1 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:29.438065 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 418/852] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:29.438065 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2002d-26db-4cd6-a9fd-7676e3573fb5 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:29.515561 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:29.553671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc61b31-32ac-4beb-9c30-cd6d3a92c1d1 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:29.561648 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2002d-26db-4cd6-a9fd-7676e3573fb5 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:29.604368 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c453d6a-7ed5-4d05-9491-bade3672f005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:29.605346 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c453d6a-7ed5-4d05-9491-bade3672f005 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:29.605733 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c453d6a-7ed5-4d05-9491-bade3672f005 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:29.605878 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c453d6a-7ed5-4d05-9491-bade3672f005 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:29.606517 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c453d6a-7ed5-4d05-9491-bade3672f005 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:29.606804 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c453d6a-7ed5-4d05-9491-bade3672f005 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:29.608221 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c453d6a-7ed5-4d05-9491-bade3672f005 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:29.614269 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 435/853] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Oct 4 16:19:29 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:29.615487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c453d6a-7ed5-4d05-9491-bade3672f005 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:29.615815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808fe67-5e5c-41eb-a9b4-702ffd0c9c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:29.616836 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808fe67-5e5c-41eb-a9b4-702ffd0c9c32 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:29.617223 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808fe67-5e5c-41eb-a9b4-702ffd0c9c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:29.617597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808fe67-5e5c-41eb-a9b4-702ffd0c9c32 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:29.618400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808fe67-5e5c-41eb-a9b4-702ffd0c9c32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:29.618810 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808fe67-5e5c-41eb-a9b4-702ffd0c9c32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:29.620598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808fe67-5e5c-41eb-a9b4-702ffd0c9c32 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:29.637065 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 419/854] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:29.642722 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808fe67-5e5c-41eb-a9b4-702ffd0c9c32 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:29.713503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:29.777856 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c453d6a-7ed5-4d05-9491-bade3672f005 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:29.805021 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808fe67-5e5c-41eb-a9b4-702ffd0c9c32 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:29.821387 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c09a1-e8d1-4df3-8e17-a2198d9fadc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:29.822032 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c09a1-e8d1-4df3-8e17-a2198d9fadc1 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:29.822742 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c09a1-e8d1-4df3-8e17-a2198d9fadc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:29.822742 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c09a1-e8d1-4df3-8e17-a2198d9fadc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:29.831018 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c09a1-e8d1-4df3-8e17-a2198d9fadc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:29.832520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c09a1-e8d1-4df3-8e17-a2198d9fadc1 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:29.838680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:29.847940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-d40c09a1-e8d1-4df3-8e17-a2198d9fadc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:29.847940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:29.847940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:29.847940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:29.847940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:29.847940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:29.847940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:29.847940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:29.847940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:29.847940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:29.847940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:29.847940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:29.847940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:19:29.847940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:19:29.847940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:19:29.849059 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:19:29.849059 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:29.849059 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:29.849059 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:29.849059 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:29.849059 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:29.849059 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:29.849059 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:29.849059 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:29.849059 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:29.849059 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:29.849059 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:29.849059 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:29.849059 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:29.849059 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:29.849059 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:29.849059 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:29.850108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:19:29.850108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:19:29.850108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:19:29.850108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:19:29.850108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:19:29.850108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:19:29.850108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:29.850108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:29.850108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 436/855] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:19:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:29.850701 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69c3c8-bf33-4391-ae09-b126ba941fa7 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:29.855546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69c3c8-bf33-4391-ae09-b126ba941fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:29.855546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69c3c8-bf33-4391-ae09-b126ba941fa7 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:29.855546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 437/856] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:29.855843 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c50ad-1995-4416-b40d-35f572a12108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:29.855843 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c50ad-1995-4416-b40d-35f572a12108 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:29.855843 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c50ad-1995-4416-b40d-35f572a12108 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:29.855843 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c50ad-1995-4416-b40d-35f572a12108 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:29.859982 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69c3c8-bf33-4391-ae09-b126ba941fa7 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:29.868643 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c50ad-1995-4416-b40d-35f572a12108 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:29.871170 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c50ad-1995-4416-b40d-35f572a12108 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:29.885975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-9c8c50ad-1995-4416-b40d-35f572a12108 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 16:19:29.885975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:29.885975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:29.885975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:29.885975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:29.885975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:29.885975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:29.885975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:29.885975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:29.885975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:29.885975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:29.885975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:29.885975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:19:29.885975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:19:29.885975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:19:29.885975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:19:29.887338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:29.887338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:29.887338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:19:29.887338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:29.887338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:19:29.887338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:29.887338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:29.887338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:29.887338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:29.887338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:29.887338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:29.887338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:29.887338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:29.887338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:29.887338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:29.887338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:29.887338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:29.887338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:29.888474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:29.888474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:29.888474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:19:29.888474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:19:29.888474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:19:29.888474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:19:29.888474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:19:29.888474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:19:29.888474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 16:19:29.888474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:29.889239 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 420/857] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:19:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:29.890337 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235204ac-34c0-4817-9106-74938fab696b None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:29.890617 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235204ac-34c0-4817-9106-74938fab696b None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:29.890887 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235204ac-34c0-4817-9106-74938fab696b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:29.912596 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-235204ac-34c0-4817-9106-74938fab696b None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:29.914399 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-235204ac-34c0-4817-9106-74938fab696b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:29.992926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69c3c8-bf33-4391-ae09-b126ba941fa7 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:30.003215 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 421/858] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:19:30.003215 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235204ac-34c0-4817-9106-74938fab696b None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:30.017889 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:30.041583 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5cebb8-6aee-4a65-ba8b-f02b0d45c660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:30.042185 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cebb8-6aee-4a65-ba8b-f02b0d45c660 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:30.042460 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cebb8-6aee-4a65-ba8b-f02b0d45c660 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:30.042726 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cebb8-6aee-4a65-ba8b-f02b0d45c660 None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:30.043451 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5cebb8-6aee-4a65-ba8b-f02b0d45c660 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:30.043751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5cebb8-6aee-4a65-ba8b-f02b0d45c660 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:30.045563 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5cebb8-6aee-4a65-ba8b-f02b0d45c660 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:30.064019 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 438/859] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:19:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:30.066674 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5cebb8-6aee-4a65-ba8b-f02b0d45c660 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:30.154085 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235204ac-34c0-4817-9106-74938fab696b None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:30.184872 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:30.192856 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5cebb8-6aee-4a65-ba8b-f02b0d45c660 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:30.204867 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770496c0-422f-4a12-b592-12d00145eb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:30.206003 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770496c0-422f-4a12-b592-12d00145eb3d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:30.206351 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770496c0-422f-4a12-b592-12d00145eb3d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:30.206689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770496c0-422f-4a12-b592-12d00145eb3d None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:30.207804 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770496c0-422f-4a12-b592-12d00145eb3d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:30.208355 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770496c0-422f-4a12-b592-12d00145eb3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:30.212371 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770496c0-422f-4a12-b592-12d00145eb3d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:30.233471 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c75db5-e751-4995-a9d9-3935a6f452b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:30.234446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c75db5-e751-4995-a9d9-3935a6f452b2 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:30.235009 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c75db5-e751-4995-a9d9-3935a6f452b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:30.235454 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c75db5-e751-4995-a9d9-3935a6f452b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:30.236537 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c75db5-e751-4995-a9d9-3935a6f452b2 None admin] RBAC: Adding query filter params (role.id=2165a726b4034e1584166027f2361b5f, scope.project.id=e480e782c4fa403a913ca7179db0843b, user.id=05cfc9d62a244701a5df524d1c26f107) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:30.237061 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c75db5-e751-4995-a9d9-3935a6f452b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:30.242890 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 422/860] 10.222.0.55 () {56 vars in 1135 bytes} [Tue Oct 4 16:19:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:30.244024 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770496c0-422f-4a12-b592-12d00145eb3d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:30.244594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c75db5-e751-4995-a9d9-3935a6f452b2 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:30.259508 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 439/861] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:19:30 2022] GET /identity/v3/role_assignments?user.id=05cfc9d62a244701a5df524d1c26f107&scope.project.id=e480e782c4fa403a913ca7179db0843b&role.id=2165a726b4034e1584166027f2361b5f => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:30.321635 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c75db5-e751-4995-a9d9-3935a6f452b2 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:30.376780 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770496c0-422f-4a12-b592-12d00145eb3d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:30.378097 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:30.420499 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764af4f9-22d8-49d6-ac8a-d3106b217f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:30.421243 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764af4f9-22d8-49d6-ac8a-d3106b217f02 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:30.421588 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764af4f9-22d8-49d6-ac8a-d3106b217f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:30.421933 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764af4f9-22d8-49d6-ac8a-d3106b217f02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:30.461795 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c75db5-e751-4995-a9d9-3935a6f452b2 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:30.477047 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:30.514125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764af4f9-22d8-49d6-ac8a-d3106b217f02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:30.515687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764af4f9-22d8-49d6-ac8a-d3106b217f02 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:30.517370 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037de66-b64a-490e-9f85-f8b538024072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:30.518378 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037de66-b64a-490e-9f85-f8b538024072 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:30.518819 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037de66-b64a-490e-9f85-f8b538024072 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:30.519239 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037de66-b64a-490e-9f85-f8b538024072 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:30.519842 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037de66-b64a-490e-9f85-f8b538024072 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:30.521272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037de66-b64a-490e-9f85-f8b538024072 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:30.540815 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-c037de66-b64a-490e-9f85-f8b538024072 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 16:19:30.540815 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:30.540815 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 16:19:30.540815 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 16:19:30.540815 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 16:19:30.540815 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 16:19:30.540815 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 16:19:30.540815 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:30.540815 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 16:19:30.540815 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:30.540815 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:19:30.540815 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:30.540815 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:30.540815 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:30.540815 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:30.540815 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:30.541935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:30.541935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:30.541935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:30.541935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:30.541935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:30.541935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:30.541935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:30.541935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 16:19:30.541935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 16:19:30.541935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 16:19:30.541935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 16:19:30.541935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:30.541935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:30.541935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:30.541935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:30.541935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:30.541935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:30.543249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:30.543249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:30.543249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:30.543249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:30.543249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:30.543249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:30.543249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:30.543249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:30.543249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:30.543249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:30.543249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 16:19:30.543249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:30.543249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 16:19:30.543249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:30.543249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 440/862] 10.222.0.55 () {56 vars in 1132 bytes} [Tue Oct 4 16:19:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:19:30.549910 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037de66-b64a-490e-9f85-f8b538024072 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:30.680281 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 423/863] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:19:30 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 16:19:30.687915 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764af4f9-22d8-49d6-ac8a-d3106b217f02 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:30.701910 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037de66-b64a-490e-9f85-f8b538024072 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:30.704651 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:30.740690 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c11ed1-1529-4843-a543-e1ea5427ab63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:30.741479 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c11ed1-1529-4843-a543-e1ea5427ab63 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:30.741850 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c11ed1-1529-4843-a543-e1ea5427ab63 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:30.742243 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c11ed1-1529-4843-a543-e1ea5427ab63 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:30.743281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c11ed1-1529-4843-a543-e1ea5427ab63 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:30.743918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c11ed1-1529-4843-a543-e1ea5427ab63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:30.745812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c11ed1-1529-4843-a543-e1ea5427ab63 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:30.754657 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 441/864] 10.222.0.55 () {56 vars in 1126 bytes} [Tue Oct 4 16:19:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:30.764265 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c11ed1-1529-4843-a543-e1ea5427ab63 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:30.799438 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:30.830113 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764af4f9-22d8-49d6-ac8a-d3106b217f02 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:30.879303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae068f3c-2717-4bb8-8a02-88ecc515df1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:30.879959 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae068f3c-2717-4bb8-8a02-88ecc515df1a None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:30.880273 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae068f3c-2717-4bb8-8a02-88ecc515df1a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:30.880550 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae068f3c-2717-4bb8-8a02-88ecc515df1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:30.893178 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c11ed1-1529-4843-a543-e1ea5427ab63 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:30.895021 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae068f3c-2717-4bb8-8a02-88ecc515df1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:30.897829 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae068f3c-2717-4bb8-8a02-88ecc515df1a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:30.924333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-ae068f3c-2717-4bb8-8a02-88ecc515df1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:30.924333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:30.924333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:30.924333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:30.924333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:30.924333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:30.924333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:30.924333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:30.924333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:30.924333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:30.924333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:30.924333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:30.924333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:30.924333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:30.924333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:30.924333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:30.925366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:30.925366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:30.925366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:30.925366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:30.925366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:30.925366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:30.925366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:30.925366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:30.925366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:30.925366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:30.925366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:30.925366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:30.925366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:30.925366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:30.925366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:30.925366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:30.925366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:30.926270 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:30.926270 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:30.926270 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:30.928927 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 424/865] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:30.936485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae068f3c-2717-4bb8-8a02-88ecc515df1a None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:30.940425 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7111df-22be-4a69-808e-6b01d5df45b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:30.941153 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7111df-22be-4a69-808e-6b01d5df45b1 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:30.941528 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7111df-22be-4a69-808e-6b01d5df45b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:30.941891 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7111df-22be-4a69-808e-6b01d5df45b1 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:30.942812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7111df-22be-4a69-808e-6b01d5df45b1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:30.943237 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7111df-22be-4a69-808e-6b01d5df45b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:30.944774 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7111df-22be-4a69-808e-6b01d5df45b1 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:30.950493 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 442/866] 10.222.0.55 () {56 vars in 1126 bytes} [Tue Oct 4 16:19:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:19:31.100928 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae068f3c-2717-4bb8-8a02-88ecc515df1a None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:31.129895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:31.139679 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f86d24-df2a-4053-a4bb-a803d80f9a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:31.140831 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f86d24-df2a-4053-a4bb-a803d80f9a5e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:31.141509 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f86d24-df2a-4053-a4bb-a803d80f9a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:31.141776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f86d24-df2a-4053-a4bb-a803d80f9a5e None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:31.142429 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f86d24-df2a-4053-a4bb-a803d80f9a5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:31.142726 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f86d24-df2a-4053-a4bb-a803d80f9a5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:31.144215 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f86d24-df2a-4053-a4bb-a803d80f9a5e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:31.158431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 425/867] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:31.166233 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7111df-22be-4a69-808e-6b01d5df45b1 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:31.217793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:31.313013 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7111df-22be-4a69-808e-6b01d5df45b1 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:31.351673 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2632c-2d5a-4220-9644-63ade5f97009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:31.352633 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2632c-2d5a-4220-9644-63ade5f97009 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:31.353086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2632c-2d5a-4220-9644-63ade5f97009 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:31.353530 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2632c-2d5a-4220-9644-63ade5f97009 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:31.361480 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2632c-2d5a-4220-9644-63ade5f97009 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:31.363272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2632c-2d5a-4220-9644-63ade5f97009 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:31.375917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-d5c2632c-2d5a-4220-9644-63ade5f97009 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:31.375917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:31.375917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:31.375917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:31.375917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:31.375917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:31.375917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:31.375917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:31.375917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:31.375917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:31.375917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:31.375917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:31.375917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:19:31.375917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:19:31.375917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:19:31.376868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:19:31.376868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:31.376868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:31.376868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:31.376868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:31.376868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:31.376868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:31.376868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:31.376868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:31.376868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:31.376868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:31.376868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:31.376868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:31.376868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:31.376868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:31.376868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:31.376868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:31.377808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:19:31.377808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:19:31.377808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:19:31.377808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:19:31.377808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:19:31.377808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:19:31.377808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:31.377808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:31.380057 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 443/868] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:19:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:31.385753 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f86d24-df2a-4053-a4bb-a803d80f9a5e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:31.507535 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f86d24-df2a-4053-a4bb-a803d80f9a5e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:31.553529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381d357-8bbc-46fe-b9ee-090d56da07ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:31.554197 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381d357-8bbc-46fe-b9ee-090d56da07ca None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:31.554418 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381d357-8bbc-46fe-b9ee-090d56da07ca None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:31.554691 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381d357-8bbc-46fe-b9ee-090d56da07ca None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:31.555430 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381d357-8bbc-46fe-b9ee-090d56da07ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:31.555731 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381d357-8bbc-46fe-b9ee-090d56da07ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:31.557245 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381d357-8bbc-46fe-b9ee-090d56da07ca None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:31.572144 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 426/869] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:19:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:31.581206 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2632c-2d5a-4220-9644-63ade5f97009 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:31.694428 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:31.703467 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2632c-2d5a-4220-9644-63ade5f97009 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:31.746635 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ba495-b93d-40b6-b11e-5d5d79367f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:31.747621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ba495-b93d-40b6-b11e-5d5d79367f57 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:31.748054 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ba495-b93d-40b6-b11e-5d5d79367f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:31.748460 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ba495-b93d-40b6-b11e-5d5d79367f57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:31.749325 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ba495-b93d-40b6-b11e-5d5d79367f57 None admin] RBAC: Adding query filter params (role.id=066f46534195417295e63a5316632eae, scope.project.id=e480e782c4fa403a913ca7179db0843b, user.id=6590cb6c1c964039b9dea771a647bdac) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:31.749784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ba495-b93d-40b6-b11e-5d5d79367f57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:31.751517 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ba495-b93d-40b6-b11e-5d5d79367f57 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:31.758617 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 444/870] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:19:31 2022] GET /identity/v3/role_assignments?user.id=6590cb6c1c964039b9dea771a647bdac&scope.project.id=e480e782c4fa403a913ca7179db0843b&role.id=066f46534195417295e63a5316632eae => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:32.039647 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408084f-c110-467f-9383-feaa310e179b None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:32.039827 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408084f-c110-467f-9383-feaa310e179b None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:32.040150 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408084f-c110-467f-9383-feaa310e179b None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:32.041764 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 427/871] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:32.047917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15cd9b-a5df-4a75-b5af-8c7ec676f3b1 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:32.048205 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15cd9b-a5df-4a75-b5af-8c7ec676f3b1 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:32.048546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15cd9b-a5df-4a75-b5af-8c7ec676f3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:32.072406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-bf15cd9b-a5df-4a75-b5af-8c7ec676f3b1 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:32.073689 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-bf15cd9b-a5df-4a75-b5af-8c7ec676f3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:32.154051 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 445/872] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:19:32.448690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408084f-c110-467f-9383-feaa310e179b None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:32.505402 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:32.563092 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408084f-c110-467f-9383-feaa310e179b None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:32.605307 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31a112-ca7e-4f07-9947-bc2515f259a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:32.605992 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31a112-ca7e-4f07-9947-bc2515f259a0 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:32.606271 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31a112-ca7e-4f07-9947-bc2515f259a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:32.606541 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31a112-ca7e-4f07-9947-bc2515f259a0 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:32.607245 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31a112-ca7e-4f07-9947-bc2515f259a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:32.608632 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31a112-ca7e-4f07-9947-bc2515f259a0 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:32.634273 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 428/873] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Oct 4 16:19:32 2022] POST /identity/v3/services => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:19:32.753427 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6ce86-5b2b-4e3b-97e6-3e31bac71e53 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:32.753939 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6ce86-5b2b-4e3b-97e6-3e31bac71e53 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:32.753939 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6ce86-5b2b-4e3b-97e6-3e31bac71e53 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:32.755806 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 446/874] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:19:32.761773 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ade5bf-a2cc-408a-8e17-fac64ab1a6c4 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:32.762063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ade5bf-a2cc-408a-8e17-fac64ab1a6c4 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:32.762317 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ade5bf-a2cc-408a-8e17-fac64ab1a6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:32.782419 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-f0ade5bf-a2cc-408a-8e17-fac64ab1a6c4 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:32.783662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f0ade5bf-a2cc-408a-8e17-fac64ab1a6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:32.865948 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 429/875] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:32 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:19:33.134177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6ce86-5b2b-4e3b-97e6-3e31bac71e53 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:33.222939 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:33.233111 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40caa3c-ef16-43a9-94b5-1ef9b9288cdd None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:33.233396 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40caa3c-ef16-43a9-94b5-1ef9b9288cdd None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:33.233677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40caa3c-ef16-43a9-94b5-1ef9b9288cdd None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:33.235313 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 430/876] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:33.240598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502c50c-6269-40bd-9eb6-b3a5dd4e1858 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:33.240875 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502c50c-6269-40bd-9eb6-b3a5dd4e1858 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:33.241143 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502c50c-6269-40bd-9eb6-b3a5dd4e1858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:33.241443 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6ce86-5b2b-4e3b-97e6-3e31bac71e53 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:33.258935 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-e502c50c-6269-40bd-9eb6-b3a5dd4e1858 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:33.260174 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-e502c50c-6269-40bd-9eb6-b3a5dd4e1858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:33.278023 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228e4b9-7161-48ae-ad37-8558ea1cfa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:33.278761 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228e4b9-7161-48ae-ad37-8558ea1cfa69 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:33.279065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228e4b9-7161-48ae-ad37-8558ea1cfa69 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:33.279338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228e4b9-7161-48ae-ad37-8558ea1cfa69 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:33.287603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:33.291607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228e4b9-7161-48ae-ad37-8558ea1cfa69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:19:33.297074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-1228e4b9-7161-48ae-ad37-8558ea1cfa69 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 16:19:33.297074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:33.297074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:33.297074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:33.297074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:33.297074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:33.297074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:33.297074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:33.297074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:33.297074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:33.297074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:33.297074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:33.297074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:19:33.297074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:19:33.297074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:19:33.297074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:19:33.298007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:19:33.298007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:19:33.298007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:19:33.298007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:19:33.298007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:33.298007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:33.298007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:33.298007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:33.298007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:33.298007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:33.298007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:33.298007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:33.298007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:33.298007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:33.298007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:33.298007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:33.298873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:33.298873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:33.298873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:33.298873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:33.298873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:19:33.298873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:19:33.298873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:19:33.298873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:19:33.298873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:19:33.298873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:19:33.298873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 16:19:33.298873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:33.298873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 447/877] 10.222.0.55 () {56 vars in 1120 bytes} [Tue Oct 4 16:19:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:33.307911 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228e4b9-7161-48ae-ad37-8558ea1cfa69 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:33.336934 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 431/878] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:33 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 16:19:33.410236 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228e4b9-7161-48ae-ad37-8558ea1cfa69 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:33.447452 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43448f93-fe68-42e7-8363-ee9bec7dc4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:33.448486 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43448f93-fe68-42e7-8363-ee9bec7dc4dc None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:33.448976 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43448f93-fe68-42e7-8363-ee9bec7dc4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:33.449435 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43448f93-fe68-42e7-8363-ee9bec7dc4dc None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:33.450302 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43448f93-fe68-42e7-8363-ee9bec7dc4dc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:33.450810 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43448f93-fe68-42e7-8363-ee9bec7dc4dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:33.452384 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43448f93-fe68-42e7-8363-ee9bec7dc4dc None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:33.461247 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 448/879] 10.222.0.55 () {56 vars in 1115 bytes} [Tue Oct 4 16:19:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:33.467406 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502c50c-6269-40bd-9eb6-b3a5dd4e1858 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:33.569065 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502c50c-6269-40bd-9eb6-b3a5dd4e1858 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:33.604250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43448f93-fe68-42e7-8363-ee9bec7dc4dc None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:33.606375 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319e1ce-d75c-486b-91ef-9c581c8e4fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:33.607126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319e1ce-d75c-486b-91ef-9c581c8e4fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:33.607714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319e1ce-d75c-486b-91ef-9c581c8e4fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:33.607986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319e1ce-d75c-486b-91ef-9c581c8e4fa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:33.616804 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:33.621695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319e1ce-d75c-486b-91ef-9c581c8e4fa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:33.623232 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319e1ce-d75c-486b-91ef-9c581c8e4fa1 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:33.639453 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-d319e1ce-d75c-486b-91ef-9c581c8e4fa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:33.639453 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:33.639453 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:33.639453 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:33.639453 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:33.639453 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:33.639453 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:33.639453 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:33.639453 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:33.639453 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:33.639453 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:33.639453 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:33.639453 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:33.639453 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:33.639453 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:33.639453 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:33.640636 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:33.640636 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:33.640636 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:33.640636 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:33.640636 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:33.640636 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:33.640636 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:33.640636 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:33.640636 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:33.640636 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:33.640636 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:33.640636 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:33.640636 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:33.640636 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:33.640636 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:33.640636 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:33.640636 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:33.641558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:33.641558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:33.641558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:33.641558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 432/880] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:33.646388 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319e1ce-d75c-486b-91ef-9c581c8e4fa1 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:33.663582 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:33.723239 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43448f93-fe68-42e7-8363-ee9bec7dc4dc None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:33.754150 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319e1ce-d75c-486b-91ef-9c581c8e4fa1 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:33.765765 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c0ee7-dadb-4ee3-acb7-562959c9e26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:33.767125 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c0ee7-dadb-4ee3-acb7-562959c9e26f None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:33.767844 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c0ee7-dadb-4ee3-acb7-562959c9e26f None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:33.768261 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c0ee7-dadb-4ee3-acb7-562959c9e26f None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:33.769051 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c0ee7-dadb-4ee3-acb7-562959c9e26f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:33.772935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c0ee7-dadb-4ee3-acb7-562959c9e26f None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:33.803326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 449/881] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Oct 4 16:19:33 2022] POST /identity/v3/services => generated 269 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:19:33.803818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87f4f4-6fd2-4f0e-ba76-1ce01790f4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:33.804465 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87f4f4-6fd2-4f0e-ba76-1ce01790f4ae None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:33.804741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87f4f4-6fd2-4f0e-ba76-1ce01790f4ae None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:33.805011 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87f4f4-6fd2-4f0e-ba76-1ce01790f4ae None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:33.805817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87f4f4-6fd2-4f0e-ba76-1ce01790f4ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:33.806122 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87f4f4-6fd2-4f0e-ba76-1ce01790f4ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:33.808945 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87f4f4-6fd2-4f0e-ba76-1ce01790f4ae None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:33.826468 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 433/882] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:19:33.832990 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c0ee7-dadb-4ee3-acb7-562959c9e26f None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:33.922024 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:33.967818 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c0ee7-dadb-4ee3-acb7-562959c9e26f None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:34.008418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065f8be-ec2f-4cb5-95bd-307758c79740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:34.009080 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065f8be-ec2f-4cb5-95bd-307758c79740 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:34.009363 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065f8be-ec2f-4cb5-95bd-307758c79740 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:34.009634 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065f8be-ec2f-4cb5-95bd-307758c79740 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:34.018323 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5065f8be-ec2f-4cb5-95bd-307758c79740 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:34.019872 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5065f8be-ec2f-4cb5-95bd-307758c79740 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:34.033705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-5065f8be-ec2f-4cb5-95bd-307758c79740 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 16:19:34.033705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:34.033705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:34.033705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:34.033705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:34.033705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:34.033705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:34.033705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:34.033705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:34.033705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:34.033705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:34.033705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:34.033705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:19:34.033705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:19:34.033705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:19:34.033705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:19:34.034702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:34.034702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:34.034702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:19:34.034702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:34.034702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:19:34.034702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:34.034702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:34.034702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:34.034702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:34.034702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:34.034702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:34.034702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:34.034702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:34.034702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:34.034702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:34.034702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:34.034702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:34.034702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:34.035745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:34.035745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:34.035745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:19:34.035745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:19:34.035745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:19:34.035745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:19:34.035745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:19:34.035745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:19:34.035745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 16:19:34.035745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:34.035745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 450/883] 10.222.0.55 () {56 vars in 1117 bytes} [Tue Oct 4 16:19:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:34.042758 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87f4f4-6fd2-4f0e-ba76-1ce01790f4ae None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:34.125496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:34.161741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87f4f4-6fd2-4f0e-ba76-1ce01790f4ae None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:34.187047 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3def6a-93e1-45fd-8dc5-7d07428769ae None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:34.187346 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3def6a-93e1-45fd-8dc5-7d07428769ae None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:34.187633 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3def6a-93e1-45fd-8dc5-7d07428769ae None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:34.194840 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 451/884] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:34.197170 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49b8f7-6b36-4dc4-82e2-31f2b408578e None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:34.197535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49b8f7-6b36-4dc4-82e2-31f2b408578e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:34.197897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49b8f7-6b36-4dc4-82e2-31f2b408578e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:34.201272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a02f5-67c9-44be-833e-c60ee0837f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:34.201988 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a02f5-67c9-44be-833e-c60ee0837f73 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:34.202266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a02f5-67c9-44be-833e-c60ee0837f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:34.202536 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a02f5-67c9-44be-833e-c60ee0837f73 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:34.203388 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a02f5-67c9-44be-833e-c60ee0837f73 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:34.203686 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a02f5-67c9-44be-833e-c60ee0837f73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:34.205235 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a02f5-67c9-44be-833e-c60ee0837f73 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:34.218441 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-fe49b8f7-6b36-4dc4-82e2-31f2b408578e None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:34.219821 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-fe49b8f7-6b36-4dc4-82e2-31f2b408578e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:34.233728 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 434/885] 10.222.0.55 () {56 vars in 1149 bytes} [Tue Oct 4 16:19:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:34.240003 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a02f5-67c9-44be-833e-c60ee0837f73 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:34.308480 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 452/886] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 16:19:34.347913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a02f5-67c9-44be-833e-c60ee0837f73 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:34.377270 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:34.384690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62f460-1027-4f72-9efd-db26af109a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:34.385311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62f460-1027-4f72-9efd-db26af109a8a None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:34.385611 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62f460-1027-4f72-9efd-db26af109a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:34.386052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62f460-1027-4f72-9efd-db26af109a8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:34.457409 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62f460-1027-4f72-9efd-db26af109a8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:34.459141 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62f460-1027-4f72-9efd-db26af109a8a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:34.559730 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 435/887] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:19:34 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 16:19:34.566736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49b8f7-6b36-4dc4-82e2-31f2b408578e None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:34.589413 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62f460-1027-4f72-9efd-db26af109a8a None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:34.622434 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:34.637876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:34.696171 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49b8f7-6b36-4dc4-82e2-31f2b408578e None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:34.708624 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62f460-1027-4f72-9efd-db26af109a8a None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:34.746569 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59871346-9038-485c-81b0-e1c39cff2a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:34.746820 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8247762-29e6-4973-8683-9c8b3fef4529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:34.747245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59871346-9038-485c-81b0-e1c39cff2a07 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:34.747348 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8247762-29e6-4973-8683-9c8b3fef4529 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:34.747518 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59871346-9038-485c-81b0-e1c39cff2a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:34.747631 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8247762-29e6-4973-8683-9c8b3fef4529 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:34.747793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59871346-9038-485c-81b0-e1c39cff2a07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:34.747887 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8247762-29e6-4973-8683-9c8b3fef4529 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:34.748376 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8247762-29e6-4973-8683-9c8b3fef4529 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:34.749898 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8247762-29e6-4973-8683-9c8b3fef4529 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:34.759466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-e8247762-29e6-4973-8683-9c8b3fef4529 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 16:19:34.759466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:34.759466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 16:19:34.759466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 16:19:34.759466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 16:19:34.759466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 16:19:34.759466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 16:19:34.759466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:34.759466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 16:19:34.759466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:34.759466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:19:34.759466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:34.759466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:34.759466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:34.759466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:34.759466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:34.759466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:34.760485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:34.760485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:34.760485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:34.760485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:34.760485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:34.760485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:34.760485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 16:19:34.760485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 16:19:34.760485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 16:19:34.760485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 16:19:34.760485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:34.760485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:34.760485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:34.760485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:34.760485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:34.760485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:34.761473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:34.761473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:34.761473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:34.761473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:34.761473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:34.761473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:34.761473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:34.761473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:34.761473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:34.761473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:34.761473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 16:19:34.761473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:34.761473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 16:19:34.761473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:34.762217 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59871346-9038-485c-81b0-e1c39cff2a07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:34.762298 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 436/888] 10.222.0.55 () {56 vars in 1126 bytes} [Tue Oct 4 16:19:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:19:34.762374 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59871346-9038-485c-81b0-e1c39cff2a07 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:34.766724 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8247762-29e6-4973-8683-9c8b3fef4529 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:34.782244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-59871346-9038-485c-81b0-e1c39cff2a07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:34.782244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:34.782244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:34.782244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:34.782244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:34.782244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:34.782244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:34.782244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:34.782244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:34.782244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:34.782244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:34.782244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:34.782244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:34.782244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:34.782244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:34.782244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:34.784477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:34.784477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:34.784477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:34.784477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:34.784477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:34.784477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:34.784477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:34.784477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:34.784477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:34.784477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:34.784477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:34.784477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:34.784477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:34.784477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:34.784477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:34.784477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:34.784477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:34.785688 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:34.785688 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:34.785688 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:34.791006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 453/889] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:34.791006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59871346-9038-485c-81b0-e1c39cff2a07 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:34.882197 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:34.892335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8247762-29e6-4973-8683-9c8b3fef4529 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:34.929401 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59871346-9038-485c-81b0-e1c39cff2a07 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:34.934098 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8851097-5550-48f4-ab2d-45bb639765d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:34.934921 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8851097-5550-48f4-ab2d-45bb639765d4 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:34.935428 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8851097-5550-48f4-ab2d-45bb639765d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:34.935754 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8851097-5550-48f4-ab2d-45bb639765d4 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:34.936457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8851097-5550-48f4-ab2d-45bb639765d4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:34.936815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8851097-5550-48f4-ab2d-45bb639765d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:34.938445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8851097-5550-48f4-ab2d-45bb639765d4 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:34.942120 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:34.950331 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 437/890] 10.222.0.55 () {56 vars in 1122 bytes} [Tue Oct 4 16:19:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:19:34.951717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8851097-5550-48f4-ab2d-45bb639765d4 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:34.971892 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c139e5-2e1b-477b-986b-b5f22699fcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:34.972423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c139e5-2e1b-477b-986b-b5f22699fcf8 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:34.972692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c139e5-2e1b-477b-986b-b5f22699fcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:34.972954 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c139e5-2e1b-477b-986b-b5f22699fcf8 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:34.973625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c139e5-2e1b-477b-986b-b5f22699fcf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:34.973917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c139e5-2e1b-477b-986b-b5f22699fcf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:34.975307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c139e5-2e1b-477b-986b-b5f22699fcf8 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:34.990402 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 454/891] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:19:34.996212 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c139e5-2e1b-477b-986b-b5f22699fcf8 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:35.082047 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8851097-5550-48f4-ab2d-45bb639765d4 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:35.118870 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a85f15-c127-4bb2-aa68-1b677a3da12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:35.119857 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a85f15-c127-4bb2-aa68-1b677a3da12e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:35.120473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c139e5-2e1b-477b-986b-b5f22699fcf8 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:35.120589 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a85f15-c127-4bb2-aa68-1b677a3da12e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:35.121022 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a85f15-c127-4bb2-aa68-1b677a3da12e None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:35.121863 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a85f15-c127-4bb2-aa68-1b677a3da12e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:35.122168 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a85f15-c127-4bb2-aa68-1b677a3da12e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:35.123573 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a85f15-c127-4bb2-aa68-1b677a3da12e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:35.128427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 438/892] 10.222.0.55 () {56 vars in 1122 bytes} [Tue Oct 4 16:19:34 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:19:35.129637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27473530-3716-4758-89c9-3ca7103378b1 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:35.129919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27473530-3716-4758-89c9-3ca7103378b1 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:35.130191 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27473530-3716-4758-89c9-3ca7103378b1 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:35.135906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 439/893] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:35.137543 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70635cd5-1544-43a3-93bb-4add0ff2fcb1 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:35.137824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70635cd5-1544-43a3-93bb-4add0ff2fcb1 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:35.138096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70635cd5-1544-43a3-93bb-4add0ff2fcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:35.158710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-70635cd5-1544-43a3-93bb-4add0ff2fcb1 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:35.159990 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-70635cd5-1544-43a3-93bb-4add0ff2fcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:35.170314 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0668f5f-6ea8-4380-b398-608efc4308b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:35.171624 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0668f5f-6ea8-4380-b398-608efc4308b9 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:35.172081 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0668f5f-6ea8-4380-b398-608efc4308b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:35.172545 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0668f5f-6ea8-4380-b398-608efc4308b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:35.177237 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:35.183208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0668f5f-6ea8-4380-b398-608efc4308b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:35.185667 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0668f5f-6ea8-4380-b398-608efc4308b9 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:35.201004 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-a0668f5f-6ea8-4380-b398-608efc4308b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:35.201004 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:35.201004 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:35.201004 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:35.201004 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:35.201004 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:35.201004 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:35.201004 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:35.201004 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:35.201004 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:35.201004 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:35.201004 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:35.201004 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:19:35.201004 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:19:35.201004 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:19:35.202001 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:19:35.202001 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:35.202001 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:35.202001 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:35.202001 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:35.202001 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:35.202001 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:35.202001 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:35.202001 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:35.202001 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:35.202001 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:35.202001 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:35.202001 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:35.202001 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:35.202001 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:35.202001 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:35.202001 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:35.202913 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:19:35.202913 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:19:35.202913 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:19:35.202913 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:19:35.202913 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:19:35.202913 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:19:35.202913 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:35.202913 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:35.205625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 455/894] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:19:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:35.211473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0668f5f-6ea8-4380-b398-608efc4308b9 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:35.252893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:35.268623 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 440/895] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 16:19:35.350575 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0668f5f-6ea8-4380-b398-608efc4308b9 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:35.390122 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b4e17-3de8-4b36-9dea-a51ff2ce70c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:35.390742 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b4e17-3de8-4b36-9dea-a51ff2ce70c3 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:35.391052 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b4e17-3de8-4b36-9dea-a51ff2ce70c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:35.391334 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b4e17-3de8-4b36-9dea-a51ff2ce70c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:35.392057 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b4e17-3de8-4b36-9dea-a51ff2ce70c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:35.392361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b4e17-3de8-4b36-9dea-a51ff2ce70c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:35.393802 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b4e17-3de8-4b36-9dea-a51ff2ce70c3 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:35.407612 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 456/896] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:19:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:35.413561 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70635cd5-1544-43a3-93bb-4add0ff2fcb1 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:35.532010 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70635cd5-1544-43a3-93bb-4add0ff2fcb1 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:35.562905 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b4e17-3de8-4b36-9dea-a51ff2ce70c3 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:35.579816 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967500a3-9786-4fc9-960f-139ec06c805d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:35.580395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967500a3-9786-4fc9-960f-139ec06c805d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:35.580675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967500a3-9786-4fc9-960f-139ec06c805d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:35.580950 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967500a3-9786-4fc9-960f-139ec06c805d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:35.581700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967500a3-9786-4fc9-960f-139ec06c805d None admin] RBAC: Adding query filter params (role.id=b557a16f80704a549ace1ef1a84f3086, scope.project.id=e480e782c4fa403a913ca7179db0843b, user.id=05cfc9d62a244701a5df524d1c26f107) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:35.582007 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967500a3-9786-4fc9-960f-139ec06c805d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:35.583507 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967500a3-9786-4fc9-960f-139ec06c805d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:35.595143 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 441/897] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:19:35 2022] GET /identity/v3/role_assignments?user.id=05cfc9d62a244701a5df524d1c26f107&scope.project.id=e480e782c4fa403a913ca7179db0843b&role.id=b557a16f80704a549ace1ef1a84f3086 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:35.686864 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:35.701094 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b4e17-3de8-4b36-9dea-a51ff2ce70c3 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:35.748659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1dfc8e-a923-4f9d-8f42-e065b3726d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:35.749326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1dfc8e-a923-4f9d-8f42-e065b3726d3d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:35.749602 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1dfc8e-a923-4f9d-8f42-e065b3726d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:35.749869 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1dfc8e-a923-4f9d-8f42-e065b3726d3d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:35.750473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1dfc8e-a923-4f9d-8f42-e065b3726d3d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:35.751912 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1dfc8e-a923-4f9d-8f42-e065b3726d3d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:35.762822 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-aa1dfc8e-a923-4f9d-8f42-e065b3726d3d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 16:19:35.762822 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:35.762822 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 16:19:35.762822 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 16:19:35.762822 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 16:19:35.762822 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 16:19:35.762822 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 16:19:35.762822 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:35.762822 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 16:19:35.762822 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:35.762822 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:19:35.762822 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:35.762822 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:35.762822 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:35.762822 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:35.762822 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:35.762822 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:35.763943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:35.763943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:35.763943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:35.763943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:35.763943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:35.763943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:35.763943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 16:19:35.763943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 16:19:35.763943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 16:19:35.763943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 16:19:35.763943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:35.763943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:35.763943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:35.763943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:35.763943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:35.763943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:35.764784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:35.764784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:35.764784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:35.764784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:35.764784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:35.764784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:35.764784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:35.764784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:35.764784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:35.764784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:35.764784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 16:19:35.764784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:35.764784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 16:19:35.764784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:35.764784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 457/898] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Oct 4 16:19:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:19:35.770569 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967500a3-9786-4fc9-960f-139ec06c805d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:35.789660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:35.888477 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967500a3-9786-4fc9-960f-139ec06c805d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:35.925086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7631e2-c312-49b2-bc1d-2932e09d9383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:35.925714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7631e2-c312-49b2-bc1d-2932e09d9383 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:35.926035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7631e2-c312-49b2-bc1d-2932e09d9383 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:35.926305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7631e2-c312-49b2-bc1d-2932e09d9383 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:35.926943 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7631e2-c312-49b2-bc1d-2932e09d9383 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:35.927267 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7631e2-c312-49b2-bc1d-2932e09d9383 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:35.928639 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7631e2-c312-49b2-bc1d-2932e09d9383 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:35.934056 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 442/899] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Oct 4 16:19:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:35.939786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1dfc8e-a923-4f9d-8f42-e065b3726d3d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:36.054914 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1dfc8e-a923-4f9d-8f42-e065b3726d3d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:36.091747 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff646bc-05cd-486a-adfe-a58e91ac0ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:36.092362 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff646bc-05cd-486a-adfe-a58e91ac0ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:36.092632 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff646bc-05cd-486a-adfe-a58e91ac0ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:36.092896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff646bc-05cd-486a-adfe-a58e91ac0ba0 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:36.093525 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff646bc-05cd-486a-adfe-a58e91ac0ba0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:36.093819 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff646bc-05cd-486a-adfe-a58e91ac0ba0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:36.095338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff646bc-05cd-486a-adfe-a58e91ac0ba0 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:36.100936 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 458/900] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Oct 4 16:19:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:36.106883 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7631e2-c312-49b2-bc1d-2932e09d9383 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:36.174518 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d06ec1-517d-438c-8de7-56c2e07ab83e None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:36.174866 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d06ec1-517d-438c-8de7-56c2e07ab83e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:36.175102 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d06ec1-517d-438c-8de7-56c2e07ab83e None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:36.176584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 459/901] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:19:36.182196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e2d32-ad88-4c06-9b67-965fbf45d50c None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:36.182694 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e2d32-ad88-4c06-9b67-965fbf45d50c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:36.183305 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e2d32-ad88-4c06-9b67-965fbf45d50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:36.200351 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:36.205082 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-328e2d32-ad88-4c06-9b67-965fbf45d50c None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:36.207640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-328e2d32-ad88-4c06-9b67-965fbf45d50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:36.223359 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:36.224324 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7631e2-c312-49b2-bc1d-2932e09d9383 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:36.265405 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0912f42-6661-4935-90c7-30cf1f6d54d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:36.266035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0912f42-6661-4935-90c7-30cf1f6d54d7 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:36.266314 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0912f42-6661-4935-90c7-30cf1f6d54d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:36.266597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0912f42-6661-4935-90c7-30cf1f6d54d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:36.267603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0912f42-6661-4935-90c7-30cf1f6d54d7 None admin] RBAC: Adding query filter params (interface=public, service_id=e3c62a5802454443a109c3cc30f6e823, region_id=RegionOne) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:36.267913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0912f42-6661-4935-90c7-30cf1f6d54d7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:36.269950 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0912f42-6661-4935-90c7-30cf1f6d54d7 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:36.279072 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 443/902] 10.222.0.55 () {56 vars in 1251 bytes} [Tue Oct 4 16:19:36 2022] GET /identity/v3/endpoints?service_id=e3c62a5802454443a109c3cc30f6e823&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:19:36.283333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0912f42-6661-4935-90c7-30cf1f6d54d7 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:36.303007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 460/903] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 16:19:36.392717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0912f42-6661-4935-90c7-30cf1f6d54d7 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:36.428256 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c4cee-506c-4363-bcd4-a2f3392e63b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:36.428879 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c4cee-506c-4363-bcd4-a2f3392e63b1 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:36.429158 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c4cee-506c-4363-bcd4-a2f3392e63b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:36.429433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c4cee-506c-4363-bcd4-a2f3392e63b1 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:36.430042 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c4cee-506c-4363-bcd4-a2f3392e63b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:36.431449 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c4cee-506c-4363-bcd4-a2f3392e63b1 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:36.437890 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 444/904] 10.222.0.55 () {56 vars in 1087 bytes} [Tue Oct 4 16:19:36 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:19:36.565965 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e2d32-ad88-4c06-9b67-965fbf45d50c None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:36.688138 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e2d32-ad88-4c06-9b67-965fbf45d50c None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:36.722730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb1332-ae0a-419e-ae9e-3448a0ea192e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:36.723403 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb1332-ae0a-419e-ae9e-3448a0ea192e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:36.723679 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb1332-ae0a-419e-ae9e-3448a0ea192e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:36.723947 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb1332-ae0a-419e-ae9e-3448a0ea192e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:36.724529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb1332-ae0a-419e-ae9e-3448a0ea192e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:36.725895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb1332-ae0a-419e-ae9e-3448a0ea192e None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:36.735012 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-7ddb1332-ae0a-419e-ae9e-3448a0ea192e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 16:19:36.735012 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:36.735012 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 16:19:36.735012 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 16:19:36.735012 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 16:19:36.735012 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 16:19:36.735012 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 16:19:36.735012 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:36.735012 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 16:19:36.735012 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:36.735012 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:19:36.735012 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:36.735012 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:36.735012 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:36.735012 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:36.735012 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:36.735957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:36.735957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:36.735957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:36.735957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:36.735957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:36.735957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:36.735957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:36.735957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 16:19:36.735957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 16:19:36.735957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 16:19:36.735957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 16:19:36.735957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:36.735957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:36.735957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:36.735957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:36.735957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:36.735957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:36.736874 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:36.736874 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:36.736874 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:36.736874 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:36.736874 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:36.736874 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:36.736874 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:36.736874 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:36.736874 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:36.736874 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:36.736874 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 16:19:36.736874 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:36.736874 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 16:19:36.736874 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:36.736874 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 461/905] 10.222.0.55 () {56 vars in 1132 bytes} [Tue Oct 4 16:19:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:36.744355 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c4cee-506c-4363-bcd4-a2f3392e63b1 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:36.755553 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:36.856398 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c4cee-506c-4363-bcd4-a2f3392e63b1 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:36.891557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d8e61-e93d-4914-84b7-8f67f61db969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:36.892176 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d8e61-e93d-4914-84b7-8f67f61db969 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:36.892455 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d8e61-e93d-4914-84b7-8f67f61db969 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:36.892730 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d8e61-e93d-4914-84b7-8f67f61db969 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:36.893366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d8e61-e93d-4914-84b7-8f67f61db969 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:36.893666 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d8e61-e93d-4914-84b7-8f67f61db969 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:36.895066 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d8e61-e93d-4914-84b7-8f67f61db969 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:36.900181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 445/906] 10.222.0.55 () {56 vars in 1126 bytes} [Tue Oct 4 16:19:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:36.905798 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb1332-ae0a-419e-ae9e-3448a0ea192e None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:36.927769 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:37.013801 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb1332-ae0a-419e-ae9e-3448a0ea192e None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:37.054864 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5d908-1694-49b8-a785-b099f73e1015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:37.055867 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5d908-1694-49b8-a785-b099f73e1015 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:37.056373 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5d908-1694-49b8-a785-b099f73e1015 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:37.056852 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5d908-1694-49b8-a785-b099f73e1015 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:37.057798 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5d908-1694-49b8-a785-b099f73e1015 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:37.058521 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5d908-1694-49b8-a785-b099f73e1015 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:37.060226 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5d908-1694-49b8-a785-b099f73e1015 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:37.066409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 462/907] 10.222.0.55 () {56 vars in 1126 bytes} [Tue Oct 4 16:19:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:37.072099 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d8e61-e93d-4914-84b7-8f67f61db969 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:37.144582 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:37.183220 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d8e61-e93d-4914-84b7-8f67f61db969 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:37.218855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bca83b-6e4c-4703-ad38-b721ebc3399a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:37.219512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bca83b-6e4c-4703-ad38-b721ebc3399a None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:37.219788 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bca83b-6e4c-4703-ad38-b721ebc3399a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:37.220062 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bca83b-6e4c-4703-ad38-b721ebc3399a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:37.221411 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bca83b-6e4c-4703-ad38-b721ebc3399a None admin] RBAC: Adding query filter params (interface=public, service_id=c03c7e8ab1da4d359b1cf34271064101, region_id=RegionOne) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:37.221411 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bca83b-6e4c-4703-ad38-b721ebc3399a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:37.222474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bca83b-6e4c-4703-ad38-b721ebc3399a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:37.228399 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 446/908] 10.222.0.55 () {56 vars in 1251 bytes} [Tue Oct 4 16:19:37 2022] GET /identity/v3/endpoints?service_id=c03c7e8ab1da4d359b1cf34271064101&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:37.234340 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5d908-1694-49b8-a785-b099f73e1015 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:37.339356 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:37.350094 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5d908-1694-49b8-a785-b099f73e1015 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:37.389309 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9fe39-fda2-46f8-b5e2-3ba6883b98bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:37.389933 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9fe39-fda2-46f8-b5e2-3ba6883b98bc None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:37.390209 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9fe39-fda2-46f8-b5e2-3ba6883b98bc None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:37.390475 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9fe39-fda2-46f8-b5e2-3ba6883b98bc None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:37.391112 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9fe39-fda2-46f8-b5e2-3ba6883b98bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:37.392562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9fe39-fda2-46f8-b5e2-3ba6883b98bc None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:37.399152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 463/909] 10.222.0.55 () {56 vars in 1087 bytes} [Tue Oct 4 16:19:37 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:19:37.598536 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbd52a-f21a-436c-aec4-e3ad731e6ae8 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:37.598903 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbd52a-f21a-436c-aec4-e3ad731e6ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:37.599320 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbd52a-f21a-436c-aec4-e3ad731e6ae8 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:37.602406 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 447/910] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:37.606944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536c366-4281-4bf9-85e8-36b98b40b631 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:37.607441 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536c366-4281-4bf9-85e8-36b98b40b631 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:37.607817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536c366-4281-4bf9-85e8-36b98b40b631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:37.632740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-c536c366-4281-4bf9-85e8-36b98b40b631 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:37.633962 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-c536c366-4281-4bf9-85e8-36b98b40b631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:37.717791 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 464/911] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:37 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:19:37.944544 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558918b-93bb-4a68-a7bc-f8fedce80000 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:37.945980 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558918b-93bb-4a68-a7bc-f8fedce80000 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:37.946783 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558918b-93bb-4a68-a7bc-f8fedce80000 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:37.950007 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 448/912] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:37.955221 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d1e79-956a-436a-8f8c-83ca13cbf279 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:37.955507 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d1e79-956a-436a-8f8c-83ca13cbf279 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:37.955778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d1e79-956a-436a-8f8c-83ca13cbf279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:37.974587 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-de0d1e79-956a-436a-8f8c-83ca13cbf279 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:37.975824 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-de0d1e79-956a-436a-8f8c-83ca13cbf279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:37.984787 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558918b-93bb-4a68-a7bc-f8fedce80000 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:38.063047 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:38.070335 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 465/913] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:37 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:19:38.113933 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558918b-93bb-4a68-a7bc-f8fedce80000 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:38.149702 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e56f55-79dc-4517-a9aa-a205a5ff82ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:38.150368 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e56f55-79dc-4517-a9aa-a205a5ff82ab None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:38.150649 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e56f55-79dc-4517-a9aa-a205a5ff82ab None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:38.150921 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e56f55-79dc-4517-a9aa-a205a5ff82ab None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:38.151677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e56f55-79dc-4517-a9aa-a205a5ff82ab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:38.153060 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e56f55-79dc-4517-a9aa-a205a5ff82ab None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:38.156509 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:38.172880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 449/914] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Oct 4 16:19:37 2022] POST /identity/v3/services => generated 241 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:19:38.492100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d1e79-956a-436a-8f8c-83ca13cbf279 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:38.600290 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d1e79-956a-436a-8f8c-83ca13cbf279 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:38.645819 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c310e-75aa-4746-9c45-ade1253f9ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:38.646463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c310e-75aa-4746-9c45-ade1253f9ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:38.646738 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c310e-75aa-4746-9c45-ade1253f9ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:38.647145 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c310e-75aa-4746-9c45-ade1253f9ba4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:38.664590 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c310e-75aa-4746-9c45-ade1253f9ba4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:19:38.670187 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-3d3c310e-75aa-4746-9c45-ade1253f9ba4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 16:19:38.670187 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:38.670187 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:38.670187 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:38.670187 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:38.670187 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:38.670187 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:38.670187 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:38.670187 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:38.670187 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:38.670187 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:38.670187 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:38.670187 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:19:38.670187 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:19:38.670187 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:19:38.670187 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:19:38.671184 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:19:38.671184 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:19:38.671184 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:19:38.671184 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:19:38.671184 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:38.671184 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:38.671184 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:38.671184 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:38.671184 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:38.671184 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:38.671184 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:38.671184 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:38.671184 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:38.671184 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:38.671184 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:38.671184 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:38.672038 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:38.672038 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:38.672038 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:38.672038 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:38.672038 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:19:38.672038 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:19:38.672038 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:19:38.672038 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:19:38.672038 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:19:38.672038 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:19:38.672038 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 16:19:38.672038 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:38.672038 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 466/915] 10.222.0.55 () {56 vars in 1120 bytes} [Tue Oct 4 16:19:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:38.677771 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e56f55-79dc-4517-a9aa-a205a5ff82ab None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:38.721191 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5b445-0b08-4d69-9678-2b650d79ee4e None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:38.722053 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5b445-0b08-4d69-9678-2b650d79ee4e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:38.722333 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5b445-0b08-4d69-9678-2b650d79ee4e None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:38.727872 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 467/916] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:19:38.729620 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d76761-0fe1-4535-895e-9104cb3147f6 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:38.729858 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d76761-0fe1-4535-895e-9104cb3147f6 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:38.730132 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d76761-0fe1-4535-895e-9104cb3147f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:38.748386 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-26d76761-0fe1-4535-895e-9104cb3147f6 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:38.749495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-26d76761-0fe1-4535-895e-9104cb3147f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:38.791553 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e56f55-79dc-4517-a9aa-a205a5ff82ab None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:38.812357 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:38.831600 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d2d4b-157e-4ca6-a4d7-2af318a799d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:38.832220 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d2d4b-157e-4ca6-a4d7-2af318a799d0 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:38.832492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d2d4b-157e-4ca6-a4d7-2af318a799d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:38.832757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d2d4b-157e-4ca6-a4d7-2af318a799d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:38.833474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d2d4b-157e-4ca6-a4d7-2af318a799d0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:38.833772 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d2d4b-157e-4ca6-a4d7-2af318a799d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:38.834491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 468/917] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 16:19:38.839832 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d2d4b-157e-4ca6-a4d7-2af318a799d0 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:38.849415 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 450/918] 10.222.0.55 () {56 vars in 1115 bytes} [Tue Oct 4 16:19:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:38.856166 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d76761-0fe1-4535-895e-9104cb3147f6 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:38.959114 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d76761-0fe1-4535-895e-9104cb3147f6 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:38.999285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55c0d1-7e67-4021-a556-f1940536fa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:38.999847 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55c0d1-7e67-4021-a556-f1940536fa34 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:39.000125 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55c0d1-7e67-4021-a556-f1940536fa34 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:39.000395 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55c0d1-7e67-4021-a556-f1940536fa34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:39.011773 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55c0d1-7e67-4021-a556-f1940536fa34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:39.013528 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55c0d1-7e67-4021-a556-f1940536fa34 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:39.029661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-dd55c0d1-7e67-4021-a556-f1940536fa34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:39.029661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:39.029661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:39.029661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:39.029661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:39.029661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:39.029661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:39.029661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:39.029661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:39.029661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:39.029661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:39.029661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:39.029661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:39.029661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:39.029661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:39.029661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:39.030664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:39.030664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:39.030664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:39.030664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:39.030664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:39.030664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:39.030664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:39.030664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:39.030664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:39.030664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:39.030664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:39.030664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:39.030664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:39.030664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:39.030664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:39.030664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:39.030664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:39.031619 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:39.031619 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:39.031619 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:39.033533 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 469/919] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:39.039220 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d2d4b-157e-4ca6-a4d7-2af318a799d0 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:39.101872 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:39.112740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55c0d1-7e67-4021-a556-f1940536fa34 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:39.159370 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:39.172960 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d2d4b-157e-4ca6-a4d7-2af318a799d0 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:39.212105 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cde977-8d85-4a27-ad4a-e3c68c767bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:39.212731 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cde977-8d85-4a27-ad4a-e3c68c767bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:39.213013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cde977-8d85-4a27-ad4a-e3c68c767bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:39.213286 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cde977-8d85-4a27-ad4a-e3c68c767bd9 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:39.214412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cde977-8d85-4a27-ad4a-e3c68c767bd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:39.214412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cde977-8d85-4a27-ad4a-e3c68c767bd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:39.215814 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cde977-8d85-4a27-ad4a-e3c68c767bd9 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:39.227417 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55c0d1-7e67-4021-a556-f1940536fa34 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:39.229773 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 451/920] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:39.235192 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cde977-8d85-4a27-ad4a-e3c68c767bd9 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:39.264357 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a259bf-6b83-49f3-947d-4dd7bce70251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:39.265251 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a259bf-6b83-49f3-947d-4dd7bce70251 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:39.265704 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a259bf-6b83-49f3-947d-4dd7bce70251 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:39.266149 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a259bf-6b83-49f3-947d-4dd7bce70251 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:39.266891 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a259bf-6b83-49f3-947d-4dd7bce70251 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:39.268519 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a259bf-6b83-49f3-947d-4dd7bce70251 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:39.277990 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-d2a259bf-6b83-49f3-947d-4dd7bce70251 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 16:19:39.277990 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:39.277990 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 16:19:39.277990 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 16:19:39.277990 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 16:19:39.277990 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 16:19:39.277990 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 16:19:39.277990 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:39.277990 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 16:19:39.277990 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:39.277990 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:19:39.277990 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:39.277990 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:39.277990 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:39.277990 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:39.277990 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:39.277990 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:39.279065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:39.279065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:39.279065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:39.279065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:39.279065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:39.279065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:39.279065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 16:19:39.279065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 16:19:39.279065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 16:19:39.279065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 16:19:39.279065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:39.279065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:39.279065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:39.279065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:39.279065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:39.279065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:39.280027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:39.280027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:39.280027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:39.280027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:39.280027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:39.280027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:39.280027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:39.280027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:39.280027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:39.280027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:39.280027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 16:19:39.280027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:39.280027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 16:19:39.280027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:39.287526 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 470/921] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Oct 4 16:19:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:39.289121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a259bf-6b83-49f3-947d-4dd7bce70251 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:39.345604 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cde977-8d85-4a27-ad4a-e3c68c767bd9 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:39.369935 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:39.398185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36181e03-634b-4641-a635-81512cbede0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:39.398883 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36181e03-634b-4641-a635-81512cbede0f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:39.399193 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36181e03-634b-4641-a635-81512cbede0f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:39.399474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36181e03-634b-4641-a635-81512cbede0f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:39.400097 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a259bf-6b83-49f3-947d-4dd7bce70251 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:39.402108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:39.410029 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36181e03-634b-4641-a635-81512cbede0f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:39.412206 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36181e03-634b-4641-a635-81512cbede0f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:39.431249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-36181e03-634b-4641-a635-81512cbede0f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 16:19:39.431249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:39.431249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:39.431249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:39.431249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:39.431249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:39.431249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:39.431249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:39.431249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:39.431249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:39.431249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:39.431249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:39.431249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:19:39.431249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:19:39.431249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:19:39.431249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:19:39.432262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:39.432262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:39.432262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:19:39.432262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:39.432262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:19:39.432262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:39.432262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:39.432262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:39.432262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:39.432262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:39.432262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:39.432262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:39.432262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:39.432262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:39.432262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:39.432262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:39.432262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:39.432262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:39.433283 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:39.433283 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:39.433283 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:19:39.433283 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:19:39.433283 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:19:39.433283 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:19:39.433283 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:19:39.433283 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:19:39.433283 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 16:19:39.433283 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:39.435133 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 452/922] 10.222.0.55 () {56 vars in 1117 bytes} [Tue Oct 4 16:19:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:19:39.438387 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36181e03-634b-4641-a635-81512cbede0f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:39.454626 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e27a8-9304-48ca-8b55-214373172c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:39.456169 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e27a8-9304-48ca-8b55-214373172c40 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:39.456944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e27a8-9304-48ca-8b55-214373172c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:39.457731 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e27a8-9304-48ca-8b55-214373172c40 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:39.459201 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e27a8-9304-48ca-8b55-214373172c40 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:39.460040 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e27a8-9304-48ca-8b55-214373172c40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:39.462807 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e27a8-9304-48ca-8b55-214373172c40 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:39.472650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 471/923] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Oct 4 16:19:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:39.478959 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e27a8-9304-48ca-8b55-214373172c40 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:39.559289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36181e03-634b-4641-a635-81512cbede0f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:39.599485 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e27a8-9304-48ca-8b55-214373172c40 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:39.612971 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ca7b8-7b6e-4f8a-9209-d2bd304abeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:39.613925 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ca7b8-7b6e-4f8a-9209-d2bd304abeea None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:39.614541 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ca7b8-7b6e-4f8a-9209-d2bd304abeea None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:39.614955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ca7b8-7b6e-4f8a-9209-d2bd304abeea None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:39.616420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ca7b8-7b6e-4f8a-9209-d2bd304abeea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:39.616983 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ca7b8-7b6e-4f8a-9209-d2bd304abeea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:39.619206 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ca7b8-7b6e-4f8a-9209-d2bd304abeea None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:39.638826 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b24761-4d00-45cb-985b-160277fdd4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:39.639710 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b24761-4d00-45cb-985b-160277fdd4fa None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:39.640074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b24761-4d00-45cb-985b-160277fdd4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:39.640436 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b24761-4d00-45cb-985b-160277fdd4fa None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:39.641162 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b24761-4d00-45cb-985b-160277fdd4fa None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:39.641563 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b24761-4d00-45cb-985b-160277fdd4fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:39.647157 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b24761-4d00-45cb-985b-160277fdd4fa None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:39.647954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 453/924] 10.222.0.55 () {56 vars in 1149 bytes} [Tue Oct 4 16:19:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:39.649619 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ca7b8-7b6e-4f8a-9209-d2bd304abeea None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:39.656882 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 472/925] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Oct 4 16:19:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:39.658335 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b24761-4d00-45cb-985b-160277fdd4fa None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:39.691615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:39.699361 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:39.777757 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b24761-4d00-45cb-985b-160277fdd4fa None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:39.815780 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d9845-aa0b-4064-ba52-4ec97ea684f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:39.816409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d9845-aa0b-4064-ba52-4ec97ea684f8 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:39.816774 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d9845-aa0b-4064-ba52-4ec97ea684f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:39.817140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d9845-aa0b-4064-ba52-4ec97ea684f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:39.817901 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d9845-aa0b-4064-ba52-4ec97ea684f8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:39.819481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d9845-aa0b-4064-ba52-4ec97ea684f8 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:39.833408 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ca7b8-7b6e-4f8a-9209-d2bd304abeea None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:39.850182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 473/926] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:19:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:19:39.853765 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f222d-2302-4a86-9244-bd07b46e835c None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:39.854099 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f222d-2302-4a86-9244-bd07b46e835c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:39.854493 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f222d-2302-4a86-9244-bd07b46e835c None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:39.856222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 474/927] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:19:39.862230 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f02efe-f4d0-4dd7-b67e-d0ec1fc7b64f None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:39.862744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f02efe-f4d0-4dd7-b67e-d0ec1fc7b64f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:39.863217 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f02efe-f4d0-4dd7-b67e-d0ec1fc7b64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:39.894650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-d5f02efe-f4d0-4dd7-b67e-d0ec1fc7b64f None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:39.896816 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-d5f02efe-f4d0-4dd7-b67e-d0ec1fc7b64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:39.897504 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4097e12-8c07-49d8-9dd9-61cf5a847662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:39.898404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4097e12-8c07-49d8-9dd9-61cf5a847662 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:39.898824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4097e12-8c07-49d8-9dd9-61cf5a847662 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:39.899298 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4097e12-8c07-49d8-9dd9-61cf5a847662 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:39.917349 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4097e12-8c07-49d8-9dd9-61cf5a847662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:39.919808 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4097e12-8c07-49d8-9dd9-61cf5a847662 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:39.943138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-d4097e12-8c07-49d8-9dd9-61cf5a847662 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:39.943138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:39.943138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:39.943138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:39.943138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:39.943138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:39.943138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:39.943138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:39.943138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:39.943138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:39.943138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:39.943138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:39.943138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:39.943138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:39.943138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:39.943138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:39.944240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:39.944240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:39.944240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:39.944240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:39.944240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:39.944240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:39.944240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:39.944240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:39.944240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:39.944240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:39.944240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:39.944240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:39.944240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:39.944240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:39.944240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:39.944240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:39.944240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:39.945189 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:39.945189 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:39.945189 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:39.949560 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 454/928] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:39.950618 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4097e12-8c07-49d8-9dd9-61cf5a847662 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:40.004815 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 475/929] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 16:19:40.065693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:40.086597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4097e12-8c07-49d8-9dd9-61cf5a847662 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:40.122463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e79c9-9b56-492f-9581-42b2e0abdeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:40.123123 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e79c9-9b56-492f-9581-42b2e0abdeee None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:40.123414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e79c9-9b56-492f-9581-42b2e0abdeee None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:40.123663 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e79c9-9b56-492f-9581-42b2e0abdeee None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:40.124319 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e79c9-9b56-492f-9581-42b2e0abdeee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:40.124614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e79c9-9b56-492f-9581-42b2e0abdeee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:40.126059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e79c9-9b56-492f-9581-42b2e0abdeee None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:40.139752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 455/930] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:40.145832 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f02efe-f4d0-4dd7-b67e-d0ec1fc7b64f None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:40.165899 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:40.258509 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f02efe-f4d0-4dd7-b67e-d0ec1fc7b64f None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:40.292475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e79c9-9b56-492f-9581-42b2e0abdeee None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:40.300600 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac03dd5-d5c9-4884-a6fd-08a2aab35768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:40.301578 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac03dd5-d5c9-4884-a6fd-08a2aab35768 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:40.302055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac03dd5-d5c9-4884-a6fd-08a2aab35768 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:40.302547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac03dd5-d5c9-4884-a6fd-08a2aab35768 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:40.310243 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac03dd5-d5c9-4884-a6fd-08a2aab35768 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:40.312083 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac03dd5-d5c9-4884-a6fd-08a2aab35768 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:40.325060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-dac03dd5-d5c9-4884-a6fd-08a2aab35768 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:40.325060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:40.325060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:40.325060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:40.325060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:40.325060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:40.325060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:40.325060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:40.325060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:40.325060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:40.325060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:40.325060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:40.325060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:19:40.325060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:19:40.325060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:19:40.326029 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:19:40.326029 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:40.326029 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:40.326029 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:40.326029 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:40.326029 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:40.326029 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:40.326029 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:40.326029 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:40.326029 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:40.326029 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:40.326029 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:40.326029 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:40.326029 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:40.326029 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:40.326029 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:40.326029 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:40.326974 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:19:40.326974 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:19:40.326974 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:19:40.326974 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:19:40.326974 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:19:40.326974 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:19:40.326974 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:40.326974 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:40.329469 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 476/931] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:19:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:40.335864 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac03dd5-d5c9-4884-a6fd-08a2aab35768 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:40.410837 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e79c9-9b56-492f-9581-42b2e0abdeee None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:40.428232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:40.453728 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba01fd-c9b2-469a-9427-95c6252e4866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:40.454668 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba01fd-c9b2-469a-9427-95c6252e4866 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:40.455108 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba01fd-c9b2-469a-9427-95c6252e4866 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:40.455660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba01fd-c9b2-469a-9427-95c6252e4866 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:40.456387 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba01fd-c9b2-469a-9427-95c6252e4866 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:40.456564 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac03dd5-d5c9-4884-a6fd-08a2aab35768 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:40.458135 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba01fd-c9b2-469a-9427-95c6252e4866 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:40.468662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-afba01fd-c9b2-469a-9427-95c6252e4866 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 16:19:40.468662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:40.468662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 16:19:40.468662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 16:19:40.468662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 16:19:40.468662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 16:19:40.468662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 16:19:40.468662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:40.468662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 16:19:40.468662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:40.468662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:19:40.468662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:40.468662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:40.468662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:40.468662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:40.468662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:40.469695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:40.469695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:40.469695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:40.469695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:40.469695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:40.469695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:40.469695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:40.469695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 16:19:40.469695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 16:19:40.469695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 16:19:40.469695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 16:19:40.469695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:40.469695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:40.469695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:40.469695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:40.469695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:40.469695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:40.470595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:40.470595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:40.470595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:40.470595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:40.470595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:40.470595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:40.470595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:40.470595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:40.470595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:40.470595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:40.470595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 16:19:40.470595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:40.470595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 16:19:40.470595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:40.477888 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 456/932] 10.222.0.55 () {56 vars in 1132 bytes} [Tue Oct 4 16:19:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:40.479084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba01fd-c9b2-469a-9427-95c6252e4866 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:40.492074 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:40.498676 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edeea06-33d2-480b-99ce-e36165ad941e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:40.499779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeea06-33d2-480b-99ce-e36165ad941e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:40.500273 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeea06-33d2-480b-99ce-e36165ad941e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:40.500825 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeea06-33d2-480b-99ce-e36165ad941e None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:40.501750 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edeea06-33d2-480b-99ce-e36165ad941e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:40.502270 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edeea06-33d2-480b-99ce-e36165ad941e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:40.504199 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edeea06-33d2-480b-99ce-e36165ad941e None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:40.518635 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 477/933] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:19:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:19:40.520242 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824973d-d6f6-488a-91c9-5fb7908afbe2 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:40.520736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824973d-d6f6-488a-91c9-5fb7908afbe2 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:40.521229 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824973d-d6f6-488a-91c9-5fb7908afbe2 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:40.522657 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 478/934] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:40.524516 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824973d-d6f6-488a-91c9-5fb7908afbe2 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:40.600407 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba01fd-c9b2-469a-9427-95c6252e4866 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:40.638146 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f237fe-dd2e-4b96-b449-ca469aab8970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:40.638368 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824973d-d6f6-488a-91c9-5fb7908afbe2 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:40.638772 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f237fe-dd2e-4b96-b449-ca469aab8970 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:40.639076 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f237fe-dd2e-4b96-b449-ca469aab8970 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:40.639350 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f237fe-dd2e-4b96-b449-ca469aab8970 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:40.640021 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f237fe-dd2e-4b96-b449-ca469aab8970 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:40.640321 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f237fe-dd2e-4b96-b449-ca469aab8970 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:40.641716 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f237fe-dd2e-4b96-b449-ca469aab8970 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:40.647038 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 457/935] 10.222.0.55 () {56 vars in 1126 bytes} [Tue Oct 4 16:19:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:40.648172 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509ba83-281f-40ad-9aba-d587525b816e None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:40.648457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509ba83-281f-40ad-9aba-d587525b816e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:40.648729 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509ba83-281f-40ad-9aba-d587525b816e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:40.673365 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-2509ba83-281f-40ad-9aba-d587525b816e None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:40.674448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-2509ba83-281f-40ad-9aba-d587525b816e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:40.693110 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c91f77-37c0-410a-a047-576fb566d635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:40.693800 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c91f77-37c0-410a-a047-576fb566d635 None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:40.694077 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c91f77-37c0-410a-a047-576fb566d635 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:40.694348 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c91f77-37c0-410a-a047-576fb566d635 None admin] PATH_INFO: `/v3/projects/e480e782c4fa403a913ca7179db0843b/users/05cfc9d62a244701a5df524d1c26f107/roles/b557a16f80704a549ace1ef1a84f3086` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:40.696983 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c91f77-37c0-410a-a047-576fb566d635 None admin] RBAC: Authorizing `identity:create_grant(project_id=e480e782c4fa403a913ca7179db0843b, user_id=05cfc9d62a244701a5df524d1c26f107, role_id=b557a16f80704a549ace1ef1a84f3086)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:40.698673 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c91f77-37c0-410a-a047-576fb566d635 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:40.703791 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:40.717241 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 479/936] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Oct 4 16:19:40 2022] PUT /identity/v3/projects/e480e782c4fa403a913ca7179db0843b/users/05cfc9d62a244701a5df524d1c26f107/roles/b557a16f80704a549ace1ef1a84f3086 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:19:40.718084 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c91f77-37c0-410a-a047-576fb566d635 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:40.755535 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:40.763768 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 458/937] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:19:40.869599 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c91f77-37c0-410a-a047-576fb566d635 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:40.908809 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795beb5-8e00-4fa1-9547-4418ebe7196b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:40.909441 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795beb5-8e00-4fa1-9547-4418ebe7196b None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:40.909714 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795beb5-8e00-4fa1-9547-4418ebe7196b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:40.909976 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795beb5-8e00-4fa1-9547-4418ebe7196b None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:40.910613 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795beb5-8e00-4fa1-9547-4418ebe7196b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:40.910907 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795beb5-8e00-4fa1-9547-4418ebe7196b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:40.912331 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795beb5-8e00-4fa1-9547-4418ebe7196b None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:40.918310 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 480/938] 10.222.0.55 () {56 vars in 1126 bytes} [Tue Oct 4 16:19:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:40.928513 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509ba83-281f-40ad-9aba-d587525b816e None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:41.031971 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509ba83-281f-40ad-9aba-d587525b816e None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:41.048109 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795beb5-8e00-4fa1-9547-4418ebe7196b None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:41.069758 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c249b9-ba3f-4e8a-b390-5637038171d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:41.070379 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c249b9-ba3f-4e8a-b390-5637038171d7 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:41.070660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c249b9-ba3f-4e8a-b390-5637038171d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:41.070929 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c249b9-ba3f-4e8a-b390-5637038171d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:41.071640 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c249b9-ba3f-4e8a-b390-5637038171d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:41.073361 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c249b9-ba3f-4e8a-b390-5637038171d7 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:41.100055 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 459/939] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:19:40 2022] POST /identity/v3/endpoints => generated 347 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:19:41.115702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:41.163760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795beb5-8e00-4fa1-9547-4418ebe7196b None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:41.210215 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff739ef9-f1a0-4ef2-bf92-f6241cbfa73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:41.210790 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff739ef9-f1a0-4ef2-bf92-f6241cbfa73c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:41.211095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff739ef9-f1a0-4ef2-bf92-f6241cbfa73c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:41.211363 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff739ef9-f1a0-4ef2-bf92-f6241cbfa73c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:41.211965 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff739ef9-f1a0-4ef2-bf92-f6241cbfa73c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:41.213385 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff739ef9-f1a0-4ef2-bf92-f6241cbfa73c None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:41.223677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-ff739ef9-f1a0-4ef2-bf92-f6241cbfa73c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 16:19:41.223677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:41.223677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 16:19:41.223677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 16:19:41.223677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 16:19:41.223677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 16:19:41.223677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 16:19:41.223677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:41.223677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 16:19:41.223677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:41.223677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:19:41.223677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:41.223677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:41.223677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:41.223677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:41.223677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:41.223677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:41.226177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:41.226177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:41.226177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:41.226177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:41.226177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:41.226177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:41.226177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 16:19:41.226177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 16:19:41.226177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 16:19:41.226177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 16:19:41.226177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:41.226177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:41.226177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:41.226177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:41.226177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:41.226177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:41.228208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:41.228208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:41.228208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:41.228208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:41.228208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:41.228208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:41.228208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:41.228208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:41.228208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:41.228208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:41.228208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 16:19:41.228208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:41.228208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 16:19:41.228208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:41.228208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 481/940] 10.222.0.55 () {56 vars in 1126 bytes} [Tue Oct 4 16:19:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:41.231650 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c249b9-ba3f-4e8a-b390-5637038171d7 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:41.307231 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:41.356009 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c249b9-ba3f-4e8a-b390-5637038171d7 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:41.392709 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82ecb7-3313-4953-b84d-7ebe6a8ceef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:41.393335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82ecb7-3313-4953-b84d-7ebe6a8ceef6 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:41.393608 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82ecb7-3313-4953-b84d-7ebe6a8ceef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:41.393875 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82ecb7-3313-4953-b84d-7ebe6a8ceef6 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:41.394516 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82ecb7-3313-4953-b84d-7ebe6a8ceef6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:41.394813 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82ecb7-3313-4953-b84d-7ebe6a8ceef6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:41.396208 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82ecb7-3313-4953-b84d-7ebe6a8ceef6 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:41.401591 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 460/941] 10.222.0.55 () {56 vars in 1122 bytes} [Tue Oct 4 16:19:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:41.407243 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff739ef9-f1a0-4ef2-bf92-f6241cbfa73c None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:41.510054 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff739ef9-f1a0-4ef2-bf92-f6241cbfa73c None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:41.531772 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:41.547371 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4697f-e263-4a26-9a9e-5226666c3646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:41.548619 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4697f-e263-4a26-9a9e-5226666c3646 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:41.548891 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4697f-e263-4a26-9a9e-5226666c3646 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:41.549159 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4697f-e263-4a26-9a9e-5226666c3646 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:41.549799 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4697f-e263-4a26-9a9e-5226666c3646 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:41.550101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4697f-e263-4a26-9a9e-5226666c3646 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:41.551511 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4697f-e263-4a26-9a9e-5226666c3646 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:41.557449 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 482/942] 10.222.0.55 () {56 vars in 1122 bytes} [Tue Oct 4 16:19:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:41.563468 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82ecb7-3313-4953-b84d-7ebe6a8ceef6 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:41.671666 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82ecb7-3313-4953-b84d-7ebe6a8ceef6 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:41.695584 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:41.724311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9dac6-0bf1-4545-be88-81ae08cba986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:41.724943 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9dac6-0bf1-4545-be88-81ae08cba986 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:41.725222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9dac6-0bf1-4545-be88-81ae08cba986 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:41.725495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9dac6-0bf1-4545-be88-81ae08cba986 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:41.726217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9dac6-0bf1-4545-be88-81ae08cba986 None admin] RBAC: Adding query filter params (interface=public, service_id=a2430f3a084e4808b311ad4c073e4a35, region_id=RegionOne) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:41.726528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9dac6-0bf1-4545-be88-81ae08cba986 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:41.727958 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9dac6-0bf1-4545-be88-81ae08cba986 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:41.734356 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 461/943] 10.222.0.55 () {56 vars in 1251 bytes} [Tue Oct 4 16:19:41 2022] GET /identity/v3/endpoints?service_id=a2430f3a084e4808b311ad4c073e4a35&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:41.740306 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4697f-e263-4a26-9a9e-5226666c3646 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:41.843760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4697f-e263-4a26-9a9e-5226666c3646 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:41.878736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf32105-14ed-4e2c-a5e9-d1a147aa0d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:41.879388 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf32105-14ed-4e2c-a5e9-d1a147aa0d06 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:41.879665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf32105-14ed-4e2c-a5e9-d1a147aa0d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:41.879934 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf32105-14ed-4e2c-a5e9-d1a147aa0d06 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:41.880544 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf32105-14ed-4e2c-a5e9-d1a147aa0d06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:41.881913 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf32105-14ed-4e2c-a5e9-d1a147aa0d06 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:41.888534 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 483/944] 10.222.0.55 () {56 vars in 1087 bytes} [Tue Oct 4 16:19:41 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:19:42.225412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb8ee6-aaa7-41e5-958b-7cdbb1d9ed05 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:42.225915 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb8ee6-aaa7-41e5-958b-7cdbb1d9ed05 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:42.225915 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb8ee6-aaa7-41e5-958b-7cdbb1d9ed05 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:42.227460 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 462/945] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:42.233174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309704f1-1c5a-4518-aab6-b2dc0acb0a65 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:42.233596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309704f1-1c5a-4518-aab6-b2dc0acb0a65 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:42.233789 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309704f1-1c5a-4518-aab6-b2dc0acb0a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:42.252600 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-309704f1-1c5a-4518-aab6-b2dc0acb0a65 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:42.254494 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-309704f1-1c5a-4518-aab6-b2dc0acb0a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:42.300048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:42.324005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 484/946] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 16:19:42.590783 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb8ee6-aaa7-41e5-958b-7cdbb1d9ed05 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:42.700278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb8ee6-aaa7-41e5-958b-7cdbb1d9ed05 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:42.736541 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50093b-d030-4a12-b879-f3092d85e885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:42.737164 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50093b-d030-4a12-b879-f3092d85e885 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:42.737441 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50093b-d030-4a12-b879-f3092d85e885 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:42.737711 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50093b-d030-4a12-b879-f3092d85e885 None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:42.738380 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50093b-d030-4a12-b879-f3092d85e885 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:42.739854 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50093b-d030-4a12-b879-f3092d85e885 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:42.742530 dv-cinder-749155-14-smb devstack@keystone.service[81561]: WARNING keystone.server.flask.common [None req-9c50093b-d030-4a12-b879-f3092d85e885 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 04 16:19:42.761794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.sql.core [None req-9c50093b-d030-4a12-b879-f3092d85e885 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 16:19:42.761794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 04 16:19:42.761794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [parameters: {'id': '5ede9ddd38c64a498e6a54d6d8917894', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 04 16:19:42.761794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81561) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 16:19:42.769714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-9c50093b-d030-4a12-b879-f3092d85e885 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5ede9ddd38c64a498e6a54d6d8917894.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5ede9ddd38c64a498e6a54d6d8917894. Oct 04 16:19:42.769714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:42.769714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 16:19:42.769714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 16:19:42.769714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 16:19:42.769714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 16:19:42.769714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 16:19:42.769714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 16:19:42.769714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 16:19:42.769714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application conn.query(q) Oct 04 16:19:42.769714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 16:19:42.769714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 16:19:42.769714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 16:19:42.770572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application result.read() Oct 04 16:19:42.770572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 16:19:42.770572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 16:19:42.770572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 16:19:42.770572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 16:19:42.770572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 16:19:42.770572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 16:19:42.770572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 16:19:42.770572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 16:19:42.770572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 16:19:42.770572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:42.770572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 16:19:42.770572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:42.770572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:42.770572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 16:19:42.770572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 16:19:42.770572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 04 16:19:42.770572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 04 16:19:42.771586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 16:19:42.771586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application next(self.gen) Oct 04 16:19:42.771586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 16:19:42.771586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application yield resource Oct 04 16:19:42.771586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 16:19:42.771586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application next(self.gen) Oct 04 16:19:42.771586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 16:19:42.771586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 16:19:42.771586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 16:19:42.771586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 16:19:42.771586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 16:19:42.771586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise self.value Oct 04 16:19:42.771586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 16:19:42.771586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 16:19:42.771586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 16:19:42.771586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application session.commit() Oct 04 16:19:42.771586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 16:19:42.772489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 16:19:42.772489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 16:19:42.772489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 16:19:42.772489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 16:19:42.772489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self.session.flush() Oct 04 16:19:42.772489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 16:19:42.772489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 16:19:42.772489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 16:19:42.772489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 16:19:42.772489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 16:19:42.772489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application compat.raise_( Oct 04 16:19:42.772489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 16:19:42.772489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception Oct 04 16:19:42.772489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 16:19:42.772489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 16:19:42.772489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 16:19:42.772489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 16:19:42.773412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 16:19:42.773412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 16:19:42.773412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 16:19:42.773412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 16:19:42.773412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 04 16:19:42.773412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 04 16:19:42.773412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 16:19:42.773412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 16:19:42.773412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 16:19:42.773412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 16:19:42.773412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 16:19:42.773412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 16:19:42.773412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 16:19:42.773412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 16:19:42.773412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 16:19:42.774212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 16:19:42.774212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 16:19:42.774212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception Oct 04 16:19:42.774212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 16:19:42.774212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 16:19:42.774212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 16:19:42.774212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 16:19:42.774212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 16:19:42.774212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 16:19:42.774212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 16:19:42.774212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application conn.query(q) Oct 04 16:19:42.774212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 16:19:42.774212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 16:19:42.774212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 16:19:42.774212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application result.read() Oct 04 16:19:42.774212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 16:19:42.774212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 16:19:42.776295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 16:19:42.776295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 16:19:42.776295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 16:19:42.776295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 16:19:42.776295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 16:19:42.776295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 16:19:42.776295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 16:19:42.776295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 04 16:19:42.776295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [parameters: {'id': '5ede9ddd38c64a498e6a54d6d8917894', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 04 16:19:42.776295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 16:19:42.776295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:42.776295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:19:42.776295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:42.776295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:42.776295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 04 16:19:42.778199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 04 16:19:42.778199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 16:19:42.778199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 16:19:42.778199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 04 16:19:42.778199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:42.778199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:19:42.778199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:42.778199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:42.778199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:42.778199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:42.778199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:42.778199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:42.778199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:42.778199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:42.778199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:42.778199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:42.778199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:42.780462 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:42.780462 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 04 16:19:42.780462 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 04 16:19:42.780462 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:42.780462 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:42.780462 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 04 16:19:42.780462 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 04 16:19:42.780462 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5ede9ddd38c64a498e6a54d6d8917894. Oct 04 16:19:42.780462 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:42.780462 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 463/947] 10.222.0.55 () {60 vars in 1140 bytes} [Tue Oct 4 16:19:42 2022] POST /identity/v3/projects => generated 262 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:42.781252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309704f1-1c5a-4518-aab6-b2dc0acb0a65 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:42.899977 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309704f1-1c5a-4518-aab6-b2dc0acb0a65 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:42.936644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc02a9-4cdc-44fa-aadc-aaad242ad25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:42.937295 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc02a9-4cdc-44fa-aadc-aaad242ad25d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:42.937575 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc02a9-4cdc-44fa-aadc-aaad242ad25d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:42.937849 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc02a9-4cdc-44fa-aadc-aaad242ad25d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:42.945349 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc02a9-4cdc-44fa-aadc-aaad242ad25d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:42.946807 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc02a9-4cdc-44fa-aadc-aaad242ad25d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:42.959308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-00bc02a9-4cdc-44fa-aadc-aaad242ad25d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:42.959308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:42.959308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:42.959308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:42.959308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:42.959308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:42.959308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:42.959308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:42.959308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:42.959308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:42.959308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:42.959308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:42.959308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:19:42.959308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:19:42.959308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:19:42.961406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:19:42.961406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:42.961406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:42.961406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:42.961406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:42.961406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:42.961406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:42.961406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:42.961406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:42.961406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:42.961406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:42.961406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:42.961406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:42.961406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:42.961406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:42.961406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:42.961406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:42.963501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:19:42.963501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:19:42.963501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:19:42.963501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:19:42.963501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:19:42.963501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:19:42.963501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:42.963501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:42.966756 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50093b-d030-4a12-b879-f3092d85e885 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:42.976362 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 485/948] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:19:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:43.020405 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:43.078231 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50093b-d030-4a12-b879-f3092d85e885 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:43.115126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ef1bb-c8d9-4d66-ab5d-7956bff35dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:43.116023 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ef1bb-c8d9-4d66-ab5d-7956bff35dec None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:43.116461 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ef1bb-c8d9-4d66-ab5d-7956bff35dec None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:43.116852 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ef1bb-c8d9-4d66-ab5d-7956bff35dec None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:43.117547 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ef1bb-c8d9-4d66-ab5d-7956bff35dec None admin] RBAC: Adding query filter params (name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:43.117854 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ef1bb-c8d9-4d66-ab5d-7956bff35dec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:43.119627 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ef1bb-c8d9-4d66-ab5d-7956bff35dec None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:43.141549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 464/949] 10.222.0.55 () {56 vars in 1112 bytes} [Tue Oct 4 16:19:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:43.343343 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a693056-63de-48aa-9e4d-c8be68601fde None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:43.344337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a693056-63de-48aa-9e4d-c8be68601fde None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:43.344337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a693056-63de-48aa-9e4d-c8be68601fde None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:43.345550 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 486/950] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:43.351171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54232a84-3bf4-4799-bcad-5a158ff698b1 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:43.351936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54232a84-3bf4-4799-bcad-5a158ff698b1 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:43.351936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54232a84-3bf4-4799-bcad-5a158ff698b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:43.370927 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-54232a84-3bf4-4799-bcad-5a158ff698b1 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:43.372719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-54232a84-3bf4-4799-bcad-5a158ff698b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:43.452520 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 465/951] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 16:19:43.525254 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45650a1-a33d-4c99-80f6-29035fe5e05c None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:43.525254 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45650a1-a33d-4c99-80f6-29035fe5e05c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:43.525254 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45650a1-a33d-4c99-80f6-29035fe5e05c None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:43.525254 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 487/952] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:43.531350 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffa8bc-aee1-4c22-bdef-f7e5b8eb8200 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:43.531642 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffa8bc-aee1-4c22-bdef-f7e5b8eb8200 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:43.531921 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffa8bc-aee1-4c22-bdef-f7e5b8eb8200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:43.551381 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-72ffa8bc-aee1-4c22-bdef-f7e5b8eb8200 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:43.552702 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-72ffa8bc-aee1-4c22-bdef-f7e5b8eb8200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:43.578280 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:43.650103 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 466/953] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:19:43.783093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45650a1-a33d-4c99-80f6-29035fe5e05c None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:43.826760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:43.891118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45650a1-a33d-4c99-80f6-29035fe5e05c None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:43.923474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffa8bc-aee1-4c22-bdef-f7e5b8eb8200 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:43.928046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cfdbc-f86b-420c-b386-6df0b6f93049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:43.928707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cfdbc-f86b-420c-b386-6df0b6f93049 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:43.929022 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cfdbc-f86b-420c-b386-6df0b6f93049 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:43.929252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cfdbc-f86b-420c-b386-6df0b6f93049 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:43.943781 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441cfdbc-f86b-420c-b386-6df0b6f93049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:19:43.950035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-441cfdbc-f86b-420c-b386-6df0b6f93049 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 16:19:43.950035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:43.950035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:43.950035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:43.950035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:43.950035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:43.950035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:43.950035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:43.950035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:43.950035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:43.950035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:43.950035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:43.950035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:19:43.950035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:19:43.950035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:19:43.950035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:19:43.951418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:19:43.951418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:19:43.951418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:19:43.951418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:19:43.951418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:43.951418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:43.951418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:43.951418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:43.951418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:43.951418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:43.951418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:43.951418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:43.951418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:43.951418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:43.951418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:43.951418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:43.952369 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:43.952369 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:43.952369 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:43.952369 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:43.952369 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:19:43.952369 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:19:43.952369 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:19:43.952369 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:19:43.952369 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:19:43.952369 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:19:43.952369 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 16:19:43.952369 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:43.952369 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 488/954] 10.222.0.55 () {56 vars in 1120 bytes} [Tue Oct 4 16:19:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:43.957224 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cfdbc-f86b-420c-b386-6df0b6f93049 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:44.057725 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffa8bc-aee1-4c22-bdef-f7e5b8eb8200 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:44.082929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:44.089889 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cfdbc-f86b-420c-b386-6df0b6f93049 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:44.106185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e3271-8ee8-4575-8d7f-604801c5b1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:44.107322 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e3271-8ee8-4575-8d7f-604801c5b1d2 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:44.107813 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e3271-8ee8-4575-8d7f-604801c5b1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:44.108445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e3271-8ee8-4575-8d7f-604801c5b1d2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:44.109932 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e3271-8ee8-4575-8d7f-604801c5b1d2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:44.112126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e3271-8ee8-4575-8d7f-604801c5b1d2 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:44.123492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-6f2e3271-8ee8-4575-8d7f-604801c5b1d2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 16:19:44.123492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:44.123492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 16:19:44.123492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 16:19:44.123492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 16:19:44.123492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 16:19:44.123492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 16:19:44.123492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:44.123492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 16:19:44.123492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:44.123492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:19:44.123492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:44.123492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:44.123492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:44.123492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:44.123492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:44.123492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:44.124769 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:44.124769 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:44.124769 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:44.124769 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:44.124769 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:44.124769 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:44.124769 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 16:19:44.124769 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 16:19:44.124769 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 16:19:44.124769 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 16:19:44.124769 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:44.124769 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:44.124769 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:44.124769 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:44.124769 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:44.124769 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:44.125954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:44.125954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:44.125954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:44.125954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:44.125954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:44.125954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:44.125954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:44.125954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:44.125954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:44.125954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:44.125954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 16:19:44.125954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:44.125954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 16:19:44.125954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:44.125954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 467/955] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:19:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:19:44.133213 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e3271-8ee8-4575-8d7f-604801c5b1d2 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:44.140472 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960cd81-02c0-4305-921e-2c95e4a073cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:44.141489 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960cd81-02c0-4305-921e-2c95e4a073cd None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:44.141984 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960cd81-02c0-4305-921e-2c95e4a073cd None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:44.142474 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960cd81-02c0-4305-921e-2c95e4a073cd None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:44.143408 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960cd81-02c0-4305-921e-2c95e4a073cd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:44.143917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960cd81-02c0-4305-921e-2c95e4a073cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:44.146132 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960cd81-02c0-4305-921e-2c95e4a073cd None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:44.157763 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 489/956] 10.222.0.55 () {56 vars in 1115 bytes} [Tue Oct 4 16:19:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:19:44.163450 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960cd81-02c0-4305-921e-2c95e4a073cd None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:44.170552 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:44.253551 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e3271-8ee8-4575-8d7f-604801c5b1d2 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:44.290799 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b9b91-e568-4198-915a-b1cb66266a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:44.291436 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b9b91-e568-4198-915a-b1cb66266a01 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:44.291751 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b9b91-e568-4198-915a-b1cb66266a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:44.292149 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b9b91-e568-4198-915a-b1cb66266a01 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:44.292787 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b9b91-e568-4198-915a-b1cb66266a01 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:44.293082 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b9b91-e568-4198-915a-b1cb66266a01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:44.293554 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960cd81-02c0-4305-921e-2c95e4a073cd None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:44.294823 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b9b91-e568-4198-915a-b1cb66266a01 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:44.300039 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 468/957] 10.222.0.55 () {56 vars in 1112 bytes} [Tue Oct 4 16:19:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:44.301069 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd9fa1-8b5b-4207-8ddf-cdb71476ab7d None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:44.301347 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd9fa1-8b5b-4207-8ddf-cdb71476ab7d None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:44.301614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd9fa1-8b5b-4207-8ddf-cdb71476ab7d None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:44.302971 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 469/958] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:44.307862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd9fa1-8b5b-4207-8ddf-cdb71476ab7d None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:44.334594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7abaf-d7f7-4007-9a8b-fa74038be943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:44.335280 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7abaf-d7f7-4007-9a8b-fa74038be943 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:44.335538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7abaf-d7f7-4007-9a8b-fa74038be943 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:44.335805 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7abaf-d7f7-4007-9a8b-fa74038be943 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:44.349042 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7abaf-d7f7-4007-9a8b-fa74038be943 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:44.350505 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7abaf-d7f7-4007-9a8b-fa74038be943 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:44.369920 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-10c7abaf-d7f7-4007-9a8b-fa74038be943 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:44.369920 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:44.369920 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:44.369920 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:44.369920 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:44.369920 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:44.369920 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:44.369920 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:44.369920 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:44.369920 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:44.369920 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:44.369920 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:44.369920 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:44.369920 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:44.369920 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:44.369920 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:44.377712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:44.377712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:44.377712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:44.377712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:44.377712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:44.377712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:44.377712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:44.377712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:44.377712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:44.377712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:44.377712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:44.377712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:44.377712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:44.377712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:44.377712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:44.377712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:44.377712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:44.378653 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:44.378653 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:44.378653 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:44.378653 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 490/959] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:44.378653 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0472ca-abb0-4ad3-8bbe-f52b656cf8ed None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:44.378653 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0472ca-abb0-4ad3-8bbe-f52b656cf8ed None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:44.378653 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0472ca-abb0-4ad3-8bbe-f52b656cf8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:44.394697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-7f0472ca-abb0-4ad3-8bbe-f52b656cf8ed None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:44.395943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-7f0472ca-abb0-4ad3-8bbe-f52b656cf8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:44.404465 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:44.415590 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:44.434205 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd9fa1-8b5b-4207-8ddf-cdb71476ab7d None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:44.475655 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a5036-5ebb-4c5f-b25f-07ba324568b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:44.476270 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a5036-5ebb-4c5f-b25f-07ba324568b5 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:44.476543 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a5036-5ebb-4c5f-b25f-07ba324568b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:44.476809 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a5036-5ebb-4c5f-b25f-07ba324568b5 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:44.477238 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 491/960] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:19:44.478222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0472ca-abb0-4ad3-8bbe-f52b656cf8ed None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:44.483257 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a5036-5ebb-4c5f-b25f-07ba324568b5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:44.483735 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a5036-5ebb-4c5f-b25f-07ba324568b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:44.485264 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a5036-5ebb-4c5f-b25f-07ba324568b5 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:44.494328 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 470/961] 10.222.0.55 () {56 vars in 1112 bytes} [Tue Oct 4 16:19:44 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:44.605788 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0472ca-abb0-4ad3-8bbe-f52b656cf8ed None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:44.646926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e32ea-bd12-4a04-b50b-3adda5a1b862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:44.649891 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e32ea-bd12-4a04-b50b-3adda5a1b862 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:44.649891 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e32ea-bd12-4a04-b50b-3adda5a1b862 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:44.649891 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e32ea-bd12-4a04-b50b-3adda5a1b862 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:44.649891 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e32ea-bd12-4a04-b50b-3adda5a1b862 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:44.649891 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e32ea-bd12-4a04-b50b-3adda5a1b862 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:44.650482 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e32ea-bd12-4a04-b50b-3adda5a1b862 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:44.664684 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 492/962] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:44.672208 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a5036-5ebb-4c5f-b25f-07ba324568b5 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:44.775823 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e32ea-bd12-4a04-b50b-3adda5a1b862 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:44.779780 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:44.810058 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a5036-5ebb-4c5f-b25f-07ba324568b5 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:44.876024 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a4170-02b9-4999-9b60-35ae97cea580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:44.877699 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a4170-02b9-4999-9b60-35ae97cea580 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:44.878692 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a4170-02b9-4999-9b60-35ae97cea580 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:44.879677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a4170-02b9-4999-9b60-35ae97cea580 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:44.894575 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a4170-02b9-4999-9b60-35ae97cea580 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:44.897651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a4170-02b9-4999-9b60-35ae97cea580 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:44.923048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-161a4170-02b9-4999-9b60-35ae97cea580 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 16:19:44.923048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:44.923048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:44.923048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:44.923048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:44.923048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:44.923048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:44.923048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:44.923048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:44.923048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:44.923048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:44.923048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:44.923048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:19:44.923048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:19:44.923048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:19:44.923048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:19:44.924255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:44.924255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:44.924255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:19:44.924255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:44.924255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:19:44.924255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:44.924255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:44.924255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:44.924255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:44.924255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:44.924255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:44.924255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:44.924255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:44.924255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:44.924255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:44.924255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:44.924255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:44.924255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:44.925195 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:44.925195 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:44.925195 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:19:44.925195 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:19:44.925195 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:19:44.925195 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:19:44.925195 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:19:44.925195 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:19:44.925195 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 16:19:44.925195 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:44.928604 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 471/963] 10.222.0.55 () {56 vars in 1117 bytes} [Tue Oct 4 16:19:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:44.934111 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a4170-02b9-4999-9b60-35ae97cea580 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:44.945275 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e32ea-bd12-4a04-b50b-3adda5a1b862 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:44.961516 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:44.993067 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a9593-2b1b-4045-92cd-c47bdb35aef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:44.995343 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a9593-2b1b-4045-92cd-c47bdb35aef7 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:44.996605 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a9593-2b1b-4045-92cd-c47bdb35aef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:44.997654 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a9593-2b1b-4045-92cd-c47bdb35aef7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:44.998974 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a9593-2b1b-4045-92cd-c47bdb35aef7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:45.002768 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a9593-2b1b-4045-92cd-c47bdb35aef7 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:45.015155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-398a9593-2b1b-4045-92cd-c47bdb35aef7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 16:19:45.015155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:45.015155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 16:19:45.015155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 16:19:45.015155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 16:19:45.015155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 16:19:45.015155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 16:19:45.015155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:45.015155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 16:19:45.015155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:45.015155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:19:45.015155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:45.015155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:45.015155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:45.015155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:45.015155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:45.015155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:45.016398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:45.016398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:45.016398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:45.016398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:45.016398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:45.016398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:45.016398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 16:19:45.016398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 16:19:45.016398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 16:19:45.016398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 16:19:45.016398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:45.016398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:45.016398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:45.016398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:45.016398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:45.016398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:45.017417 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:45.017417 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:45.017417 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:45.017417 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:45.017417 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:45.017417 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:45.017417 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:45.017417 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:45.017417 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:45.017417 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:45.017417 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 16:19:45.017417 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:45.017417 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 16:19:45.017417 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:45.020379 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 493/964] 10.222.0.55 () {56 vars in 1126 bytes} [Tue Oct 4 16:19:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:19:45.026273 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a9593-2b1b-4045-92cd-c47bdb35aef7 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:45.100180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a4170-02b9-4999-9b60-35ae97cea580 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:45.109944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:45.151610 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fde4f-eab3-400e-8ff6-86685dfb54c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:45.152157 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fde4f-eab3-400e-8ff6-86685dfb54c1 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:45.152433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fde4f-eab3-400e-8ff6-86685dfb54c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:45.152703 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fde4f-eab3-400e-8ff6-86685dfb54c1 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:45.153499 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fde4f-eab3-400e-8ff6-86685dfb54c1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:45.153744 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fde4f-eab3-400e-8ff6-86685dfb54c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:45.155307 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fde4f-eab3-400e-8ff6-86685dfb54c1 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:45.156090 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a9593-2b1b-4045-92cd-c47bdb35aef7 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:45.179458 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 472/965] 10.222.0.55 () {56 vars in 1149 bytes} [Tue Oct 4 16:19:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:19:45.184946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fde4f-eab3-400e-8ff6-86685dfb54c1 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:45.198349 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed860f7-25bd-4988-9b0c-673ab618f5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:45.198745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed860f7-25bd-4988-9b0c-673ab618f5c4 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:45.199049 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed860f7-25bd-4988-9b0c-673ab618f5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:45.199332 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed860f7-25bd-4988-9b0c-673ab618f5c4 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:45.199975 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed860f7-25bd-4988-9b0c-673ab618f5c4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:45.200281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed860f7-25bd-4988-9b0c-673ab618f5c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:45.201669 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed860f7-25bd-4988-9b0c-673ab618f5c4 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:45.207138 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 494/966] 10.222.0.55 () {56 vars in 1122 bytes} [Tue Oct 4 16:19:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:45.212535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed860f7-25bd-4988-9b0c-673ab618f5c4 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:45.288151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:45.318265 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fde4f-eab3-400e-8ff6-86685dfb54c1 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:45.318488 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed860f7-25bd-4988-9b0c-673ab618f5c4 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:45.353431 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:45.364128 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71339e95-a422-4679-9df2-4c4f7b9b0b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:45.365138 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71339e95-a422-4679-9df2-4c4f7b9b0b2f None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:45.365561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71339e95-a422-4679-9df2-4c4f7b9b0b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:45.366061 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71339e95-a422-4679-9df2-4c4f7b9b0b2f None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:45.367023 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71339e95-a422-4679-9df2-4c4f7b9b0b2f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:45.367567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71339e95-a422-4679-9df2-4c4f7b9b0b2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:45.369306 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c972f87-d741-401e-bfd1-e752522458bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:45.369577 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71339e95-a422-4679-9df2-4c4f7b9b0b2f None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:45.370169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c972f87-d741-401e-bfd1-e752522458bc None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:45.370511 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c972f87-d741-401e-bfd1-e752522458bc None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:45.370835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c972f87-d741-401e-bfd1-e752522458bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:45.382800 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 495/967] 10.222.0.55 () {56 vars in 1122 bytes} [Tue Oct 4 16:19:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:45.384324 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71339e95-a422-4679-9df2-4c4f7b9b0b2f None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:45.454964 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c972f87-d741-401e-bfd1-e752522458bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:45.457420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c972f87-d741-401e-bfd1-e752522458bc None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:45.514102 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71339e95-a422-4679-9df2-4c4f7b9b0b2f None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:45.534765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:45.552292 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6836f1-daed-4ca6-aaeb-ce079dc459db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:45.552994 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6836f1-daed-4ca6-aaeb-ce079dc459db None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:45.553340 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6836f1-daed-4ca6-aaeb-ce079dc459db None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:45.553615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6836f1-daed-4ca6-aaeb-ce079dc459db None admin] PATH_INFO: `/v3/endpoints` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:45.554301 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6836f1-daed-4ca6-aaeb-ce079dc459db None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:45.555732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6836f1-daed-4ca6-aaeb-ce079dc459db None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:45.571158 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 473/968] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:19:45 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 16:19:45.572590 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c55cd-c585-4113-8eb9-7fefed4e798e None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:45.573014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c55cd-c585-4113-8eb9-7fefed4e798e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:45.573422 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c55cd-c585-4113-8eb9-7fefed4e798e None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:45.577289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 474/969] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:45.579422 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c55cd-c585-4113-8eb9-7fefed4e798e None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:45.588083 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 496/970] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:19:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:19:45.590298 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1d639-7f72-41b3-adbf-9a79e44e6f97 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:45.590787 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1d639-7f72-41b3-adbf-9a79e44e6f97 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:45.591225 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1d639-7f72-41b3-adbf-9a79e44e6f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:45.619106 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-f9f1d639-7f72-41b3-adbf-9a79e44e6f97 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:45.621967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-f9f1d639-7f72-41b3-adbf-9a79e44e6f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:45.690615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:45.726042 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 497/971] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:19:45.758242 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c55cd-c585-4113-8eb9-7fefed4e798e None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:45.805841 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ab92d-0400-49c7-9542-e7464fb86803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:45.806492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ab92d-0400-49c7-9542-e7464fb86803 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:45.806766 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ab92d-0400-49c7-9542-e7464fb86803 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:45.807065 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ab92d-0400-49c7-9542-e7464fb86803 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:45.819873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ab92d-0400-49c7-9542-e7464fb86803 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:45.821359 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ab92d-0400-49c7-9542-e7464fb86803 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:45.837403 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-676ab92d-0400-49c7-9542-e7464fb86803 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:45.837403 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:45.837403 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:45.837403 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:45.837403 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:45.837403 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:45.837403 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:45.837403 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:45.837403 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:45.837403 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:45.837403 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:45.837403 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:45.837403 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:45.837403 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:45.837403 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:45.837403 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:45.838431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:45.838431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:45.838431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:45.838431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:45.838431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:45.838431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:45.838431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:45.838431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:45.838431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:45.838431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:45.838431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:45.838431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:45.838431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:45.838431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:45.838431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:45.838431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:45.838431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:45.839427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:45.839427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:45.839427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:45.839427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 475/972] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:45.845256 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1d639-7f72-41b3-adbf-9a79e44e6f97 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:45.953868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1d639-7f72-41b3-adbf-9a79e44e6f97 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:45.988765 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cfc1d-4187-4c09-98d9-e2a9ea62763c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:45.989352 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cfc1d-4187-4c09-98d9-e2a9ea62763c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:45.989625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cfc1d-4187-4c09-98d9-e2a9ea62763c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:45.989932 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cfc1d-4187-4c09-98d9-e2a9ea62763c None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:45.990588 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964cfc1d-4187-4c09-98d9-e2a9ea62763c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:45.990885 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964cfc1d-4187-4c09-98d9-e2a9ea62763c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:45.992304 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964cfc1d-4187-4c09-98d9-e2a9ea62763c None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:46.008957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 498/973] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:19:46.014699 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ab92d-0400-49c7-9542-e7464fb86803 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:46.040661 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:46.065634 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cfc1d-4187-4c09-98d9-e2a9ea62763c None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:46.108126 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:46.139074 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ab92d-0400-49c7-9542-e7464fb86803 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:46.187017 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1db47-4109-4d7b-96ec-5bec7eaadf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:46.187925 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1db47-4109-4d7b-96ec-5bec7eaadf9b None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:46.188210 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1db47-4109-4d7b-96ec-5bec7eaadf9b None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:46.188472 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1db47-4109-4d7b-96ec-5bec7eaadf9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:46.195406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cfc1d-4187-4c09-98d9-e2a9ea62763c None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:46.197559 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1db47-4109-4d7b-96ec-5bec7eaadf9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:46.199984 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1db47-4109-4d7b-96ec-5bec7eaadf9b None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:46.218377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-70e1db47-4109-4d7b-96ec-5bec7eaadf9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:46.218377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:46.218377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:46.218377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:46.218377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:46.218377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:46.218377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:46.218377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:46.218377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:46.218377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:46.218377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:46.218377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:46.218377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:19:46.218377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:19:46.218377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:19:46.219414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:19:46.219414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:46.219414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:46.219414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:46.219414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:46.219414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:46.219414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:46.219414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:46.219414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:46.219414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:46.219414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:46.219414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:46.219414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:46.219414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:46.219414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:46.219414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:46.219414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:46.220314 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:19:46.220314 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:19:46.220314 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:19:46.220314 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:19:46.220314 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:19:46.220314 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:19:46.220314 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:46.220314 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:46.220753 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 476/974] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:19:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:46.226528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1db47-4109-4d7b-96ec-5bec7eaadf9b None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:46.242162 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53c3fd-099c-4aa1-a3aa-723275605bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:46.242922 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53c3fd-099c-4aa1-a3aa-723275605bf1 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:46.243156 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53c3fd-099c-4aa1-a3aa-723275605bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:46.243385 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53c3fd-099c-4aa1-a3aa-723275605bf1 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:46.244043 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53c3fd-099c-4aa1-a3aa-723275605bf1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:46.245702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53c3fd-099c-4aa1-a3aa-723275605bf1 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:46.248761 dv-cinder-749155-14-smb devstack@keystone.service[81562]: WARNING keystone.server.flask.common [None req-ec53c3fd-099c-4aa1-a3aa-723275605bf1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 04 16:19:46.263925 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.sql.core [None req-ec53c3fd-099c-4aa1-a3aa-723275605bf1 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 16:19:46.263925 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 04 16:19:46.263925 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [parameters: {'user_id': 'd8e71716802f4ecd9a67fe406365ceff', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 04 16:19:46.263925 dv-cinder-749155-14-smb devstack@keystone.service[81562]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81562) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 16:19:46.282923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-ec53c3fd-099c-4aa1-a3aa-723275605bf1 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 04 16:19:46.282923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:46.282923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 16:19:46.282923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 16:19:46.282923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 16:19:46.282923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 16:19:46.282923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 16:19:46.282923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 16:19:46.282923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 16:19:46.282923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application conn.query(q) Oct 04 16:19:46.282923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 16:19:46.282923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 16:19:46.282923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 16:19:46.282923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application result.read() Oct 04 16:19:46.282923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 16:19:46.283955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 16:19:46.283955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 16:19:46.283955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 16:19:46.283955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 16:19:46.283955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 16:19:46.283955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 16:19:46.283955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 16:19:46.283955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 16:19:46.283955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:46.283955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 16:19:46.283955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:46.283955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:46.283955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 16:19:46.283955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 16:19:46.283955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 04 16:19:46.283955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 04 16:19:46.283955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 16:19:46.283955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application next(self.gen) Oct 04 16:19:46.284926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 16:19:46.284926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application yield resource Oct 04 16:19:46.284926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 16:19:46.284926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application next(self.gen) Oct 04 16:19:46.284926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 16:19:46.284926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 16:19:46.284926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 16:19:46.284926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 16:19:46.284926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 16:19:46.284926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise self.value Oct 04 16:19:46.284926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 16:19:46.284926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 16:19:46.284926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 16:19:46.284926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application session.commit() Oct 04 16:19:46.284926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 16:19:46.284926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 16:19:46.284926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 16:19:46.285871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 16:19:46.285871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 16:19:46.285871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self.session.flush() Oct 04 16:19:46.285871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 16:19:46.285871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 16:19:46.285871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 16:19:46.285871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 16:19:46.285871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 16:19:46.285871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application compat.raise_( Oct 04 16:19:46.285871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 16:19:46.285871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception Oct 04 16:19:46.285871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 16:19:46.285871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 16:19:46.285871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 16:19:46.285871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 16:19:46.285871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 16:19:46.285871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 16:19:46.287529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 16:19:46.287529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 16:19:46.287529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 16:19:46.287529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 04 16:19:46.287529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 16:19:46.287529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 16:19:46.287529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 16:19:46.287529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 16:19:46.287529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 16:19:46.287529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 16:19:46.287529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 16:19:46.287529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 16:19:46.287529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 16:19:46.287529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 16:19:46.287529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 16:19:46.287529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception Oct 04 16:19:46.288560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 16:19:46.288560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 16:19:46.288560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 16:19:46.288560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 16:19:46.288560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 16:19:46.288560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 16:19:46.288560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 16:19:46.288560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application conn.query(q) Oct 04 16:19:46.288560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 16:19:46.288560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 16:19:46.288560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 16:19:46.288560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application result.read() Oct 04 16:19:46.288560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 16:19:46.288560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 16:19:46.288560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 16:19:46.288560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 16:19:46.289438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 16:19:46.289438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 16:19:46.289438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 16:19:46.289438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 16:19:46.289438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 16:19:46.289438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 04 16:19:46.289438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd8e71716802f4ecd9a67fe406365ceff', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 04 16:19:46.289438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 16:19:46.289438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:46.289438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:19:46.289438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:46.289438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:46.289438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:46.289438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:46.289438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:46.290250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:46.290250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:46.290250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:46.290250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:46.290250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:46.290250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:46.290250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:46.290250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 04 16:19:46.290250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 04 16:19:46.290250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:46.290250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:46.290250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:19:46.290250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:46.290250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:19:46.290250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:46.290250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 04 16:19:46.290250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 04 16:19:46.292399 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 04 16:19:46.292399 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 04 16:19:46.292399 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 16:19:46.292399 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 16:19:46.292399 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 04 16:19:46.292399 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:46.292399 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 499/975] 10.222.0.55 () {60 vars in 1131 bytes} [Tue Oct 4 16:19:46 2022] POST /identity/v3/users => generated 160 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:19:46.293375 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53c3fd-099c-4aa1-a3aa-723275605bf1 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:46.329941 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:46.352293 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1db47-4109-4d7b-96ec-5bec7eaadf9b None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:46.388855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1add1b-f3cc-4299-a17a-c8906dea5928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:46.389528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1add1b-f3cc-4299-a17a-c8906dea5928 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:46.389808 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1add1b-f3cc-4299-a17a-c8906dea5928 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:46.390074 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1add1b-f3cc-4299-a17a-c8906dea5928 None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:46.390774 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1add1b-f3cc-4299-a17a-c8906dea5928 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:46.391150 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1add1b-f3cc-4299-a17a-c8906dea5928 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:46.392629 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1add1b-f3cc-4299-a17a-c8906dea5928 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:46.407080 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:46.413283 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 477/976] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:19:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:46.414908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1add1b-f3cc-4299-a17a-c8906dea5928 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:46.422824 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53c3fd-099c-4aa1-a3aa-723275605bf1 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:46.463228 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7508dbc-3f19-4857-82e3-4ac5d4141a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:46.464002 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7508dbc-3f19-4857-82e3-4ac5d4141a69 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:46.464282 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7508dbc-3f19-4857-82e3-4ac5d4141a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:46.464552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7508dbc-3f19-4857-82e3-4ac5d4141a69 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:46.473034 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7508dbc-3f19-4857-82e3-4ac5d4141a69 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:46.474524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7508dbc-3f19-4857-82e3-4ac5d4141a69 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:46.488098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-a7508dbc-3f19-4857-82e3-4ac5d4141a69 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 16:19:46.488098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:46.488098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:46.488098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:46.488098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:46.488098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:46.488098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:46.488098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:46.488098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:46.488098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:46.488098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:46.488098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:46.488098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:19:46.488098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:19:46.488098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:19:46.488098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:19:46.489164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:46.489164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:46.489164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:19:46.489164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:46.489164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:19:46.489164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:46.489164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:46.489164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:46.489164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:46.489164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:46.489164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:46.489164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:46.489164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:46.489164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:46.489164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:46.489164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:46.489164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:46.489164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:46.490130 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:46.490130 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:46.490130 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:19:46.490130 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:19:46.490130 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:19:46.490130 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:19:46.490130 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:19:46.490130 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:19:46.490130 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 16:19:46.490130 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:46.490130 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 500/977] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:19:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:46.495467 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7508dbc-3f19-4857-82e3-4ac5d4141a69 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:46.547505 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1add1b-f3cc-4299-a17a-c8906dea5928 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:46.588858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596acb2-9ad3-4bc2-a09d-c9f087f6299a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:46.589986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596acb2-9ad3-4bc2-a09d-c9f087f6299a None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:46.590472 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596acb2-9ad3-4bc2-a09d-c9f087f6299a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:46.590943 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596acb2-9ad3-4bc2-a09d-c9f087f6299a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:46.591942 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596acb2-9ad3-4bc2-a09d-c9f087f6299a None admin] RBAC: Adding query filter params (role.id=b557a16f80704a549ace1ef1a84f3086, scope.project.id=e480e782c4fa403a913ca7179db0843b, user.id=05cfc9d62a244701a5df524d1c26f107) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:46.592454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596acb2-9ad3-4bc2-a09d-c9f087f6299a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:46.594382 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596acb2-9ad3-4bc2-a09d-c9f087f6299a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:46.607075 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 478/978] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:19:46 2022] GET /identity/v3/role_assignments?user.id=05cfc9d62a244701a5df524d1c26f107&scope.project.id=e480e782c4fa403a913ca7179db0843b&role.id=b557a16f80704a549ace1ef1a84f3086 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:19:46.634898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7508dbc-3f19-4857-82e3-4ac5d4141a69 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:46.677887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569642c-6486-44ba-b5bf-5d4c73aa91e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:46.678527 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569642c-6486-44ba-b5bf-5d4c73aa91e7 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:46.678798 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569642c-6486-44ba-b5bf-5d4c73aa91e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:46.679104 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569642c-6486-44ba-b5bf-5d4c73aa91e7 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:46.679840 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569642c-6486-44ba-b5bf-5d4c73aa91e7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:46.680135 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569642c-6486-44ba-b5bf-5d4c73aa91e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:46.681637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569642c-6486-44ba-b5bf-5d4c73aa91e7 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:46.725108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 501/979] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Oct 4 16:19:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:19:46.865192 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46360bdf-28f6-4be2-b179-cd8c7d5902ee None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:46.865549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46360bdf-28f6-4be2-b179-cd8c7d5902ee None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:46.865767 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46360bdf-28f6-4be2-b179-cd8c7d5902ee None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:46.867515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 479/980] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:46.873738 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ffefa-5b11-494e-9e39-d1f13d548f7b None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:46.874032 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ffefa-5b11-494e-9e39-d1f13d548f7b None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:46.874291 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ffefa-5b11-494e-9e39-d1f13d548f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:46.893934 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-045ffefa-5b11-494e-9e39-d1f13d548f7b None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:46.895526 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-045ffefa-5b11-494e-9e39-d1f13d548f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:46.908423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:46.975156 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 502/981] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:19:47.240165 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46360bdf-28f6-4be2-b179-cd8c7d5902ee None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:47.249688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:47.352678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46360bdf-28f6-4be2-b179-cd8c7d5902ee None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:47.388126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb00f5-3664-4a24-b5c0-0084f6b88c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:47.388754 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb00f5-3664-4a24-b5c0-0084f6b88c65 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:47.389026 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb00f5-3664-4a24-b5c0-0084f6b88c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:47.389290 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb00f5-3664-4a24-b5c0-0084f6b88c65 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:47.389955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb00f5-3664-4a24-b5c0-0084f6b88c65 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:47.391360 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb00f5-3664-4a24-b5c0-0084f6b88c65 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:47.411022 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 480/982] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Oct 4 16:19:47 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:19:48.000886 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8266ca5-ccff-4603-8b4f-e9fc33919c96 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:48.001420 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8266ca5-ccff-4603-8b4f-e9fc33919c96 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:48.001420 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8266ca5-ccff-4603-8b4f-e9fc33919c96 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:48.002735 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 503/983] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:48.008487 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc0dec-db98-4ead-a651-435819d28374 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:48.008975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc0dec-db98-4ead-a651-435819d28374 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:48.009054 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc0dec-db98-4ead-a651-435819d28374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:48.027856 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-f5fc0dec-db98-4ead-a651-435819d28374 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:48.029071 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f5fc0dec-db98-4ead-a651-435819d28374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:48.092796 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:48.109382 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 481/984] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:19:48.372978 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8266ca5-ccff-4603-8b4f-e9fc33919c96 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:48.479860 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8266ca5-ccff-4603-8b4f-e9fc33919c96 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:48.516221 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239eeaf-6f4a-45be-91b0-e57e65717da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:48.516860 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239eeaf-6f4a-45be-91b0-e57e65717da6 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:48.517130 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239eeaf-6f4a-45be-91b0-e57e65717da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:48.517398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239eeaf-6f4a-45be-91b0-e57e65717da6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:48.517988 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239eeaf-6f4a-45be-91b0-e57e65717da6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:48.519394 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239eeaf-6f4a-45be-91b0-e57e65717da6 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:48.528650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-a239eeaf-6f4a-45be-91b0-e57e65717da6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 16:19:48.528650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:48.528650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 16:19:48.528650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 16:19:48.528650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 16:19:48.528650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 16:19:48.528650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 16:19:48.528650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:48.528650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 16:19:48.528650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:48.528650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:19:48.528650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:48.528650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:48.528650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:48.528650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:48.528650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:48.528650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:48.529711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:48.529711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:48.529711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:48.529711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:48.529711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:48.529711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:48.529711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 16:19:48.529711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 16:19:48.529711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 16:19:48.529711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 16:19:48.529711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:48.529711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:48.529711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:48.529711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:48.529711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:48.529711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:48.530597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:48.530597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:48.530597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:48.530597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:48.530597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:48.530597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:48.530597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:48.530597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:48.530597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:48.530597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:48.530597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 16:19:48.530597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:48.530597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 16:19:48.530597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:48.530597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 504/985] 10.222.0.55 () {56 vars in 1126 bytes} [Tue Oct 4 16:19:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:48.537142 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc0dec-db98-4ead-a651-435819d28374 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:48.651751 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc0dec-db98-4ead-a651-435819d28374 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:48.693060 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d94065-b62a-4226-b8d2-ed48a9d07898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:48.693687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d94065-b62a-4226-b8d2-ed48a9d07898 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:48.693968 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d94065-b62a-4226-b8d2-ed48a9d07898 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:48.694237 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d94065-b62a-4226-b8d2-ed48a9d07898 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:48.694880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d94065-b62a-4226-b8d2-ed48a9d07898 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:48.695209 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d94065-b62a-4226-b8d2-ed48a9d07898 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:48.696575 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d94065-b62a-4226-b8d2-ed48a9d07898 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:48.706882 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 482/986] 10.222.0.55 () {56 vars in 1122 bytes} [Tue Oct 4 16:19:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:48.707953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239eeaf-6f4a-45be-91b0-e57e65717da6 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:48.721095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:48.822188 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239eeaf-6f4a-45be-91b0-e57e65717da6 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:48.856206 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047734b4-af61-4209-bd60-317f7c7af692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:48.856819 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047734b4-af61-4209-bd60-317f7c7af692 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:48.857094 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047734b4-af61-4209-bd60-317f7c7af692 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:48.857358 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047734b4-af61-4209-bd60-317f7c7af692 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:48.857992 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047734b4-af61-4209-bd60-317f7c7af692 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:48.858290 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047734b4-af61-4209-bd60-317f7c7af692 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:48.859675 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047734b4-af61-4209-bd60-317f7c7af692 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:48.864860 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 505/987] 10.222.0.55 () {56 vars in 1122 bytes} [Tue Oct 4 16:19:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:19:48.870770 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d94065-b62a-4226-b8d2-ed48a9d07898 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:48.878945 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e5d0c-5abe-4ae3-832f-5223967f6953 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:48.879270 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e5d0c-5abe-4ae3-832f-5223967f6953 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:48.879529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e5d0c-5abe-4ae3-832f-5223967f6953 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:48.881031 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 506/988] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:19:48.886016 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b4d0a-d354-4525-8e82-df91da67d21f None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:48.886298 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b4d0a-d354-4525-8e82-df91da67d21f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:48.886567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b4d0a-d354-4525-8e82-df91da67d21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:48.904725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-3a2b4d0a-d354-4525-8e82-df91da67d21f None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:48.905842 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-3a2b4d0a-d354-4525-8e82-df91da67d21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:48.930865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:48.977853 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d94065-b62a-4226-b8d2-ed48a9d07898 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:48.979767 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 507/989] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 16:19:49.014816 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c134da-6dba-4101-9eb8-b831e691a5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:49.015537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c134da-6dba-4101-9eb8-b831e691a5f7 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:49.015729 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c134da-6dba-4101-9eb8-b831e691a5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:49.015982 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c134da-6dba-4101-9eb8-b831e691a5f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:49.016688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c134da-6dba-4101-9eb8-b831e691a5f7 None admin] RBAC: Adding query filter params (interface=admin, service_id=a2430f3a084e4808b311ad4c073e4a35, region_id=RegionOne) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:49.016986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c134da-6dba-4101-9eb8-b831e691a5f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:49.018347 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c134da-6dba-4101-9eb8-b831e691a5f7 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:49.024052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 483/990] 10.222.0.55 () {56 vars in 1249 bytes} [Tue Oct 4 16:19:48 2022] GET /identity/v3/endpoints?service_id=a2430f3a084e4808b311ad4c073e4a35&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:49.029919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b4d0a-d354-4525-8e82-df91da67d21f None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:49.034508 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:49.135754 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b4d0a-d354-4525-8e82-df91da67d21f None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:49.172536 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b0458-b36a-4811-b6db-0fc92b56e313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:49.173069 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b0458-b36a-4811-b6db-0fc92b56e313 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:49.173340 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b0458-b36a-4811-b6db-0fc92b56e313 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:49.173607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b0458-b36a-4811-b6db-0fc92b56e313 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:49.174212 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b0458-b36a-4811-b6db-0fc92b56e313 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:49.175610 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b0458-b36a-4811-b6db-0fc92b56e313 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:49.182301 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 508/991] 10.222.0.55 () {56 vars in 1087 bytes} [Tue Oct 4 16:19:49 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:19:49.243632 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c134da-6dba-4101-9eb8-b831e691a5f7 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:49.363993 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c134da-6dba-4101-9eb8-b831e691a5f7 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:49.384967 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:49.399531 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffc76e-4373-4843-807f-256a4845ade0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:49.400170 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffc76e-4373-4843-807f-256a4845ade0 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:49.400438 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffc76e-4373-4843-807f-256a4845ade0 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:49.400700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffc76e-4373-4843-807f-256a4845ade0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:49.401343 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ffc76e-4373-4843-807f-256a4845ade0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:49.402697 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ffc76e-4373-4843-807f-256a4845ade0 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:49.411549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-69ffc76e-4373-4843-807f-256a4845ade0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 16:19:49.411549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:49.411549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 16:19:49.411549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 16:19:49.411549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 16:19:49.411549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 16:19:49.411549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 16:19:49.411549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:49.411549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 16:19:49.411549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:49.411549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:19:49.411549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:49.411549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:49.411549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:49.411549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:49.411549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:49.411549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:49.412537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:49.412537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:49.412537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:49.412537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:49.412537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:49.412537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:49.412537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 16:19:49.412537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 16:19:49.412537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 16:19:49.412537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 16:19:49.412537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:49.412537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:49.412537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:49.412537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:49.412537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:49.412537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:49.413486 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:49.413486 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:49.413486 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:49.413486 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:49.413486 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:49.413486 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:49.413486 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:49.413486 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:49.413486 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:49.413486 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:49.413486 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 16:19:49.413486 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:49.413486 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 16:19:49.413486 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:49.413486 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 484/992] 10.222.0.55 () {56 vars in 1105 bytes} [Tue Oct 4 16:19:49 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:49.419383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b0458-b36a-4811-b6db-0fc92b56e313 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:49.491959 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:49.543238 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b0458-b36a-4811-b6db-0fc92b56e313 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:49.592925 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc22c1f-e188-4494-800c-1d618f80c5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:49.593559 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc22c1f-e188-4494-800c-1d618f80c5c8 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:49.593829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc22c1f-e188-4494-800c-1d618f80c5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:49.594095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc22c1f-e188-4494-800c-1d618f80c5c8 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:49.594804 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc22c1f-e188-4494-800c-1d618f80c5c8 None admin] RBAC: Adding query filter params (name=image) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:49.595125 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc22c1f-e188-4494-800c-1d618f80c5c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:49.596574 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc22c1f-e188-4494-800c-1d618f80c5c8 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:49.602554 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 509/993] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:49.608562 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffc76e-4373-4843-807f-256a4845ade0 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:49.619006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31aa4bd-ebeb-441a-9b57-b563cc009aea None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:49.619302 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31aa4bd-ebeb-441a-9b57-b563cc009aea None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:49.619594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31aa4bd-ebeb-441a-9b57-b563cc009aea None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:49.621108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 510/994] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:19:49.625961 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657bc9b-6f8c-4fa8-87aa-ea21e940224c None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:49.626243 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657bc9b-6f8c-4fa8-87aa-ea21e940224c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:49.626505 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657bc9b-6f8c-4fa8-87aa-ea21e940224c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:49.644962 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-9657bc9b-6f8c-4fa8-87aa-ea21e940224c None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:49.646153 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-9657bc9b-6f8c-4fa8-87aa-ea21e940224c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:49.720041 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffc76e-4373-4843-807f-256a4845ade0 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:49.721072 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 511/995] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:49 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 16:19:49.757289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a34115-a22a-4e21-835e-707a2897e3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:49.757874 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a34115-a22a-4e21-835e-707a2897e3af None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:49.758140 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a34115-a22a-4e21-835e-707a2897e3af None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:49.758408 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a34115-a22a-4e21-835e-707a2897e3af None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:49.759103 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a34115-a22a-4e21-835e-707a2897e3af None admin] RBAC: Adding query filter params (type=image) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:49.759407 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a34115-a22a-4e21-835e-707a2897e3af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:49.760856 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a34115-a22a-4e21-835e-707a2897e3af None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:49.771066 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 485/996] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:49.985689 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657bc9b-6f8c-4fa8-87aa-ea21e940224c None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:50.050890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:50.092562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657bc9b-6f8c-4fa8-87aa-ea21e940224c None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:50.130446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8aad61-d47c-4f1c-81fc-2f04c2085cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:50.131111 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8aad61-d47c-4f1c-81fc-2f04c2085cce None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:50.131383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8aad61-d47c-4f1c-81fc-2f04c2085cce None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:50.131663 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8aad61-d47c-4f1c-81fc-2f04c2085cce None admin] PATH_INFO: `/v3/services/compute` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:50.132242 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8aad61-d47c-4f1c-81fc-2f04c2085cce None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:50.133622 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8aad61-d47c-4f1c-81fc-2f04c2085cce None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:50.142501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-7c8aad61-d47c-4f1c-81fc-2f04c2085cce None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 16:19:50.142501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:50.142501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 16:19:50.142501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 16:19:50.142501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 16:19:50.142501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 16:19:50.142501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 16:19:50.142501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:50.142501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 16:19:50.142501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:50.142501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:19:50.142501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:50.142501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:50.142501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:50.142501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:50.142501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:50.142501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:50.143682 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:50.143682 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:50.143682 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:50.143682 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:50.143682 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:50.143682 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:50.143682 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 16:19:50.143682 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 16:19:50.143682 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 16:19:50.143682 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 16:19:50.143682 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:50.143682 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:50.143682 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:50.143682 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:50.143682 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:50.143682 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:50.144555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:50.144555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:50.144555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:50.144555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:50.144555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:50.144555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:50.144555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:50.144555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:50.144555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:50.144555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:50.144555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 16:19:50.144555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:50.144555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 16:19:50.144555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:50.147075 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 512/997] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:19:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:50.149923 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a34115-a22a-4e21-835e-707a2897e3af None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:50.199992 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:50.254340 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a34115-a22a-4e21-835e-707a2897e3af None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:50.289442 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9e9a2-73b2-41b3-8046-4214eff2cfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:50.290064 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9e9a2-73b2-41b3-8046-4214eff2cfa5 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:50.290342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9e9a2-73b2-41b3-8046-4214eff2cfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:50.290611 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9e9a2-73b2-41b3-8046-4214eff2cfa5 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:50.291274 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9e9a2-73b2-41b3-8046-4214eff2cfa5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:50.291577 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9e9a2-73b2-41b3-8046-4214eff2cfa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:50.293001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9e9a2-73b2-41b3-8046-4214eff2cfa5 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:50.298589 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 486/998] 10.222.0.55 () {56 vars in 1112 bytes} [Tue Oct 4 16:19:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:50.305256 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8aad61-d47c-4f1c-81fc-2f04c2085cce None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:50.412172 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8aad61-d47c-4f1c-81fc-2f04c2085cce None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:50.438896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:50.457272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec1794-2f00-4159-ae0f-04edb3c9ea37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:50.457873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec1794-2f00-4159-ae0f-04edb3c9ea37 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:50.458150 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec1794-2f00-4159-ae0f-04edb3c9ea37 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:50.458415 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec1794-2f00-4159-ae0f-04edb3c9ea37 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:50.459107 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec1794-2f00-4159-ae0f-04edb3c9ea37 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:50.459406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec1794-2f00-4159-ae0f-04edb3c9ea37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:50.460812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec1794-2f00-4159-ae0f-04edb3c9ea37 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:50.466575 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 513/999] 10.222.0.55 () {56 vars in 1112 bytes} [Tue Oct 4 16:19:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:50.472407 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9e9a2-73b2-41b3-8046-4214eff2cfa5 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:50.592289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9e9a2-73b2-41b3-8046-4214eff2cfa5 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:50.606492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:50.631601 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c29fcf-d85a-4d19-89cf-292b08de18a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:50.632275 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c29fcf-d85a-4d19-89cf-292b08de18a0 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:50.632555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c29fcf-d85a-4d19-89cf-292b08de18a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:50.632832 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c29fcf-d85a-4d19-89cf-292b08de18a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:50.633531 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c29fcf-d85a-4d19-89cf-292b08de18a0 None admin] RBAC: Adding query filter params (interface=public, service_id=ba566520ae84451fad32e0f7292a9024, region_id=RegionOne) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:50.633842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c29fcf-d85a-4d19-89cf-292b08de18a0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:50.635297 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c29fcf-d85a-4d19-89cf-292b08de18a0 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:50.640782 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 487/1000] 10.222.0.55 () {56 vars in 1251 bytes} [Tue Oct 4 16:19:50 2022] GET /identity/v3/endpoints?service_id=ba566520ae84451fad32e0f7292a9024&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:50.646636 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec1794-2f00-4159-ae0f-04edb3c9ea37 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:50.760868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec1794-2f00-4159-ae0f-04edb3c9ea37 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:50.795835 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abc4df-792c-4529-b097-ef7dd914a600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:50.796456 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abc4df-792c-4529-b097-ef7dd914a600 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:50.796734 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abc4df-792c-4529-b097-ef7dd914a600 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:50.797012 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abc4df-792c-4529-b097-ef7dd914a600 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:50.797618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3abc4df-792c-4529-b097-ef7dd914a600 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:50.799009 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3abc4df-792c-4529-b097-ef7dd914a600 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:50.805473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 514/1001] 10.222.0.55 () {56 vars in 1087 bytes} [Tue Oct 4 16:19:50 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:19:51.381352 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d0a2a-50a4-46f3-8d68-046731dc34af None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:51.381925 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d0a2a-50a4-46f3-8d68-046731dc34af None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:51.381925 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d0a2a-50a4-46f3-8d68-046731dc34af None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:51.383460 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 488/1002] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:51.388738 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d42b4-c8ff-4172-8ece-65a80ce13fe6 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:51.389224 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d42b4-c8ff-4172-8ece-65a80ce13fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:51.389343 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d42b4-c8ff-4172-8ece-65a80ce13fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:51.408758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-3a6d42b4-c8ff-4172-8ece-65a80ce13fe6 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:51.409970 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-3a6d42b4-c8ff-4172-8ece-65a80ce13fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:51.464963 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:51.485707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 515/1003] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:51 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:19:51.751425 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d0a2a-50a4-46f3-8d68-046731dc34af None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:51.865567 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d0a2a-50a4-46f3-8d68-046731dc34af None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:51.900777 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1debc7f-dfd0-4cf1-a35b-f4097aa95bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:51.901460 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1debc7f-dfd0-4cf1-a35b-f4097aa95bde None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:51.901739 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1debc7f-dfd0-4cf1-a35b-f4097aa95bde None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:51.901985 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1debc7f-dfd0-4cf1-a35b-f4097aa95bde None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:51.902596 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1debc7f-dfd0-4cf1-a35b-f4097aa95bde None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:51.904033 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1debc7f-dfd0-4cf1-a35b-f4097aa95bde None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:51.913500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-f1debc7f-dfd0-4cf1-a35b-f4097aa95bde None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 16:19:51.913500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:51.913500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 16:19:51.913500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 16:19:51.913500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 16:19:51.913500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 16:19:51.913500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 16:19:51.913500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:51.913500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 16:19:51.913500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:51.913500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:19:51.913500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:51.913500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:51.913500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:51.913500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:51.913500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:51.913500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:51.914548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:51.914548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:51.914548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:51.914548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:51.914548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:51.914548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:51.914548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 16:19:51.914548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 16:19:51.914548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 16:19:51.914548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 16:19:51.914548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:51.914548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:51.914548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:51.914548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:51.914548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:51.914548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:51.920458 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:51.920458 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:51.920458 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:51.920458 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:51.920458 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:51.920458 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:51.920458 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:51.920458 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:51.920458 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:51.920458 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:51.920458 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 16:19:51.920458 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:51.920458 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 16:19:51.920458 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:51.920458 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 489/1004] 10.222.0.55 () {56 vars in 1126 bytes} [Tue Oct 4 16:19:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:51.922276 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d42b4-c8ff-4172-8ece-65a80ce13fe6 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:52.044931 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d42b4-c8ff-4172-8ece-65a80ce13fe6 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:52.070838 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07773347-3a26-4c78-9fd9-bfa1de6f6a3b None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:52.071556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07773347-3a26-4c78-9fd9-bfa1de6f6a3b None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:52.072127 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07773347-3a26-4c78-9fd9-bfa1de6f6a3b None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:52.073559 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 490/1005] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:52.079726 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e02a5-d068-41ad-990c-f5185f3c3522 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:52.080007 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e02a5-d068-41ad-990c-f5185f3c3522 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:52.080278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e02a5-d068-41ad-990c-f5185f3c3522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:52.092713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b63254-f007-453b-916c-c2e1eb376b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:52.093252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b63254-f007-453b-916c-c2e1eb376b44 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:52.093602 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b63254-f007-453b-916c-c2e1eb376b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:52.093781 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b63254-f007-453b-916c-c2e1eb376b44 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:52.094415 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b63254-f007-453b-916c-c2e1eb376b44 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:52.094706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b63254-f007-453b-916c-c2e1eb376b44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:52.096112 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b63254-f007-453b-916c-c2e1eb376b44 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:52.106036 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 516/1006] 10.222.0.55 () {56 vars in 1122 bytes} [Tue Oct 4 16:19:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:52.106228 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-cc1e02a5-d068-41ad-990c-f5185f3c3522 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:52.106228 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-cc1e02a5-d068-41ad-990c-f5185f3c3522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:52.107027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b63254-f007-453b-916c-c2e1eb376b44 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:52.148929 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:52.160776 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:52.191025 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 491/1007] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:52 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:19:52.229210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b63254-f007-453b-916c-c2e1eb376b44 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:52.269437 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000f62a-710a-41d9-a191-6841f7af4337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:52.270054 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000f62a-710a-41d9-a191-6841f7af4337 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:52.270317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000f62a-710a-41d9-a191-6841f7af4337 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:52.270585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000f62a-710a-41d9-a191-6841f7af4337 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:52.271336 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000f62a-710a-41d9-a191-6841f7af4337 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:52.271637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000f62a-710a-41d9-a191-6841f7af4337 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:52.273030 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000f62a-710a-41d9-a191-6841f7af4337 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:52.283211 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 517/1008] 10.222.0.55 () {56 vars in 1122 bytes} [Tue Oct 4 16:19:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:52.284547 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e02a5-d068-41ad-990c-f5185f3c3522 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:52.394632 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e02a5-d068-41ad-990c-f5185f3c3522 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:52.433300 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590bc1d-ae58-4373-b5c3-75dd2efefa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:52.433917 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590bc1d-ae58-4373-b5c3-75dd2efefa7a None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:52.434198 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590bc1d-ae58-4373-b5c3-75dd2efefa7a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:52.434444 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590bc1d-ae58-4373-b5c3-75dd2efefa7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:52.435166 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590bc1d-ae58-4373-b5c3-75dd2efefa7a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:52.436572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590bc1d-ae58-4373-b5c3-75dd2efefa7a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:52.467755 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 492/1009] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:19:52 2022] POST /identity/v3/endpoints => generated 325 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:19:52.490630 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000f62a-710a-41d9-a191-6841f7af4337 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:52.644162 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000f62a-710a-41d9-a191-6841f7af4337 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:52.665006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:52.700527 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832ef6a-3e77-4435-8c90-8856aa985df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:52.701146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832ef6a-3e77-4435-8c90-8856aa985df5 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:52.701422 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832ef6a-3e77-4435-8c90-8856aa985df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:52.701690 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832ef6a-3e77-4435-8c90-8856aa985df5 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:52.702337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832ef6a-3e77-4435-8c90-8856aa985df5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:52.703753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832ef6a-3e77-4435-8c90-8856aa985df5 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:52.721621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 518/1010] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Oct 4 16:19:52 2022] POST /identity/v3/services => generated 242 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:19:53.047748 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6108042-ac06-4704-91b2-ed569b77f775 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:53.047928 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6108042-ac06-4704-91b2-ed569b77f775 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:53.048335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6108042-ac06-4704-91b2-ed569b77f775 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:53.052315 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 493/1011] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:53.057359 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe6b98-61b2-48f1-80fc-425ec12e09b4 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:53.057654 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe6b98-61b2-48f1-80fc-425ec12e09b4 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:53.058066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe6b98-61b2-48f1-80fc-425ec12e09b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:53.079080 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-5ffe6b98-61b2-48f1-80fc-425ec12e09b4 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:53.080308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-5ffe6b98-61b2-48f1-80fc-425ec12e09b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:53.162083 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 519/1012] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:53 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:19:53.469572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6108042-ac06-4704-91b2-ed569b77f775 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:53.507015 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:53.612444 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6108042-ac06-4704-91b2-ed569b77f775 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:53.652210 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94284dc7-19d4-48d5-b9a0-16d6fa8b18da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:53.652902 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94284dc7-19d4-48d5-b9a0-16d6fa8b18da None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:53.653177 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94284dc7-19d4-48d5-b9a0-16d6fa8b18da None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:53.653449 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94284dc7-19d4-48d5-b9a0-16d6fa8b18da None admin] PATH_INFO: `/v3/services/compute` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:53.654050 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94284dc7-19d4-48d5-b9a0-16d6fa8b18da None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:53.655558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94284dc7-19d4-48d5-b9a0-16d6fa8b18da None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:53.670495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-94284dc7-19d4-48d5-b9a0-16d6fa8b18da None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 16:19:53.670495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:53.670495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 16:19:53.670495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 16:19:53.670495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 16:19:53.670495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 16:19:53.670495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 16:19:53.670495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:53.670495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 16:19:53.670495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:53.670495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:19:53.670495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:53.670495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:53.670495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:53.670495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:53.670495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:53.670495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:53.671640 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:53.671640 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:53.671640 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:53.671640 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:53.671640 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:53.671640 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:53.671640 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 16:19:53.671640 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 16:19:53.671640 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 16:19:53.671640 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 16:19:53.671640 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:53.671640 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:53.671640 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:53.671640 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:53.671640 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:53.671640 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:53.676204 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:53.676204 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:53.676204 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:53.676204 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:53.676204 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:53.676204 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:53.676204 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:53.676204 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:53.676204 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:53.676204 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:53.676204 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 16:19:53.676204 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:53.676204 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 16:19:53.676204 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:53.676204 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 494/1013] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:19:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:53.678542 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe6b98-61b2-48f1-80fc-425ec12e09b4 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:53.790377 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:53.802525 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe6b98-61b2-48f1-80fc-425ec12e09b4 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:53.856280 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565ab3b-698b-49b8-844b-e88c61ee540e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:53.857250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565ab3b-698b-49b8-844b-e88c61ee540e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:53.857685 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565ab3b-698b-49b8-844b-e88c61ee540e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:53.858116 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565ab3b-698b-49b8-844b-e88c61ee540e None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:53.859270 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565ab3b-698b-49b8-844b-e88c61ee540e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:53.859745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565ab3b-698b-49b8-844b-e88c61ee540e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:53.862169 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565ab3b-698b-49b8-844b-e88c61ee540e None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:53.875247 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 520/1014] 10.222.0.55 () {56 vars in 1112 bytes} [Tue Oct 4 16:19:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:53.877903 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94284dc7-19d4-48d5-b9a0-16d6fa8b18da None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:53.994210 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:54.003211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94284dc7-19d4-48d5-b9a0-16d6fa8b18da None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:54.043217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdea9ff-a8d0-4d7c-b4eb-5c508311ec91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:54.043766 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdea9ff-a8d0-4d7c-b4eb-5c508311ec91 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:54.044379 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdea9ff-a8d0-4d7c-b4eb-5c508311ec91 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:54.044672 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdea9ff-a8d0-4d7c-b4eb-5c508311ec91 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:54.045319 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdea9ff-a8d0-4d7c-b4eb-5c508311ec91 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:54.045619 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdea9ff-a8d0-4d7c-b4eb-5c508311ec91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:54.047010 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdea9ff-a8d0-4d7c-b4eb-5c508311ec91 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:54.053008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 495/1015] 10.222.0.55 () {56 vars in 1112 bytes} [Tue Oct 4 16:19:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:54.058948 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565ab3b-698b-49b8-844b-e88c61ee540e None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:54.199583 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565ab3b-698b-49b8-844b-e88c61ee540e None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:54.255289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd5c4d-ff73-4c55-8da9-9ff056ab5e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:54.256247 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd5c4d-ff73-4c55-8da9-9ff056ab5e38 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:54.256672 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd5c4d-ff73-4c55-8da9-9ff056ab5e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:54.257107 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd5c4d-ff73-4c55-8da9-9ff056ab5e38 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:54.258225 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd5c4d-ff73-4c55-8da9-9ff056ab5e38 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:54.260489 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd5c4d-ff73-4c55-8da9-9ff056ab5e38 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:54.292393 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 521/1016] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:19:54 2022] POST /identity/v3/endpoints => generated 334 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:19:54.749333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b7858-ff83-4623-bc7e-46fecbcab541 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:54.749882 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b7858-ff83-4623-bc7e-46fecbcab541 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:54.749882 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b7858-ff83-4623-bc7e-46fecbcab541 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:54.753596 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 496/1017] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:54.757585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd13ab-4a1b-4034-9201-26cdb473d744 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:54.758084 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd13ab-4a1b-4034-9201-26cdb473d744 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:54.758183 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd13ab-4a1b-4034-9201-26cdb473d744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:54.778403 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-b1bd13ab-4a1b-4034-9201-26cdb473d744 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:54.779690 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b1bd13ab-4a1b-4034-9201-26cdb473d744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:54.792137 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:54.875672 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 522/1018] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:19:54.947262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad023e8-091c-4678-be40-626a686bd9ad None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:54.947577 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad023e8-091c-4678-be40-626a686bd9ad None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:54.947999 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad023e8-091c-4678-be40-626a686bd9ad None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:54.949557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 497/1019] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:54.955624 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a771a7-f83b-464b-97a6-eb44c3e95631 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:54.955911 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a771a7-f83b-464b-97a6-eb44c3e95631 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:54.956165 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a771a7-f83b-464b-97a6-eb44c3e95631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:54.978315 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-14a771a7-f83b-464b-97a6-eb44c3e95631 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:54.979748 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-14a771a7-f83b-464b-97a6-eb44c3e95631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:55.062354 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 523/1020] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:19:55.152383 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad023e8-091c-4678-be40-626a686bd9ad None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:55.262587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad023e8-091c-4678-be40-626a686bd9ad None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:55.299602 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2c324-ba4b-44f1-afc5-5dbdb5edaab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:55.300571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2c324-ba4b-44f1-afc5-5dbdb5edaab2 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:55.301016 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2c324-ba4b-44f1-afc5-5dbdb5edaab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:55.301436 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2c324-ba4b-44f1-afc5-5dbdb5edaab2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:55.303303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2c324-ba4b-44f1-afc5-5dbdb5edaab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:55.305735 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2c324-ba4b-44f1-afc5-5dbdb5edaab2 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:55.308661 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 498/1021] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:55.317446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a771a7-f83b-464b-97a6-eb44c3e95631 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:55.343515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2c324-ba4b-44f1-afc5-5dbdb5edaab2 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:55.380171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:55.415440 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:55.449354 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a771a7-f83b-464b-97a6-eb44c3e95631 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:55.476632 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2c324-ba4b-44f1-afc5-5dbdb5edaab2 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:55.502813 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e2ff2-6def-42ce-a3f5-bf4cb7ea670c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:55.504490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e2ff2-6def-42ce-a3f5-bf4cb7ea670c None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:55.505369 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e2ff2-6def-42ce-a3f5-bf4cb7ea670c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:55.506444 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e2ff2-6def-42ce-a3f5-bf4cb7ea670c None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:55.508382 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e2ff2-6def-42ce-a3f5-bf4cb7ea670c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:55.510816 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e2ff2-6def-42ce-a3f5-bf4cb7ea670c None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:55.513539 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dacca-99c5-4308-950b-5e15362bf375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:55.514178 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dacca-99c5-4308-950b-5e15362bf375 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:55.514446 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dacca-99c5-4308-950b-5e15362bf375 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:55.514711 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dacca-99c5-4308-950b-5e15362bf375 None admin] PATH_INFO: `/v3/services/image` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:55.515318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24dacca-99c5-4308-950b-5e15362bf375 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:55.516669 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24dacca-99c5-4308-950b-5e15362bf375 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:55.525719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-e24dacca-99c5-4308-950b-5e15362bf375 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 16:19:55.525719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:55.525719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 16:19:55.525719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 16:19:55.525719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 16:19:55.525719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 16:19:55.525719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 16:19:55.525719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:55.525719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 16:19:55.525719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:55.525719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:19:55.525719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:55.525719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:55.525719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:55.525719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:55.525719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:55.525719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:55.527435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:55.527435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:55.527435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:55.527435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:55.527435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:55.527435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:55.527435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 16:19:55.527435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 16:19:55.527435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 16:19:55.527435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 16:19:55.527435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:55.527435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:55.527435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:55.527435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:55.527435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:55.527435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:55.528952 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:55.528952 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:55.528952 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:55.528952 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:55.528952 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:55.528952 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:55.528952 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:55.528952 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:55.528952 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:55.528952 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:55.528952 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 16:19:55.528952 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:55.528952 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 16:19:55.528952 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:55.528952 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 499/1022] 10.222.0.55 () {56 vars in 1105 bytes} [Tue Oct 4 16:19:55 2022] GET /identity/v3/services/image => generated 86 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:55.533384 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dacca-99c5-4308-950b-5e15362bf375 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:55.546567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 524/1023] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Oct 4 16:19:55 2022] POST /identity/v3/projects => generated 311 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:19:55.684383 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:55.699276 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dacca-99c5-4308-950b-5e15362bf375 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:55.742622 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885f317-29cc-4cad-ab1e-427ce4461588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:55.743233 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885f317-29cc-4cad-ab1e-427ce4461588 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:55.743507 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885f317-29cc-4cad-ab1e-427ce4461588 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:55.743789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885f317-29cc-4cad-ab1e-427ce4461588 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:55.744405 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885f317-29cc-4cad-ab1e-427ce4461588 None admin] RBAC: Adding query filter params (name=image) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:55.744747 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885f317-29cc-4cad-ab1e-427ce4461588 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:55.746372 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885f317-29cc-4cad-ab1e-427ce4461588 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:55.751927 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 500/1024] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:55.758847 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e2ff2-6def-42ce-a3f5-bf4cb7ea670c None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:55.875138 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e2ff2-6def-42ce-a3f5-bf4cb7ea670c None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:55.914729 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:55.935874 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06cf32-b57e-42b0-a61e-f11b6b36768b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:55.936590 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06cf32-b57e-42b0-a61e-f11b6b36768b None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:55.936877 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06cf32-b57e-42b0-a61e-f11b6b36768b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:55.937152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06cf32-b57e-42b0-a61e-f11b6b36768b None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:55.937836 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06cf32-b57e-42b0-a61e-f11b6b36768b None admin] RBAC: Adding query filter params (type=image) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:55.938141 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06cf32-b57e-42b0-a61e-f11b6b36768b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:55.943860 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06cf32-b57e-42b0-a61e-f11b6b36768b None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:55.949835 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 525/1025] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:55.955816 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885f317-29cc-4cad-ab1e-427ce4461588 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:56.085635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885f317-29cc-4cad-ab1e-427ce4461588 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:56.120499 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de3d9e-1778-4d0f-acff-b6b28bfd01a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:56.121121 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de3d9e-1778-4d0f-acff-b6b28bfd01a7 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:56.121397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de3d9e-1778-4d0f-acff-b6b28bfd01a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:56.121664 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de3d9e-1778-4d0f-acff-b6b28bfd01a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:56.122376 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de3d9e-1778-4d0f-acff-b6b28bfd01a7 None admin] RBAC: Adding query filter params (interface=public, service_id=0099341ab57742c5a6fbd2eb589e75ff, region_id=RegionOne) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:56.122677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de3d9e-1778-4d0f-acff-b6b28bfd01a7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:56.124115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de3d9e-1778-4d0f-acff-b6b28bfd01a7 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:56.130128 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 501/1026] 10.222.0.55 () {56 vars in 1251 bytes} [Tue Oct 4 16:19:55 2022] GET /identity/v3/endpoints?service_id=0099341ab57742c5a6fbd2eb589e75ff&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:56.135811 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06cf32-b57e-42b0-a61e-f11b6b36768b None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:56.246649 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06cf32-b57e-42b0-a61e-f11b6b36768b None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:56.281547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db01ff1-0c40-425d-9f51-b8260c92d2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:56.282165 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db01ff1-0c40-425d-9f51-b8260c92d2e9 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:56.282442 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db01ff1-0c40-425d-9f51-b8260c92d2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:56.282707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db01ff1-0c40-425d-9f51-b8260c92d2e9 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:56.283344 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db01ff1-0c40-425d-9f51-b8260c92d2e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:56.284722 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db01ff1-0c40-425d-9f51-b8260c92d2e9 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:56.292100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 526/1027] 10.222.0.55 () {56 vars in 1087 bytes} [Tue Oct 4 16:19:56 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:19:56.671543 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a05f8b-2ff0-4dab-a7ed-ac3d7cf496f7 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:56.671804 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a05f8b-2ff0-4dab-a7ed-ac3d7cf496f7 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:56.672060 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a05f8b-2ff0-4dab-a7ed-ac3d7cf496f7 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:56.673807 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 502/1028] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:56.679753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a9c6c-7f8a-46d5-b32a-0badb7936353 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:56.680105 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a9c6c-7f8a-46d5-b32a-0badb7936353 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:56.680311 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a9c6c-7f8a-46d5-b32a-0badb7936353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:56.700567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-a74a9c6c-7f8a-46d5-b32a-0badb7936353 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:56.701801 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-a74a9c6c-7f8a-46d5-b32a-0badb7936353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:56.753355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:56.775993 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 527/1029] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:19:57.038232 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a05f8b-2ff0-4dab-a7ed-ac3d7cf496f7 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:57.061472 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:57.157138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a05f8b-2ff0-4dab-a7ed-ac3d7cf496f7 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:57.195476 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537180c-09f0-4314-8edc-6e057688d4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:57.196131 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537180c-09f0-4314-8edc-6e057688d4ca None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:57.196368 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537180c-09f0-4314-8edc-6e057688d4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:57.196661 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537180c-09f0-4314-8edc-6e057688d4ca None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:57.208359 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537180c-09f0-4314-8edc-6e057688d4ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:19:57.213217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-2537180c-09f0-4314-8edc-6e057688d4ca None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 16:19:57.213217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:57.213217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:57.213217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:57.213217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:57.213217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:57.213217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:57.213217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:57.213217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:57.213217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:57.213217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:57.213217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:57.213217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:19:57.213217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:19:57.213217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:19:57.213217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:19:57.214249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:19:57.214249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:19:57.214249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:19:57.214249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:19:57.214249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:57.214249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:57.214249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:57.214249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:57.214249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:57.214249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:57.214249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:57.214249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:57.214249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:57.214249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:57.214249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:57.214249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:57.215815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:57.215815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:57.215815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:57.215815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:57.215815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:19:57.215815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:19:57.215815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:19:57.215815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:19:57.215815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:19:57.215815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:19:57.215815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 16:19:57.215815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:57.215815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 503/1030] 10.222.0.55 () {56 vars in 1120 bytes} [Tue Oct 4 16:19:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:57.220453 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a9c6c-7f8a-46d5-b32a-0badb7936353 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:57.333552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a9c6c-7f8a-46d5-b32a-0badb7936353 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:57.367367 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f00576-e4a4-405c-955a-a3f6afee495d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:57.367982 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f00576-e4a4-405c-955a-a3f6afee495d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:57.368265 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f00576-e4a4-405c-955a-a3f6afee495d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:57.368539 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f00576-e4a4-405c-955a-a3f6afee495d None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:57.369210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f00576-e4a4-405c-955a-a3f6afee495d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:57.369513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f00576-e4a4-405c-955a-a3f6afee495d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:57.370928 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f00576-e4a4-405c-955a-a3f6afee495d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:57.384461 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 528/1031] 10.222.0.55 () {56 vars in 1115 bytes} [Tue Oct 4 16:19:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:57.386186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537180c-09f0-4314-8edc-6e057688d4ca None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:57.477525 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:57.502969 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537180c-09f0-4314-8edc-6e057688d4ca None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:57.539249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834f678-d965-496b-aaa1-85663a3d659e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:57.539905 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834f678-d965-496b-aaa1-85663a3d659e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:57.540181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834f678-d965-496b-aaa1-85663a3d659e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:57.540447 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834f678-d965-496b-aaa1-85663a3d659e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:57.551891 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834f678-d965-496b-aaa1-85663a3d659e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:57.553481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834f678-d965-496b-aaa1-85663a3d659e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:57.569078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-1834f678-d965-496b-aaa1-85663a3d659e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:57.569078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:57.569078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:57.569078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:57.569078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:57.569078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:57.569078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:57.569078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:57.569078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:57.569078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:57.569078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:57.569078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:57.569078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:57.569078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:57.569078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:57.569078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:57.570096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:57.570096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:57.570096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:57.570096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:57.570096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:57.570096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:57.570096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:57.570096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:57.570096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:57.570096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:57.570096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:57.570096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:57.570096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:57.570096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:57.570096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:57.570096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:57.570096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:57.571476 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:57.571476 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:57.571476 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:57.576545 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 504/1032] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:57.576701 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f00576-e4a4-405c-955a-a3f6afee495d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:57.629323 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:57.705887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f00576-e4a4-405c-955a-a3f6afee495d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:57.740107 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf3af0-1f66-4e34-9c6e-6462592dcb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:57.740722 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf3af0-1f66-4e34-9c6e-6462592dcb3d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:57.740993 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf3af0-1f66-4e34-9c6e-6462592dcb3d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:57.741257 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf3af0-1f66-4e34-9c6e-6462592dcb3d None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:57.741955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf3af0-1f66-4e34-9c6e-6462592dcb3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:57.742248 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf3af0-1f66-4e34-9c6e-6462592dcb3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:57.743666 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf3af0-1f66-4e34-9c6e-6462592dcb3d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:57.760240 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 529/1033] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:57.761986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834f678-d965-496b-aaa1-85663a3d659e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:57.878751 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834f678-d965-496b-aaa1-85663a3d659e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:57.912370 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:57.920215 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85154b9a-4bc0-4f13-a6af-4bf418d20ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:57.920874 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85154b9a-4bc0-4f13-a6af-4bf418d20ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:57.921152 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85154b9a-4bc0-4f13-a6af-4bf418d20ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:57.921420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85154b9a-4bc0-4f13-a6af-4bf418d20ae1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:57.929865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85154b9a-4bc0-4f13-a6af-4bf418d20ae1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:57.931371 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85154b9a-4bc0-4f13-a6af-4bf418d20ae1 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:57.943614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-85154b9a-4bc0-4f13-a6af-4bf418d20ae1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 16:19:57.943614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:57.943614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:57.943614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:57.943614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:57.943614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:57.943614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:57.943614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:57.943614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:57.943614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:57.943614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:57.943614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:57.943614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:19:57.943614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:19:57.943614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:19:57.943614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:19:57.944678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:57.944678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:57.944678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:19:57.944678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:57.944678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:19:57.944678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:19:57.944678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:57.944678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:57.944678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:57.944678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:57.944678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:57.944678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:57.944678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:57.944678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:57.944678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:57.944678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:57.944678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:57.944678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:57.945715 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:57.945715 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:57.945715 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:19:57.945715 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:19:57.945715 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:19:57.945715 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:19:57.945715 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:19:57.945715 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:19:57.945715 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 16:19:57.945715 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:57.947072 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 505/1034] 10.222.0.55 () {56 vars in 1093 bytes} [Tue Oct 4 16:19:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:57.951166 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf3af0-1f66-4e34-9c6e-6462592dcb3d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:58.064181 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf3af0-1f66-4e34-9c6e-6462592dcb3d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:58.065773 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:58.087626 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c992942-cd28-4e41-b3db-fd16a9966ce6 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:58.088196 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c992942-cd28-4e41-b3db-fd16a9966ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:58.088196 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c992942-cd28-4e41-b3db-fd16a9966ce6 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:58.089742 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 506/1035] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:19:58.095111 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c00d5c-79f1-4872-844f-3424b583d2d5 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:58.095413 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c00d5c-79f1-4872-844f-3424b583d2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:58.095694 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c00d5c-79f1-4872-844f-3424b583d2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:58.109311 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fec6c-e856-447f-ac53-82b047dd2035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:58.110054 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fec6c-e856-447f-ac53-82b047dd2035 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:58.110672 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fec6c-e856-447f-ac53-82b047dd2035 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:58.110964 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fec6c-e856-447f-ac53-82b047dd2035 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:58.112343 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890fec6c-e856-447f-ac53-82b047dd2035 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:58.112884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890fec6c-e856-447f-ac53-82b047dd2035 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:58.115206 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890fec6c-e856-447f-ac53-82b047dd2035 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:58.118907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-49c00d5c-79f1-4872-844f-3424b583d2d5 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:58.120340 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-49c00d5c-79f1-4872-844f-3424b583d2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:58.143321 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 530/1036] 10.222.0.55 () {56 vars in 1133 bytes} [Tue Oct 4 16:19:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:58.144741 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fec6c-e856-447f-ac53-82b047dd2035 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:58.199876 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 507/1037] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 16:19:58.265046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fec6c-e856-447f-ac53-82b047dd2035 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:58.305464 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36469f9-2350-4b9a-96b6-cceea925030c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:58.306552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36469f9-2350-4b9a-96b6-cceea925030c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:58.307141 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36469f9-2350-4b9a-96b6-cceea925030c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:58.307661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36469f9-2350-4b9a-96b6-cceea925030c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:58.338317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:58.386589 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36469f9-2350-4b9a-96b6-cceea925030c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:58.388096 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36469f9-2350-4b9a-96b6-cceea925030c None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:58.468577 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c00d5c-79f1-4872-844f-3424b583d2d5 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:58.500454 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 531/1038] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:19:58 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 16:19:58.501753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512393a0-0bfb-49fb-a2f8-813301188a73 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:58.502040 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512393a0-0bfb-49fb-a2f8-813301188a73 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:58.502312 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512393a0-0bfb-49fb-a2f8-813301188a73 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:58.503718 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 532/1039] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:19:58.509268 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648d962-cd8e-4160-be2a-89bd67f50124 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:58.509546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648d962-cd8e-4160-be2a-89bd67f50124 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:58.509813 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648d962-cd8e-4160-be2a-89bd67f50124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:58.528498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-0648d962-cd8e-4160-be2a-89bd67f50124 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:19:58.529691 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-0648d962-cd8e-4160-be2a-89bd67f50124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:19:58.584044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c00d5c-79f1-4872-844f-3424b583d2d5 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:58.592557 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:58.605954 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 533/1040] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:19:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:19:58.606835 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648d962-cd8e-4160-be2a-89bd67f50124 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:58.611616 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:58.628004 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f797a6-efb3-45f3-90ec-80e0d76c5259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:58.628717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f797a6-efb3-45f3-90ec-80e0d76c5259 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:58.628990 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f797a6-efb3-45f3-90ec-80e0d76c5259 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:58.629259 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f797a6-efb3-45f3-90ec-80e0d76c5259 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:58.630389 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f797a6-efb3-45f3-90ec-80e0d76c5259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:58.632066 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f797a6-efb3-45f3-90ec-80e0d76c5259 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:58.633682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 508/1041] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:19:58.639462 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f797a6-efb3-45f3-90ec-80e0d76c5259 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:58.726105 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648d962-cd8e-4160-be2a-89bd67f50124 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:58.747819 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f797a6-efb3-45f3-90ec-80e0d76c5259 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:58.767146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0096e4-6b4f-4230-b02f-55736c41d64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:58.768512 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0096e4-6b4f-4230-b02f-55736c41d64e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:58.769670 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0096e4-6b4f-4230-b02f-55736c41d64e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:58.770139 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0096e4-6b4f-4230-b02f-55736c41d64e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:58.783138 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0096e4-6b4f-4230-b02f-55736c41d64e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:58.784611 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0096e4-6b4f-4230-b02f-55736c41d64e None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:58.790466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a33586-e04a-464d-8387-8d2037e208de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:58.791118 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a33586-e04a-464d-8387-8d2037e208de None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:58.791393 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a33586-e04a-464d-8387-8d2037e208de None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:58.791714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a33586-e04a-464d-8387-8d2037e208de None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:58.792363 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a33586-e04a-464d-8387-8d2037e208de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:58.794124 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a33586-e04a-464d-8387-8d2037e208de None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:58.801606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-0f0096e4-6b4f-4230-b02f-55736c41d64e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:58.801606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:58.801606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:58.801606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:58.801606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:58.801606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:58.801606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:58.801606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:58.801606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:58.801606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:58.801606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:58.801606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:58.801606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:19:58.801606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:19:58.801606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:19:58.801606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:19:58.802538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:58.802538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:58.802538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:58.802538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:58.802538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:58.802538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:58.802538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:58.802538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:58.802538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:58.802538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:58.802538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:58.802538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:58.802538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:58.802538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:58.802538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:58.802538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:58.802538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:19:58.808214 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:19:58.808214 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:19:58.808214 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:58.808214 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 534/1042] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:58.808451 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0096e4-6b4f-4230-b02f-55736c41d64e None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:58.825077 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 509/1043] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Oct 4 16:19:58 2022] POST /identity/v3/users => generated 285 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:19:58.874655 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:58.882936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a33586-e04a-464d-8387-8d2037e208de None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:58.932987 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:58.944681 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0096e4-6b4f-4230-b02f-55736c41d64e None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:58.989303 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ad0a6-8666-42a6-bede-4fa5e0542bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:58.989977 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ad0a6-8666-42a6-bede-4fa5e0542bec None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:58.990216 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ad0a6-8666-42a6-bede-4fa5e0542bec None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:58.990487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ad0a6-8666-42a6-bede-4fa5e0542bec None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:58.991198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ad0a6-8666-42a6-bede-4fa5e0542bec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:58.991481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ad0a6-8666-42a6-bede-4fa5e0542bec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:58.992894 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ad0a6-8666-42a6-bede-4fa5e0542bec None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:59.000372 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a33586-e04a-464d-8387-8d2037e208de None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:59.011620 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 535/1044] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:59.013051 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ad0a6-8666-42a6-bede-4fa5e0542bec None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:59.044458 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599447a0-827d-4223-acfa-45d2884a0723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:59.045112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599447a0-827d-4223-acfa-45d2884a0723 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:59.045391 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599447a0-827d-4223-acfa-45d2884a0723 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:59.045660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599447a0-827d-4223-acfa-45d2884a0723 None admin] PATH_INFO: `/v3/services/image` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:59.046250 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599447a0-827d-4223-acfa-45d2884a0723 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:59.047672 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599447a0-827d-4223-acfa-45d2884a0723 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:59.058295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-599447a0-827d-4223-acfa-45d2884a0723 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 16:19:59.058295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:59.058295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 16:19:59.058295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 16:19:59.058295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 16:19:59.058295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 16:19:59.058295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 16:19:59.058295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:59.058295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 16:19:59.058295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:59.058295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:19:59.058295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:59.058295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:59.058295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:59.058295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:59.058295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:59.058295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:59.059479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:59.059479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:59.059479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:59.059479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:59.059479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:59.059479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:59.059479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 16:19:59.059479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 16:19:59.059479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 16:19:59.059479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 16:19:59.059479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:59.059479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:59.059479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:59.059479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:59.059479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:59.059479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:59.060439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:59.060439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:59.060439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:59.060439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:59.060439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:59.060439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:59.060439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:59.060439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:59.060439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:59.060439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:59.060439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 16:19:59.060439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:19:59.060439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 16:19:59.060439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:19:59.060439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 510/1045] 10.222.0.55 () {56 vars in 1105 bytes} [Tue Oct 4 16:19:58 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:59.066376 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599447a0-827d-4223-acfa-45d2884a0723 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:59.128375 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ad0a6-8666-42a6-bede-4fa5e0542bec None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:59.129861 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:59.166861 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688269e9-ddc2-4e01-87b3-20e4ea6380c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:59.167638 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688269e9-ddc2-4e01-87b3-20e4ea6380c5 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:59.167903 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688269e9-ddc2-4e01-87b3-20e4ea6380c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:59.168166 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688269e9-ddc2-4e01-87b3-20e4ea6380c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:59.174265 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599447a0-827d-4223-acfa-45d2884a0723 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:59.184413 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:59.189879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688269e9-ddc2-4e01-87b3-20e4ea6380c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:59.191404 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688269e9-ddc2-4e01-87b3-20e4ea6380c5 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:59.208438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-688269e9-ddc2-4e01-87b3-20e4ea6380c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:59.208438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:19:59.208438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:19:59.208438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:19:59.208438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:19:59.208438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:19:59.208438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:19:59.208438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:19:59.208438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:19:59.208438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:19:59.208438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:19:59.208438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:19:59.208438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:19:59.208438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:19:59.208438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:19:59.209473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:19:59.209473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:19:59.209473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:19:59.209473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:19:59.209473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:19:59.209473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:19:59.209473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:19:59.209473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:19:59.209473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:19:59.209473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:19:59.209473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:19:59.209473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:19:59.209473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:19:59.209473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:19:59.209473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:19:59.209473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:19:59.209473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:19:59.210389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:19:59.210389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:19:59.210389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:19:59.210389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:19:59.210389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:19:59.210389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:19:59.210389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:19:59.210389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:19:59.210389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 536/1046] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:19:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:19:59.216741 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688269e9-ddc2-4e01-87b3-20e4ea6380c5 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:59.219171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cd66c-7a52-49c0-b84d-56984d9c248c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:59.220200 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cd66c-7a52-49c0-b84d-56984d9c248c None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:59.220678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cd66c-7a52-49c0-b84d-56984d9c248c None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:59.221200 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cd66c-7a52-49c0-b84d-56984d9c248c None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:59.222293 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cd66c-7a52-49c0-b84d-56984d9c248c None admin] RBAC: Adding query filter params (name=image) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:59.222811 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cd66c-7a52-49c0-b84d-56984d9c248c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:59.225372 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cd66c-7a52-49c0-b84d-56984d9c248c None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:59.232436 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 511/1047] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:19:59.238775 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cd66c-7a52-49c0-b84d-56984d9c248c None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:59.349164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688269e9-ddc2-4e01-87b3-20e4ea6380c5 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:59.357974 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cd66c-7a52-49c0-b84d-56984d9c248c None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:59.385820 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b57cc-b2c7-441f-b405-eaca589255ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:59.386436 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b57cc-b2c7-441f-b405-eaca589255ac None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:59.386708 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b57cc-b2c7-441f-b405-eaca589255ac None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:59.386972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b57cc-b2c7-441f-b405-eaca589255ac None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:59.387679 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b57cc-b2c7-441f-b405-eaca589255ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:59.387986 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b57cc-b2c7-441f-b405-eaca589255ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:59.389404 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b57cc-b2c7-441f-b405-eaca589255ac None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:59.396957 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71547c15-c35a-4d7f-8bb8-6b94ee3f7667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:59.397583 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71547c15-c35a-4d7f-8bb8-6b94ee3f7667 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:59.397860 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71547c15-c35a-4d7f-8bb8-6b94ee3f7667 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:59.398127 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71547c15-c35a-4d7f-8bb8-6b94ee3f7667 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:59.398763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71547c15-c35a-4d7f-8bb8-6b94ee3f7667 None admin] RBAC: Adding query filter params (type=image) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:59.399097 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71547c15-c35a-4d7f-8bb8-6b94ee3f7667 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:59.400470 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71547c15-c35a-4d7f-8bb8-6b94ee3f7667 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:59.404229 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 537/1048] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:19:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:59.407027 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 512/1049] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:19:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:19:59.411338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b57cc-b2c7-441f-b405-eaca589255ac None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:59.412726 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71547c15-c35a-4d7f-8bb8-6b94ee3f7667 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:19:59.450011 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:59.452299 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:19:59.517106 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71547c15-c35a-4d7f-8bb8-6b94ee3f7667 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:59.538960 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b57cc-b2c7-441f-b405-eaca589255ac None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:19:59.556974 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594b67c-a532-4b24-8fe9-f5a0487acaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:59.558212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594b67c-a532-4b24-8fe9-f5a0487acaec None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:59.558789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594b67c-a532-4b24-8fe9-f5a0487acaec None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:59.559269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594b67c-a532-4b24-8fe9-f5a0487acaec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:59.560189 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594b67c-a532-4b24-8fe9-f5a0487acaec None admin] RBAC: Adding query filter params (role.id=b557a16f80704a549ace1ef1a84f3086, scope.project.id=e480e782c4fa403a913ca7179db0843b, user.id=6cdee0584fe045028a44c385d032d2c7) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:19:59.561070 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594b67c-a532-4b24-8fe9-f5a0487acaec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:59.562883 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594b67c-a532-4b24-8fe9-f5a0487acaec None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:59.568542 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 513/1050] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:19:59 2022] GET /identity/v3/role_assignments?user.id=6cdee0584fe045028a44c385d032d2c7&scope.project.id=e480e782c4fa403a913ca7179db0843b&role.id=b557a16f80704a549ace1ef1a84f3086 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:19:59.583621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643535ba-f41a-4ba0-a97c-f2091872dbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:19:59.584398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643535ba-f41a-4ba0-a97c-f2091872dbf4 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:19:59.584721 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643535ba-f41a-4ba0-a97c-f2091872dbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:19:59.585062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643535ba-f41a-4ba0-a97c-f2091872dbf4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:19:59.585894 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643535ba-f41a-4ba0-a97c-f2091872dbf4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:19:59.587480 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643535ba-f41a-4ba0-a97c-f2091872dbf4 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:19:59.619102 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 538/1051] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:19:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:20:01.073990 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f732b-450e-4f5d-b06f-25f4441d9eb8 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:01.074544 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f732b-450e-4f5d-b06f-25f4441d9eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:01.074544 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f732b-450e-4f5d-b06f-25f4441d9eb8 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:01.076221 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 514/1052] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:20:01.081842 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f4948-c8f8-4c5d-ac29-3b818acaf093 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:01.082343 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f4948-c8f8-4c5d-ac29-3b818acaf093 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:01.082439 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f4948-c8f8-4c5d-ac29-3b818acaf093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:01.111752 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-789f4948-c8f8-4c5d-ac29-3b818acaf093 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:20:01.113904 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-789f4948-c8f8-4c5d-ac29-3b818acaf093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:20:01.199090 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 539/1053] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:20:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:20:01.464505 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f732b-450e-4f5d-b06f-25f4441d9eb8 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:01.567944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:01.573315 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f732b-450e-4f5d-b06f-25f4441d9eb8 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:01.614385 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a432686-df47-47f2-b301-220abc602812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:01.616025 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a432686-df47-47f2-b301-220abc602812 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:01.616539 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a432686-df47-47f2-b301-220abc602812 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:01.617026 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a432686-df47-47f2-b301-220abc602812 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:01.630245 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a432686-df47-47f2-b301-220abc602812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:20:01.635944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-8a432686-df47-47f2-b301-220abc602812 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:20:01.635944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:20:01.635944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:20:01.635944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:20:01.635944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:20:01.635944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:20:01.635944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:20:01.635944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:20:01.635944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:20:01.635944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:20:01.635944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:20:01.635944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:20:01.635944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:20:01.635944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:20:01.635944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:20:01.635944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:20:01.636986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:20:01.636986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:20:01.636986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:20:01.636986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:20:01.636986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:20:01.636986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:20:01.636986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:20:01.636986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:20:01.636986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:20:01.636986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:20:01.636986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:20:01.636986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:20:01.636986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:20:01.636986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:20:01.636986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:20:01.636986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:20:01.637893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:20:01.637893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:20:01.637893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:20:01.637893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:20:01.637893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:20:01.637893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:20:01.637893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:20:01.637893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:20:01.637893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:20:01.637893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:20:01.637893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:20:01.637893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:20:01.640555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 515/1054] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:20:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:20:01.647254 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f4948-c8f8-4c5d-ac29-3b818acaf093 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:01.650570 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:01.738159 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066f733-4ac9-4f50-8cff-a897895f077a None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:01.738367 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066f733-4ac9-4f50-8cff-a897895f077a None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:01.738652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066f733-4ac9-4f50-8cff-a897895f077a None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:01.741632 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 516/1055] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:20:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:20:01.747599 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98223bc0-1cb0-49f8-8440-b7430ad187c9 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:01.747881 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98223bc0-1cb0-49f8-8440-b7430ad187c9 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:01.748148 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98223bc0-1cb0-49f8-8440-b7430ad187c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:01.766650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f4948-c8f8-4c5d-ac29-3b818acaf093 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:01.766851 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-98223bc0-1cb0-49f8-8440-b7430ad187c9 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:20:01.768059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-98223bc0-1cb0-49f8-8440-b7430ad187c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:20:01.802524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a3de6-d0ab-46fc-9140-9bd0cd52129f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:01.803179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a3de6-d0ab-46fc-9140-9bd0cd52129f None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:01.803458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a3de6-d0ab-46fc-9140-9bd0cd52129f None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:01.803728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a3de6-d0ab-46fc-9140-9bd0cd52129f None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:01.804395 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a3de6-d0ab-46fc-9140-9bd0cd52129f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:01.804695 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a3de6-d0ab-46fc-9140-9bd0cd52129f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:01.806101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a3de6-d0ab-46fc-9140-9bd0cd52129f None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:01.819848 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 540/1056] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:20:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:01.821405 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a3de6-d0ab-46fc-9140-9bd0cd52129f None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:01.850252 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 517/1057] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:20:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 16:20:01.851474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427e361-b016-46ec-a850-a94e463b346e None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:01.851757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427e361-b016-46ec-a850-a94e463b346e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:01.852032 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427e361-b016-46ec-a850-a94e463b346e None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:01.853309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 518/1058] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:20:01.858931 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23a490-7cc9-4cd8-945b-9a5caa484363 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:01.859321 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23a490-7cc9-4cd8-945b-9a5caa484363 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:01.859592 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23a490-7cc9-4cd8-945b-9a5caa484363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:01.877994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-5c23a490-7cc9-4cd8-945b-9a5caa484363 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:20:01.879231 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-5c23a490-7cc9-4cd8-945b-9a5caa484363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:20:01.889050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:01.928420 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a3de6-d0ab-46fc-9140-9bd0cd52129f None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:01.954600 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 519/1059] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:20:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 16:20:01.965757 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03f1a6-eb1e-4d72-a69c-d8c36c510e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:01.966399 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03f1a6-eb1e-4d72-a69c-d8c36c510e3f None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:01.966685 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03f1a6-eb1e-4d72-a69c-d8c36c510e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:01.966951 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03f1a6-eb1e-4d72-a69c-d8c36c510e3f None admin] PATH_INFO: `/v3/users/244f50f13ec44620a6b01b198c6e95be` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:01.981100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03f1a6-eb1e-4d72-a69c-d8c36c510e3f None admin] RBAC: Authorizing `identity:get_user(user_id=244f50f13ec44620a6b01b198c6e95be)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:01.982546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03f1a6-eb1e-4d72-a69c-d8c36c510e3f None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:01.989008 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 541/1060] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:20:01 2022] GET /identity/v3/users/244f50f13ec44620a6b01b198c6e95be => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:20:01.990144 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23a490-7cc9-4cd8-945b-9a5caa484363 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:02.014203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:02.105420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23a490-7cc9-4cd8-945b-9a5caa484363 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:02.118277 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03f1a6-eb1e-4d72-a69c-d8c36c510e3f None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:02.143241 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a4a1c-841c-4b44-94f9-ede31fffd286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:02.143864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a4a1c-841c-4b44-94f9-ede31fffd286 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:02.144141 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a4a1c-841c-4b44-94f9-ede31fffd286 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:02.144412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a4a1c-841c-4b44-94f9-ede31fffd286 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:02.221026 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a4a1c-841c-4b44-94f9-ede31fffd286 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:02.221026 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a4a1c-841c-4b44-94f9-ede31fffd286 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:02.230069 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03f1a6-eb1e-4d72-a69c-d8c36c510e3f None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:02.242128 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:02.256869 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:02.269157 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d320e60-8e0e-4618-9eed-de6a1a44be3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:02.269787 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d320e60-8e0e-4618-9eed-de6a1a44be3e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:02.270058 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d320e60-8e0e-4618-9eed-de6a1a44be3e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:02.270326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d320e60-8e0e-4618-9eed-de6a1a44be3e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:02.281174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d320e60-8e0e-4618-9eed-de6a1a44be3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:20:02.286148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-1d320e60-8e0e-4618-9eed-de6a1a44be3e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 16:20:02.286148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:20:02.286148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:20:02.286148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:20:02.286148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:20:02.286148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:20:02.286148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:20:02.286148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:20:02.286148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:20:02.286148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:20:02.286148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:20:02.286148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:20:02.286148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:20:02.286148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:20:02.286148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:20:02.286148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:20:02.287137 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:20:02.287137 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:20:02.287137 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:20:02.287137 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:20:02.287137 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:20:02.287137 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:20:02.287137 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:20:02.287137 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:20:02.287137 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:20:02.287137 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:20:02.287137 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:20:02.287137 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:20:02.287137 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:20:02.287137 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:20:02.287137 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:20:02.287137 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:20:02.287996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:20:02.287996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:20:02.287996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:20:02.287996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:20:02.287996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:20:02.287996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:20:02.287996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:20:02.287996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:20:02.287996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:20:02.287996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:20:02.287996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 16:20:02.287996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:20:02.287996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 542/1061] 10.222.0.55 () {56 vars in 1120 bytes} [Tue Oct 4 16:20:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:20:02.288729 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d320e60-8e0e-4618-9eed-de6a1a44be3e None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:02.327769 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 520/1062] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:20:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 16:20:02.329134 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a4a1c-841c-4b44-94f9-ede31fffd286 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:02.392081 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d320e60-8e0e-4618-9eed-de6a1a44be3e None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:02.429544 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d54c3-577c-490f-8ff1-94e02d160dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:02.430157 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d54c3-577c-490f-8ff1-94e02d160dfc None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:02.430424 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d54c3-577c-490f-8ff1-94e02d160dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:02.430684 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d54c3-577c-490f-8ff1-94e02d160dfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:02.433257 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a4a1c-841c-4b44-94f9-ede31fffd286 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:02.456067 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:02.471274 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d95c6-9b0d-4c2a-a7d9-0a92ed781aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:02.471887 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d95c6-9b0d-4c2a-a7d9-0a92ed781aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:02.472165 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d95c6-9b0d-4c2a-a7d9-0a92ed781aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:02.472551 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d95c6-9b0d-4c2a-a7d9-0a92ed781aa3 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:02.473098 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d95c6-9b0d-4c2a-a7d9-0a92ed781aa3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:02.473391 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d95c6-9b0d-4c2a-a7d9-0a92ed781aa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:02.474785 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d95c6-9b0d-4c2a-a7d9-0a92ed781aa3 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:02.489120 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 521/1063] 10.222.0.55 () {56 vars in 1115 bytes} [Tue Oct 4 16:20:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:02.489120 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d95c6-9b0d-4c2a-a7d9-0a92ed781aa3 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:02.489803 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:02.506449 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d54c3-577c-490f-8ff1-94e02d160dfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:02.507857 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d54c3-577c-490f-8ff1-94e02d160dfc None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:02.596287 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d95c6-9b0d-4c2a-a7d9-0a92ed781aa3 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:02.623771 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 543/1064] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:20:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 16:20:02.624657 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d54c3-577c-490f-8ff1-94e02d160dfc None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:02.634903 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe539042-2b3c-42f3-8cd7-50d91267f3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:02.635983 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe539042-2b3c-42f3-8cd7-50d91267f3b6 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:02.636262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe539042-2b3c-42f3-8cd7-50d91267f3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:02.636841 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe539042-2b3c-42f3-8cd7-50d91267f3b6 None admin] PATH_INFO: `/v3/projects/478a9d2ceaf74552b5afb8fe408f3658` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:02.637994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe539042-2b3c-42f3-8cd7-50d91267f3b6 None admin] RBAC: Authorizing `identity:get_project(project_id=478a9d2ceaf74552b5afb8fe408f3658)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:02.639454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe539042-2b3c-42f3-8cd7-50d91267f3b6 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:02.641147 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 522/1065] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:20:02 2022] GET /identity/v3/projects/478a9d2ceaf74552b5afb8fe408f3658 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:02.641907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe539042-2b3c-42f3-8cd7-50d91267f3b6 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:02.694777 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:02.712719 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:02.730957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d54c3-577c-490f-8ff1-94e02d160dfc None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:02.750480 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe539042-2b3c-42f3-8cd7-50d91267f3b6 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:02.766876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f8f3b-888c-4787-815c-9da220f4e4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:02.767443 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f8f3b-888c-4787-815c-9da220f4e4a7 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:02.767714 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f8f3b-888c-4787-815c-9da220f4e4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:02.767980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f8f3b-888c-4787-815c-9da220f4e4a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:02.778610 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f8f3b-888c-4787-815c-9da220f4e4a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:02.782709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f8f3b-888c-4787-815c-9da220f4e4a7 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:02.790892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced28bc-9782-4a74-8545-5658a2a5ff78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:02.791824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced28bc-9782-4a74-8545-5658a2a5ff78 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:02.792203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced28bc-9782-4a74-8545-5658a2a5ff78 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:02.792583 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced28bc-9782-4a74-8545-5658a2a5ff78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:02.800409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-bb9f8f3b-888c-4787-815c-9da220f4e4a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:20:02.800409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:20:02.800409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:20:02.800409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:20:02.800409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:20:02.800409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:20:02.800409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:20:02.800409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:20:02.800409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:20:02.800409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:20:02.800409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:20:02.800409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:20:02.800409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:20:02.800409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:20:02.800409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:20:02.800409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:20:02.801957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:20:02.801957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:20:02.801957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:20:02.801957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:20:02.801957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:20:02.801957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:20:02.801957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:20:02.801957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:20:02.801957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:20:02.801957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:20:02.801957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:20:02.801957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:20:02.801957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:20:02.801957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:20:02.801957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:20:02.801957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:20:02.801957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:20:02.803726 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:20:02.803726 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:20:02.803726 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:20:02.803726 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 544/1066] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:20:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:20:02.803726 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f8f3b-888c-4787-815c-9da220f4e4a7 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:02.809826 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced28bc-9782-4a74-8545-5658a2a5ff78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:02.811337 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced28bc-9782-4a74-8545-5658a2a5ff78 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:02.827693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-cced28bc-9782-4a74-8545-5658a2a5ff78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:20:02.827693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:20:02.827693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:20:02.827693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:20:02.827693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:20:02.827693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:20:02.827693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:20:02.827693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:20:02.827693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:20:02.827693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:20:02.827693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:20:02.827693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:20:02.827693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:20:02.827693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:20:02.827693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:20:02.827693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:20:02.829044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:20:02.829044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:20:02.829044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:20:02.829044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:20:02.829044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:20:02.829044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:20:02.829044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:20:02.829044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:20:02.829044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:20:02.829044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:20:02.829044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:20:02.829044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:20:02.829044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:20:02.829044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:20:02.829044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:20:02.829044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:20:02.829044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:20:02.829994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:20:02.829994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:20:02.829994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:20:02.829994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 523/1067] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:20:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:20:02.829994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced28bc-9782-4a74-8545-5658a2a5ff78 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:02.921959 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f8f3b-888c-4787-815c-9da220f4e4a7 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:02.962995 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4f42d-e1c1-44e8-a510-380db3c40853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:02.964601 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4f42d-e1c1-44e8-a510-380db3c40853 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:02.964601 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4f42d-e1c1-44e8-a510-380db3c40853 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:02.964813 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4f42d-e1c1-44e8-a510-380db3c40853 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:02.965953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4f42d-e1c1-44e8-a510-380db3c40853 None admin] RBAC: Adding query filter params (role.id=066f46534195417295e63a5316632eae, scope.project.id=478a9d2ceaf74552b5afb8fe408f3658, user.id=244f50f13ec44620a6b01b198c6e95be) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:02.966460 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4f42d-e1c1-44e8-a510-380db3c40853 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:02.968053 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced28bc-9782-4a74-8545-5658a2a5ff78 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:02.969014 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4f42d-e1c1-44e8-a510-380db3c40853 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:02.970540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:02.973223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:02.984163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 545/1068] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:20:02 2022] GET /identity/v3/role_assignments?user.id=244f50f13ec44620a6b01b198c6e95be&scope.project.id=478a9d2ceaf74552b5afb8fe408f3658&role.id=066f46534195417295e63a5316632eae => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:02.984163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4f42d-e1c1-44e8-a510-380db3c40853 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:03.026672 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c79b97-4325-41cc-9612-90e5acfdcf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:03.027906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c79b97-4325-41cc-9612-90e5acfdcf0d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:03.028181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c79b97-4325-41cc-9612-90e5acfdcf0d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:03.028450 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c79b97-4325-41cc-9612-90e5acfdcf0d None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:03.029118 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c79b97-4325-41cc-9612-90e5acfdcf0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:03.029416 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c79b97-4325-41cc-9612-90e5acfdcf0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:03.031686 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c79b97-4325-41cc-9612-90e5acfdcf0d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:03.051582 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 524/1069] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:03.057530 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c79b97-4325-41cc-9612-90e5acfdcf0d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:03.111852 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4f42d-e1c1-44e8-a510-380db3c40853 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:03.160438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602947c2-5755-49f2-bec1-8b8686477d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:03.161149 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602947c2-5755-49f2-bec1-8b8686477d7d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:03.163032 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602947c2-5755-49f2-bec1-8b8686477d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:03.163032 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602947c2-5755-49f2-bec1-8b8686477d7d None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:03.163032 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602947c2-5755-49f2-bec1-8b8686477d7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:03.163032 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602947c2-5755-49f2-bec1-8b8686477d7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:03.164818 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602947c2-5755-49f2-bec1-8b8686477d7d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:03.180883 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 546/1070] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:03.194082 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c79b97-4325-41cc-9612-90e5acfdcf0d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:03.267891 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84233eaf-2f33-4324-907d-2412283e7388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:03.268340 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84233eaf-2f33-4324-907d-2412283e7388 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:03.268621 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84233eaf-2f33-4324-907d-2412283e7388 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:03.268883 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84233eaf-2f33-4324-907d-2412283e7388 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:03.278943 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84233eaf-2f33-4324-907d-2412283e7388 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:03.280371 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84233eaf-2f33-4324-907d-2412283e7388 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:03.293662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-84233eaf-2f33-4324-907d-2412283e7388 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 16:20:03.293662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:20:03.293662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:20:03.293662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:20:03.293662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:20:03.293662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:20:03.293662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:20:03.293662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:20:03.293662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:20:03.293662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:20:03.293662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:20:03.293662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:20:03.293662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:20:03.293662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:20:03.293662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:20:03.293662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:20:03.295503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:20:03.295503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:20:03.295503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:20:03.295503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:20:03.295503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:20:03.295503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:20:03.295503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:20:03.295503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:20:03.295503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:20:03.295503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:20:03.295503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:20:03.295503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:20:03.295503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:20:03.295503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:20:03.295503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:20:03.295503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:20:03.295503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:20:03.295503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:20:03.296700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:20:03.296700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:20:03.296700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:20:03.296700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:20:03.296700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:20:03.296700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:20:03.296700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:20:03.296700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:20:03.296700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 16:20:03.296700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:20:03.296700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 525/1071] 10.222.0.55 () {56 vars in 1093 bytes} [Tue Oct 4 16:20:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:20:03.304289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602947c2-5755-49f2-bec1-8b8686477d7d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:03.380791 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:03.428592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602947c2-5755-49f2-bec1-8b8686477d7d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:03.474106 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb65fd-43fe-464c-a632-411187cacff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:03.474734 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb65fd-43fe-464c-a632-411187cacff9 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:03.475050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb65fd-43fe-464c-a632-411187cacff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:03.475329 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb65fd-43fe-464c-a632-411187cacff9 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:03.476070 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb65fd-43fe-464c-a632-411187cacff9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:03.476377 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb65fd-43fe-464c-a632-411187cacff9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:03.478215 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb65fd-43fe-464c-a632-411187cacff9 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:03.501578 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 547/1072] 10.222.0.55 () {56 vars in 1133 bytes} [Tue Oct 4 16:20:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:03.508081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84233eaf-2f33-4324-907d-2412283e7388 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:03.538320 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:03.631077 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84233eaf-2f33-4324-907d-2412283e7388 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:03.669738 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c71c5-cf5d-4063-801a-c0949d4371ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:03.670397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c71c5-cf5d-4063-801a-c0949d4371ce None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:03.670757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c71c5-cf5d-4063-801a-c0949d4371ce None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:03.671048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c71c5-cf5d-4063-801a-c0949d4371ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:03.682844 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c71c5-cf5d-4063-801a-c0949d4371ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:03.684384 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c71c5-cf5d-4063-801a-c0949d4371ce None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:03.701483 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-aa2c71c5-cf5d-4063-801a-c0949d4371ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:20:03.701483 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:20:03.701483 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:20:03.701483 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:20:03.701483 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:20:03.701483 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:20:03.701483 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:20:03.701483 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:20:03.701483 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:20:03.701483 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:20:03.701483 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:20:03.701483 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:20:03.701483 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:20:03.701483 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:20:03.701483 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:20:03.701483 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:20:03.702651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:20:03.702651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:20:03.702651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:20:03.702651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:20:03.702651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:20:03.702651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:20:03.702651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:20:03.702651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:20:03.702651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:20:03.702651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:20:03.702651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:20:03.702651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:20:03.702651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:20:03.702651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:20:03.702651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:20:03.702651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:20:03.702651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:20:03.703900 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:20:03.703900 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:20:03.703900 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:20:03.703900 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 526/1073] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:20:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:20:03.708879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb65fd-43fe-464c-a632-411187cacff9 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:03.816119 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb65fd-43fe-464c-a632-411187cacff9 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:03.833590 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:03.850867 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277b559-0ac2-472a-bc36-62826bffc0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:03.851512 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277b559-0ac2-472a-bc36-62826bffc0dc None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:03.851788 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277b559-0ac2-472a-bc36-62826bffc0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:03.852055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277b559-0ac2-472a-bc36-62826bffc0dc None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:03.852699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277b559-0ac2-472a-bc36-62826bffc0dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:03.852998 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277b559-0ac2-472a-bc36-62826bffc0dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:03.854453 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277b559-0ac2-472a-bc36-62826bffc0dc None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:03.866127 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 548/1074] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:03.872273 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c71c5-cf5d-4063-801a-c0949d4371ce None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:03.951384 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:03.977633 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c71c5-cf5d-4063-801a-c0949d4371ce None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:04.012335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacaab7f-b422-4f35-8f6d-6048b49e5edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:04.012964 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacaab7f-b422-4f35-8f6d-6048b49e5edf None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:04.013240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacaab7f-b422-4f35-8f6d-6048b49e5edf None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:04.013513 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacaab7f-b422-4f35-8f6d-6048b49e5edf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:04.020391 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacaab7f-b422-4f35-8f6d-6048b49e5edf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:04.021841 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacaab7f-b422-4f35-8f6d-6048b49e5edf None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:04.033219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-eacaab7f-b422-4f35-8f6d-6048b49e5edf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:20:04.033219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:20:04.033219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:20:04.033219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:20:04.033219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:20:04.033219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:20:04.033219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:20:04.033219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:20:04.033219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:20:04.033219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:20:04.033219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:20:04.033219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:20:04.033219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:20:04.033219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:20:04.033219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:20:04.034219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:20:04.034219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:20:04.034219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:20:04.034219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:20:04.034219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:20:04.034219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:20:04.034219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:20:04.034219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:20:04.034219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:20:04.034219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:20:04.034219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:20:04.034219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:20:04.034219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:20:04.034219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:20:04.034219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:20:04.034219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:20:04.034219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:20:04.035720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:20:04.035720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:20:04.035720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:20:04.035720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:20:04.035720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:20:04.035720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:20:04.035720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:20:04.035720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:20:04.035720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 527/1075] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:20:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:20:04.040369 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277b559-0ac2-472a-bc36-62826bffc0dc None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:04.143484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277b559-0ac2-472a-bc36-62826bffc0dc None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:04.185966 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a14dc4-2d7d-4f9e-a956-8c3f0a6f5f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:04.186912 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a14dc4-2d7d-4f9e-a956-8c3f0a6f5f69 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:04.187304 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a14dc4-2d7d-4f9e-a956-8c3f0a6f5f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:04.187692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a14dc4-2d7d-4f9e-a956-8c3f0a6f5f69 None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:04.188455 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a14dc4-2d7d-4f9e-a956-8c3f0a6f5f69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:04.188829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a14dc4-2d7d-4f9e-a956-8c3f0a6f5f69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:04.190267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a14dc4-2d7d-4f9e-a956-8c3f0a6f5f69 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:04.204133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 549/1076] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:20:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:04.211184 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacaab7f-b422-4f35-8f6d-6048b49e5edf None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:04.328030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacaab7f-b422-4f35-8f6d-6048b49e5edf None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:04.364158 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f9acc-4cd8-4890-93d3-3f7ff217c62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:04.364817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f9acc-4cd8-4890-93d3-3f7ff217c62e None admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:04.365088 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f9acc-4cd8-4890-93d3-3f7ff217c62e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:04.365354 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f9acc-4cd8-4890-93d3-3f7ff217c62e None admin] PATH_INFO: `/v3/projects/e480e782c4fa403a913ca7179db0843b/users/6cdee0584fe045028a44c385d032d2c7/roles/b557a16f80704a549ace1ef1a84f3086` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:04.367677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f9acc-4cd8-4890-93d3-3f7ff217c62e None admin] RBAC: Authorizing `identity:create_grant(project_id=e480e782c4fa403a913ca7179db0843b, user_id=6cdee0584fe045028a44c385d032d2c7, role_id=b557a16f80704a549ace1ef1a84f3086)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:04.369109 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f9acc-4cd8-4890-93d3-3f7ff217c62e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:04.371541 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:04.383995 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 528/1077] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Oct 4 16:20:04 2022] PUT /identity/v3/projects/e480e782c4fa403a913ca7179db0843b/users/6cdee0584fe045028a44c385d032d2c7/roles/b557a16f80704a549ace1ef1a84f3086 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:20:05.141511 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e93494-397d-4463-a983-9991ab9a8d69 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:05.141746 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e93494-397d-4463-a983-9991ab9a8d69 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:05.142031 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e93494-397d-4463-a983-9991ab9a8d69 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:05.143572 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 550/1078] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:20:05.149440 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74a9f1-4483-49a2-a57f-bc7cbc9d6a84 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:05.149800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74a9f1-4483-49a2-a57f-bc7cbc9d6a84 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:05.150157 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74a9f1-4483-49a2-a57f-bc7cbc9d6a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:05.169900 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-1b74a9f1-4483-49a2-a57f-bc7cbc9d6a84 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:20:05.171116 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-1b74a9f1-4483-49a2-a57f-bc7cbc9d6a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:20:05.242906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 529/1079] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:20:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 16:20:05.503715 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e93494-397d-4463-a983-9991ab9a8d69 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:05.559659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:05.626194 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e93494-397d-4463-a983-9991ab9a8d69 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:05.665661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5f1fc-02f8-45c8-bc5f-5a234389487f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:05.666434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5f1fc-02f8-45c8-bc5f-5a234389487f None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:05.666840 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5f1fc-02f8-45c8-bc5f-5a234389487f None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:05.667152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5f1fc-02f8-45c8-bc5f-5a234389487f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:05.679990 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf5f1fc-02f8-45c8-bc5f-5a234389487f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:20:05.686848 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-aaf5f1fc-02f8-45c8-bc5f-5a234389487f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:20:05.686848 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:20:05.686848 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:20:05.686848 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:20:05.686848 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:20:05.686848 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:20:05.686848 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:20:05.686848 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:20:05.686848 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:20:05.686848 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:20:05.686848 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:20:05.686848 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:20:05.686848 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:20:05.686848 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:20:05.686848 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:20:05.686848 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:20:05.687855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:20:05.687855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:20:05.687855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:20:05.687855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:20:05.687855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:20:05.687855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:20:05.687855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:20:05.687855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:20:05.687855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:20:05.687855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:20:05.687855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:20:05.687855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:20:05.687855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:20:05.687855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:20:05.687855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:20:05.687855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:20:05.688709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:20:05.688709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:20:05.688709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:20:05.688709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:20:05.688709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:20:05.688709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:20:05.688709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:20:05.688709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:20:05.688709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:20:05.688709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:20:05.688709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:20:05.688709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:20:05.688709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 551/1080] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:20:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:20:05.695004 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74a9f1-4483-49a2-a57f-bc7cbc9d6a84 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:05.805140 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74a9f1-4483-49a2-a57f-bc7cbc9d6a84 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:05.830103 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:05.850625 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435521be-6667-4e4e-ab8a-aa8ebbc6927a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:05.851544 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435521be-6667-4e4e-ab8a-aa8ebbc6927a None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:05.851822 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435521be-6667-4e4e-ab8a-aa8ebbc6927a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:05.852090 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435521be-6667-4e4e-ab8a-aa8ebbc6927a None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:05.852739 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435521be-6667-4e4e-ab8a-aa8ebbc6927a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:05.853031 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435521be-6667-4e4e-ab8a-aa8ebbc6927a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:05.854469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435521be-6667-4e4e-ab8a-aa8ebbc6927a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:05.863573 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 530/1081] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:20:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:05.869709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5f1fc-02f8-45c8-bc5f-5a234389487f None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:05.973864 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:05.978194 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5f1fc-02f8-45c8-bc5f-5a234389487f None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:06.016692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e31de-c350-4137-b6e3-8e062f258152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:06.017341 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e31de-c350-4137-b6e3-8e062f258152 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:06.017627 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e31de-c350-4137-b6e3-8e062f258152 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:06.017891 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e31de-c350-4137-b6e3-8e062f258152 None admin] PATH_INFO: `/v3/users/244f50f13ec44620a6b01b198c6e95be` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:06.019199 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e31de-c350-4137-b6e3-8e062f258152 None admin] RBAC: Authorizing `identity:get_user(user_id=244f50f13ec44620a6b01b198c6e95be)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:06.020642 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e31de-c350-4137-b6e3-8e062f258152 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:06.022514 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 552/1082] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:20:05 2022] GET /identity/v3/users/244f50f13ec44620a6b01b198c6e95be => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:06.028419 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435521be-6667-4e4e-ab8a-aa8ebbc6927a None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:06.142775 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435521be-6667-4e4e-ab8a-aa8ebbc6927a None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:06.184662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149ca82-cf88-419d-b94a-a9a981c1f1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:06.185316 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149ca82-cf88-419d-b94a-a9a981c1f1de None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:06.185599 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149ca82-cf88-419d-b94a-a9a981c1f1de None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:06.185855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149ca82-cf88-419d-b94a-a9a981c1f1de None admin] PATH_INFO: `/v3/projects/478a9d2ceaf74552b5afb8fe408f3658` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:06.187025 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149ca82-cf88-419d-b94a-a9a981c1f1de None admin] RBAC: Authorizing `identity:get_project(project_id=478a9d2ceaf74552b5afb8fe408f3658)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:06.188469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149ca82-cf88-419d-b94a-a9a981c1f1de None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:06.190158 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 531/1083] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:20:06 2022] GET /identity/v3/projects/478a9d2ceaf74552b5afb8fe408f3658 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:06.196305 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e31de-c350-4137-b6e3-8e062f258152 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:06.306427 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e31de-c350-4137-b6e3-8e062f258152 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:06.345116 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7711e3-7f67-4125-846a-96d84e6e7f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:06.345795 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7711e3-7f67-4125-846a-96d84e6e7f8a None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:06.346072 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7711e3-7f67-4125-846a-96d84e6e7f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:06.346343 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7711e3-7f67-4125-846a-96d84e6e7f8a None admin] PATH_INFO: `/v3/projects/478a9d2ceaf74552b5afb8fe408f3658/users/244f50f13ec44620a6b01b198c6e95be/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:06.348568 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7711e3-7f67-4125-846a-96d84e6e7f8a None admin] RBAC: Authorizing `identity:create_grant(project_id=478a9d2ceaf74552b5afb8fe408f3658, user_id=244f50f13ec44620a6b01b198c6e95be, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:06.350008 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7711e3-7f67-4125-846a-96d84e6e7f8a None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:06.366401 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 553/1084] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Oct 4 16:20:06 2022] PUT /identity/v3/projects/478a9d2ceaf74552b5afb8fe408f3658/users/244f50f13ec44620a6b01b198c6e95be/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:20:06.566586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e9fe2-35d0-45e6-b38f-e1c38c904bbe None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:06.567131 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e9fe2-35d0-45e6-b38f-e1c38c904bbe None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:06.567211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e9fe2-35d0-45e6-b38f-e1c38c904bbe None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:06.568519 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 532/1085] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:20:06.574525 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebfdff-ab1c-4594-ab09-28fd79d2f027 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:06.575121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebfdff-ab1c-4594-ab09-28fd79d2f027 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:06.575202 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebfdff-ab1c-4594-ab09-28fd79d2f027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:06.594960 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-48ebfdff-ab1c-4594-ab09-28fd79d2f027 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:20:06.596278 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-48ebfdff-ab1c-4594-ab09-28fd79d2f027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:20:06.623134 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:06.677196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 554/1086] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:20:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:20:06.939268 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e9fe2-35d0-45e6-b38f-e1c38c904bbe None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:07.006359 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:07.066646 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e9fe2-35d0-45e6-b38f-e1c38c904bbe None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:07.104857 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f8d31-be53-4c28-8691-227ea55557ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:07.105507 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f8d31-be53-4c28-8691-227ea55557ed None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:07.105780 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f8d31-be53-4c28-8691-227ea55557ed None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:07.106046 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f8d31-be53-4c28-8691-227ea55557ed None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:07.117704 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f8d31-be53-4c28-8691-227ea55557ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:20:07.122680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-f15f8d31-be53-4c28-8691-227ea55557ed None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 16:20:07.122680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:20:07.122680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:20:07.122680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:20:07.122680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:20:07.122680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:20:07.122680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:20:07.122680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:20:07.122680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:20:07.122680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:20:07.122680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:20:07.122680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:20:07.122680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:20:07.122680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:20:07.122680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:20:07.122680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:20:07.123688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:20:07.123688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:20:07.123688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:20:07.123688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:20:07.123688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:20:07.123688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:20:07.123688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:20:07.123688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:20:07.123688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:20:07.123688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:20:07.123688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:20:07.123688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:20:07.123688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:20:07.123688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:20:07.123688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:20:07.123688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:20:07.124533 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:20:07.124533 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:20:07.124533 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:20:07.124533 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:20:07.124533 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:20:07.124533 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:20:07.124533 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:20:07.124533 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:20:07.124533 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:20:07.124533 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:20:07.124533 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 16:20:07.124533 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:20:07.124533 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 533/1087] 10.222.0.55 () {56 vars in 1120 bytes} [Tue Oct 4 16:20:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:20:07.130191 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebfdff-ab1c-4594-ab09-28fd79d2f027 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:07.244233 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebfdff-ab1c-4594-ab09-28fd79d2f027 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:07.286308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0294d-b983-4c0c-8fd8-01e03d8a1058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:07.286936 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0294d-b983-4c0c-8fd8-01e03d8a1058 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:07.287238 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0294d-b983-4c0c-8fd8-01e03d8a1058 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:07.287510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0294d-b983-4c0c-8fd8-01e03d8a1058 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:07.288188 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0294d-b983-4c0c-8fd8-01e03d8a1058 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:07.288492 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0294d-b983-4c0c-8fd8-01e03d8a1058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:07.289918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0294d-b983-4c0c-8fd8-01e03d8a1058 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:07.299081 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 555/1088] 10.222.0.55 () {56 vars in 1115 bytes} [Tue Oct 4 16:20:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:07.305157 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f8d31-be53-4c28-8691-227ea55557ed None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:07.413438 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f8d31-be53-4c28-8691-227ea55557ed None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:07.428880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:07.457147 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ec680-5d5b-4f38-a4ed-7377ff65657f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:07.457800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ec680-5d5b-4f38-a4ed-7377ff65657f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:07.458075 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ec680-5d5b-4f38-a4ed-7377ff65657f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:07.458341 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ec680-5d5b-4f38-a4ed-7377ff65657f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:07.469875 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ec680-5d5b-4f38-a4ed-7377ff65657f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:07.471609 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ec680-5d5b-4f38-a4ed-7377ff65657f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:07.487817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-579ec680-5d5b-4f38-a4ed-7377ff65657f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:20:07.487817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:20:07.487817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:20:07.487817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:20:07.487817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:20:07.487817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:20:07.487817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:20:07.487817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:20:07.487817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:20:07.487817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:20:07.487817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:20:07.487817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:20:07.487817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:20:07.487817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:20:07.487817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:20:07.487817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:20:07.492955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:20:07.492955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:20:07.492955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:20:07.492955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:20:07.492955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:20:07.492955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:20:07.492955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:20:07.492955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:20:07.492955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:20:07.492955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:20:07.492955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:20:07.492955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:20:07.492955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:20:07.492955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:20:07.492955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:20:07.492955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:20:07.492955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:20:07.495818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:20:07.495818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:20:07.495818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:20:07.495818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 534/1089] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:20:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:20:07.499465 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0294d-b983-4c0c-8fd8-01e03d8a1058 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:07.523523 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:07.618199 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0294d-b983-4c0c-8fd8-01e03d8a1058 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:07.656087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c970eb6-3ff7-4f4b-856b-bfc2890b1445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:07.656748 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c970eb6-3ff7-4f4b-856b-bfc2890b1445 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:07.657037 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c970eb6-3ff7-4f4b-856b-bfc2890b1445 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:07.657304 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c970eb6-3ff7-4f4b-856b-bfc2890b1445 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:07.657950 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c970eb6-3ff7-4f4b-856b-bfc2890b1445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:07.658249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c970eb6-3ff7-4f4b-856b-bfc2890b1445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:07.659656 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c970eb6-3ff7-4f4b-856b-bfc2890b1445 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:07.672925 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 556/1090] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:07.678915 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ec680-5d5b-4f38-a4ed-7377ff65657f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:07.789890 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ec680-5d5b-4f38-a4ed-7377ff65657f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:07.828096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09504dec-34f7-4250-b860-8a94d71d5b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:07.828736 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09504dec-34f7-4250-b860-8a94d71d5b9d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:07.829050 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09504dec-34f7-4250-b860-8a94d71d5b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:07.829291 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09504dec-34f7-4250-b860-8a94d71d5b9d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:07.837683 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09504dec-34f7-4250-b860-8a94d71d5b9d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:07.839281 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09504dec-34f7-4250-b860-8a94d71d5b9d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:07.851110 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-09504dec-34f7-4250-b860-8a94d71d5b9d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 16:20:07.851110 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:20:07.851110 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:20:07.851110 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:20:07.851110 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:20:07.851110 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:20:07.851110 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:20:07.851110 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:20:07.851110 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:20:07.851110 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:20:07.851110 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:20:07.851110 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:20:07.851110 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:20:07.851110 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:20:07.851110 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:20:07.851110 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:20:07.852125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:20:07.852125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:20:07.852125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:20:07.852125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:20:07.852125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:20:07.852125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:20:07.852125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:20:07.852125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:20:07.852125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:20:07.852125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:20:07.852125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:20:07.852125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:20:07.852125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:20:07.852125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:20:07.852125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:20:07.852125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:20:07.852125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:20:07.852125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:20:07.853093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:20:07.853093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:20:07.853093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:20:07.853093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:20:07.853093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:20:07.853093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:20:07.853093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:20:07.853093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:20:07.853093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 16:20:07.853093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:20:07.853093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 535/1091] 10.222.0.55 () {56 vars in 1093 bytes} [Tue Oct 4 16:20:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:20:07.858853 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c970eb6-3ff7-4f4b-856b-bfc2890b1445 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:07.951447 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:07.974940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c970eb6-3ff7-4f4b-856b-bfc2890b1445 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:08.014579 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad55ee-a422-41d1-b3f9-65c52e7ea3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:08.015236 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad55ee-a422-41d1-b3f9-65c52e7ea3e3 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:08.015514 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad55ee-a422-41d1-b3f9-65c52e7ea3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:08.015786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad55ee-a422-41d1-b3f9-65c52e7ea3e3 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:08.016521 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad55ee-a422-41d1-b3f9-65c52e7ea3e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:08.016825 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad55ee-a422-41d1-b3f9-65c52e7ea3e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:08.018276 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad55ee-a422-41d1-b3f9-65c52e7ea3e3 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:08.036405 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 557/1092] 10.222.0.55 () {56 vars in 1133 bytes} [Tue Oct 4 16:20:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:08.046395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09504dec-34f7-4250-b860-8a94d71d5b9d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:08.088976 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:08.170118 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09504dec-34f7-4250-b860-8a94d71d5b9d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:08.210802 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ff75e-5beb-4582-84c2-1c2add709730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:08.211449 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ff75e-5beb-4582-84c2-1c2add709730 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:08.211723 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ff75e-5beb-4582-84c2-1c2add709730 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:08.211997 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ff75e-5beb-4582-84c2-1c2add709730 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:08.294863 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ff75e-5beb-4582-84c2-1c2add709730 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:08.296360 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ff75e-5beb-4582-84c2-1c2add709730 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:08.322897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:08.408852 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 536/1093] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:20:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 16:20:08.415379 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad55ee-a422-41d1-b3f9-65c52e7ea3e3 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:08.539230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365b5a0-b807-470d-ab02-b5d404610ad4 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:08.539540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365b5a0-b807-470d-ab02-b5d404610ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:08.539812 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365b5a0-b807-470d-ab02-b5d404610ad4 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:08.540309 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad55ee-a422-41d1-b3f9-65c52e7ea3e3 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:08.541164 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 537/1094] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:20:08.547295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f8eea-3d26-4dfb-9d99-f1cebb8e38b2 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:08.547558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f8eea-3d26-4dfb-9d99-f1cebb8e38b2 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:08.547837 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f8eea-3d26-4dfb-9d99-f1cebb8e38b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:08.565773 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-b11f8eea-3d26-4dfb-9d99-f1cebb8e38b2 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:20:08.566958 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-b11f8eea-3d26-4dfb-9d99-f1cebb8e38b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:20:08.578648 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2a72f-4f1c-4994-a3df-8528569d35c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:08.579155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2a72f-4f1c-4994-a3df-8528569d35c2 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:08.579432 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2a72f-4f1c-4994-a3df-8528569d35c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:08.579705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2a72f-4f1c-4994-a3df-8528569d35c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:08.582709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:08.591714 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2a72f-4f1c-4994-a3df-8528569d35c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:08.593181 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2a72f-4f1c-4994-a3df-8528569d35c2 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:08.608426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-69f2a72f-4f1c-4994-a3df-8528569d35c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:20:08.608426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:20:08.608426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:20:08.608426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:20:08.608426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:20:08.608426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:20:08.608426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:20:08.608426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:20:08.608426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:20:08.608426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:20:08.608426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:20:08.608426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:20:08.608426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:20:08.608426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:20:08.608426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:20:08.608426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:20:08.609463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:20:08.609463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:20:08.609463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:20:08.609463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:20:08.609463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:20:08.609463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:20:08.609463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:20:08.609463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:20:08.609463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:20:08.609463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:20:08.609463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:20:08.609463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:20:08.609463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:20:08.609463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:20:08.609463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:20:08.609463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:20:08.609463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:20:08.610361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:20:08.610361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:20:08.610361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:20:08.610361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 558/1095] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:20:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:20:08.616046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2a72f-4f1c-4994-a3df-8528569d35c2 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:08.649747 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 538/1096] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:20:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 16:20:08.735540 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2a72f-4f1c-4994-a3df-8528569d35c2 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:08.777079 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855e83b-f531-4184-8959-d2adf797f299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:08.777697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855e83b-f531-4184-8959-d2adf797f299 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:08.777978 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855e83b-f531-4184-8959-d2adf797f299 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:08.778246 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855e83b-f531-4184-8959-d2adf797f299 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:08.778921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855e83b-f531-4184-8959-d2adf797f299 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:08.779251 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855e83b-f531-4184-8959-d2adf797f299 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:08.780637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855e83b-f531-4184-8959-d2adf797f299 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:08.793248 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 559/1097] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:08.799789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f8eea-3d26-4dfb-9d99-f1cebb8e38b2 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:08.861705 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:08.914452 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f8eea-3d26-4dfb-9d99-f1cebb8e38b2 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:08.933785 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855e83b-f531-4184-8959-d2adf797f299 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:08.952584 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce92ea-6f26-428d-8c1c-cae31c22283e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:08.953242 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce92ea-6f26-428d-8c1c-cae31c22283e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:08.953675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce92ea-6f26-428d-8c1c-cae31c22283e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:08.954263 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce92ea-6f26-428d-8c1c-cae31c22283e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:08.961821 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce92ea-6f26-428d-8c1c-cae31c22283e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:08.963381 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce92ea-6f26-428d-8c1c-cae31c22283e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:08.975475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-48ce92ea-6f26-428d-8c1c-cae31c22283e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:20:08.975475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:20:08.975475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:20:08.975475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:20:08.975475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:20:08.975475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:20:08.975475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:20:08.975475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:20:08.975475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:20:08.975475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:20:08.975475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:20:08.975475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:20:08.975475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:20:08.975475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:20:08.975475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:20:08.976503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:20:08.976503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:20:08.976503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:20:08.976503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:20:08.976503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:20:08.976503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:20:08.976503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:20:08.976503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:20:08.976503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:20:08.976503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:20:08.976503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:20:08.976503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:20:08.976503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:20:08.976503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:20:08.976503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:20:08.976503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:20:08.976503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:20:08.977404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:20:08.977404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:20:08.977404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:20:08.977404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:20:08.977404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:20:08.977404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:20:08.977404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:20:08.977404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:20:08.977404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 539/1098] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:20:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:20:08.982844 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce92ea-6f26-428d-8c1c-cae31c22283e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:08.988748 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:09.044184 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855e83b-f531-4184-8959-d2adf797f299 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:09.089148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12897b96-b05c-470f-a288-0ada9964d66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:09.089817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12897b96-b05c-470f-a288-0ada9964d66b None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:09.090087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12897b96-b05c-470f-a288-0ada9964d66b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:09.090345 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12897b96-b05c-470f-a288-0ada9964d66b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:09.101998 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12897b96-b05c-470f-a288-0ada9964d66b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:20:09.107113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-12897b96-b05c-470f-a288-0ada9964d66b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:20:09.107113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:20:09.107113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:20:09.107113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:20:09.107113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:20:09.107113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:20:09.107113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:20:09.107113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:20:09.107113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:20:09.107113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:20:09.107113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:20:09.107113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:20:09.107113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:20:09.107113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:20:09.107113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:20:09.107113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:20:09.108152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:20:09.108152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:20:09.108152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:20:09.108152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:20:09.108152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:20:09.108152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:20:09.108152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:20:09.108152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:20:09.108152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:20:09.108152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:20:09.108152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:20:09.108152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:20:09.108152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:20:09.108152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:20:09.108152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:20:09.108152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:20:09.109027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:20:09.109027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:20:09.109027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:20:09.109027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:20:09.109027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:20:09.109027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:20:09.109027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:20:09.109027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:20:09.109027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:20:09.109027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:20:09.109027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:20:09.109027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:20:09.109027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 560/1099] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:20:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:20:09.114885 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12897b96-b05c-470f-a288-0ada9964d66b None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:09.117605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce92ea-6f26-428d-8c1c-cae31c22283e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:09.138060 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:09.160975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a1246-0fff-404a-b7e3-472b2ecf31b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:09.161599 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a1246-0fff-404a-b7e3-472b2ecf31b5 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:09.161877 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a1246-0fff-404a-b7e3-472b2ecf31b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:09.162146 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a1246-0fff-404a-b7e3-472b2ecf31b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:09.162856 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a1246-0fff-404a-b7e3-472b2ecf31b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:09.163200 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a1246-0fff-404a-b7e3-472b2ecf31b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:09.164662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a1246-0fff-404a-b7e3-472b2ecf31b5 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:09.182770 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 540/1100] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:20:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:20:09.189212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a1246-0fff-404a-b7e3-472b2ecf31b5 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:09.233748 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12897b96-b05c-470f-a288-0ada9964d66b None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:09.242945 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:09.268594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85209f7-c3b5-4fcd-909a-3d188c95e60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:09.269348 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85209f7-c3b5-4fcd-909a-3d188c95e60d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:09.269614 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85209f7-c3b5-4fcd-909a-3d188c95e60d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:09.269883 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85209f7-c3b5-4fcd-909a-3d188c95e60d None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:09.270552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85209f7-c3b5-4fcd-909a-3d188c95e60d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:09.270847 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85209f7-c3b5-4fcd-909a-3d188c95e60d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:09.272246 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85209f7-c3b5-4fcd-909a-3d188c95e60d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:09.281481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 561/1101] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:20:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:20:09.287701 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85209f7-c3b5-4fcd-909a-3d188c95e60d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:09.296763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a1246-0fff-404a-b7e3-472b2ecf31b5 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:09.343597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8d193-cee3-46dc-ad8b-13e57253265d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:09.344225 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8d193-cee3-46dc-ad8b-13e57253265d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:09.344518 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8d193-cee3-46dc-ad8b-13e57253265d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:09.344782 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8d193-cee3-46dc-ad8b-13e57253265d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:09.345561 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8d193-cee3-46dc-ad8b-13e57253265d None admin] RBAC: Adding query filter params (role.id=b557a16f80704a549ace1ef1a84f3086, scope.project.id=e480e782c4fa403a913ca7179db0843b, user.id=6cdee0584fe045028a44c385d032d2c7) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:09.345824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8d193-cee3-46dc-ad8b-13e57253265d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:09.347341 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8d193-cee3-46dc-ad8b-13e57253265d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:09.353814 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 541/1102] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:20:09 2022] GET /identity/v3/role_assignments?user.id=6cdee0584fe045028a44c385d032d2c7&scope.project.id=e480e782c4fa403a913ca7179db0843b&role.id=b557a16f80704a549ace1ef1a84f3086 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:20:09.411040 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85209f7-c3b5-4fcd-909a-3d188c95e60d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:09.464995 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918973e5-9896-427b-a6b0-4ffca36784df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:09.465847 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918973e5-9896-427b-a6b0-4ffca36784df None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:09.466332 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918973e5-9896-427b-a6b0-4ffca36784df None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:09.466806 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918973e5-9896-427b-a6b0-4ffca36784df None admin] PATH_INFO: `/v3/users/244f50f13ec44620a6b01b198c6e95be` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:09.468911 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918973e5-9896-427b-a6b0-4ffca36784df None admin] RBAC: Authorizing `identity:get_user(user_id=244f50f13ec44620a6b01b198c6e95be)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:09.470573 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918973e5-9896-427b-a6b0-4ffca36784df None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:09.472536 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 562/1103] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:20:09 2022] GET /identity/v3/users/244f50f13ec44620a6b01b198c6e95be => generated 285 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:09.478531 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8d193-cee3-46dc-ad8b-13e57253265d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:09.527875 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:09.599463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8d193-cee3-46dc-ad8b-13e57253265d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:09.636432 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0cb5e-0455-4b42-a4f9-329b3fe3e6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:09.637058 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0cb5e-0455-4b42-a4f9-329b3fe3e6da None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:09.637323 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0cb5e-0455-4b42-a4f9-329b3fe3e6da None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:09.637594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0cb5e-0455-4b42-a4f9-329b3fe3e6da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:09.715660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0cb5e-0455-4b42-a4f9-329b3fe3e6da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:09.717077 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0cb5e-0455-4b42-a4f9-329b3fe3e6da None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:09.764436 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:09.830519 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 542/1104] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:20:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 16:20:09.836810 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918973e5-9896-427b-a6b0-4ffca36784df None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:09.891660 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:09.961476 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918973e5-9896-427b-a6b0-4ffca36784df None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:10.008527 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7795cf-002d-4db3-9ea5-f2d480eb8506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:10.009097 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7795cf-002d-4db3-9ea5-f2d480eb8506 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:10.009374 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7795cf-002d-4db3-9ea5-f2d480eb8506 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:10.009630 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7795cf-002d-4db3-9ea5-f2d480eb8506 None admin] PATH_INFO: `/v3/projects/478a9d2ceaf74552b5afb8fe408f3658` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:10.010926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7795cf-002d-4db3-9ea5-f2d480eb8506 None admin] RBAC: Authorizing `identity:get_project(project_id=478a9d2ceaf74552b5afb8fe408f3658)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:10.012425 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7795cf-002d-4db3-9ea5-f2d480eb8506 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:10.014083 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 563/1105] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:20:09 2022] GET /identity/v3/projects/478a9d2ceaf74552b5afb8fe408f3658 => generated 311 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:10.024109 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0cb5e-0455-4b42-a4f9-329b3fe3e6da None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:10.131594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0cb5e-0455-4b42-a4f9-329b3fe3e6da None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:10.169574 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5e9c5-32dc-481f-b32c-da31a141ea6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:10.170209 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5e9c5-32dc-481f-b32c-da31a141ea6c None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:10.170476 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5e9c5-32dc-481f-b32c-da31a141ea6c None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:10.170754 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5e9c5-32dc-481f-b32c-da31a141ea6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:10.172173 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5e9c5-32dc-481f-b32c-da31a141ea6c None admin] RBAC: Adding query filter params (role.id=066f46534195417295e63a5316632eae, scope.project.id=478a9d2ceaf74552b5afb8fe408f3658, user.id=244f50f13ec44620a6b01b198c6e95be) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:10.172173 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5e9c5-32dc-481f-b32c-da31a141ea6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:10.173323 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5e9c5-32dc-481f-b32c-da31a141ea6c None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:10.180593 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 543/1106] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:20:10 2022] GET /identity/v3/role_assignments?user.id=244f50f13ec44620a6b01b198c6e95be&scope.project.id=478a9d2ceaf74552b5afb8fe408f3658&role.id=066f46534195417295e63a5316632eae => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:20:12.381586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f507f-1e40-4bda-ba0b-ec708521ccaa None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:12.382203 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f507f-1e40-4bda-ba0b-ec708521ccaa None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:12.382203 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f507f-1e40-4bda-ba0b-ec708521ccaa None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:12.383509 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 564/1107] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:20:12.389131 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c934c9-0e50-47c0-83dc-7afd8bb290f2 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:12.389590 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c934c9-0e50-47c0-83dc-7afd8bb290f2 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:12.389683 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c934c9-0e50-47c0-83dc-7afd8bb290f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:12.397292 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:12.408958 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-62c934c9-0e50-47c0-83dc-7afd8bb290f2 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:20:12.410157 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-62c934c9-0e50-47c0-83dc-7afd8bb290f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:20:12.480751 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 544/1108] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:20:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 16:20:12.746180 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f507f-1e40-4bda-ba0b-ec708521ccaa None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:12.867218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f507f-1e40-4bda-ba0b-ec708521ccaa None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:12.875452 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:12.910304 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d15c0-215f-42d2-8f09-686f3b94cc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:12.910950 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d15c0-215f-42d2-8f09-686f3b94cc41 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:12.911244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d15c0-215f-42d2-8f09-686f3b94cc41 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:12.911516 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d15c0-215f-42d2-8f09-686f3b94cc41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:12.912673 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d15c0-215f-42d2-8f09-686f3b94cc41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:12.914109 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d15c0-215f-42d2-8f09-686f3b94cc41 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:12.915774 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 565/1109] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:20:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:12.924410 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c934c9-0e50-47c0-83dc-7afd8bb290f2 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:13.039287 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c934c9-0e50-47c0-83dc-7afd8bb290f2 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:13.080307 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bf23d-056a-4cea-b774-eeb7717943e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:13.081363 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bf23d-056a-4cea-b774-eeb7717943e2 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:13.082095 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bf23d-056a-4cea-b774-eeb7717943e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:13.082592 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bf23d-056a-4cea-b774-eeb7717943e2 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:13.084018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5bf23d-056a-4cea-b774-eeb7717943e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:13.086428 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5bf23d-056a-4cea-b774-eeb7717943e2 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:13.095040 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:13.110504 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 545/1110] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Oct 4 16:20:12 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:20:15.337449 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115caff-1866-4218-9558-c230dd2ff391 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:15.337991 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115caff-1866-4218-9558-c230dd2ff391 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:15.337991 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115caff-1866-4218-9558-c230dd2ff391 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:15.339469 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 566/1111] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:20:15.345155 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b8dab-f6ae-4ff5-a70f-dcdc3368c35e None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:15.345548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b8dab-f6ae-4ff5-a70f-dcdc3368c35e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:15.345696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b8dab-f6ae-4ff5-a70f-dcdc3368c35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:15.372391 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-5d3b8dab-f6ae-4ff5-a70f-dcdc3368c35e None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:20:15.373603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-5d3b8dab-f6ae-4ff5-a70f-dcdc3368c35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:20:15.442790 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 546/1112] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:20:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:20:15.707323 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115caff-1866-4218-9558-c230dd2ff391 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:15.819358 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115caff-1866-4218-9558-c230dd2ff391 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:15.852410 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd0d8b-4337-4145-82f4-ab14c0edf764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:15.853034 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd0d8b-4337-4145-82f4-ab14c0edf764 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:15.853307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd0d8b-4337-4145-82f4-ab14c0edf764 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:15.853572 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd0d8b-4337-4145-82f4-ab14c0edf764 None admin] PATH_INFO: `/v3/roles/2497938af8354a00a7e4ec59ad8b9582` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:15.855026 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd0d8b-4337-4145-82f4-ab14c0edf764 None admin] RBAC: Authorizing `identity:get_role(role_id=2497938af8354a00a7e4ec59ad8b9582)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:15.856392 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd0d8b-4337-4145-82f4-ab14c0edf764 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:15.857729 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 567/1113] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:20:15 2022] GET /identity/v3/roles/2497938af8354a00a7e4ec59ad8b9582 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:15.864114 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b8dab-f6ae-4ff5-a70f-dcdc3368c35e None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:15.988890 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b8dab-f6ae-4ff5-a70f-dcdc3368c35e None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:16.015186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:16.033211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb71dd5-7d4a-489e-8453-31c1ff2d3c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:16.033947 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb71dd5-7d4a-489e-8453-31c1ff2d3c66 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:16.034318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb71dd5-7d4a-489e-8453-31c1ff2d3c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:16.034663 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb71dd5-7d4a-489e-8453-31c1ff2d3c66 None admin] PATH_INFO: `/v3/users/a823c4b444bb410cab7cdff1b1e98d5f` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:16.051020 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb71dd5-7d4a-489e-8453-31c1ff2d3c66 None admin] RBAC: Authorizing `identity:get_user(user_id=a823c4b444bb410cab7cdff1b1e98d5f)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:16.052795 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb71dd5-7d4a-489e-8453-31c1ff2d3c66 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:16.055028 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 547/1114] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:20:15 2022] GET /identity/v3/users/a823c4b444bb410cab7cdff1b1e98d5f => generated 286 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:16.061852 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd0d8b-4337-4145-82f4-ab14c0edf764 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:16.106475 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:16.172428 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd0d8b-4337-4145-82f4-ab14c0edf764 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:16.209917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47913b7e-f733-45d7-b17d-0bd9423c555b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:16.210538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47913b7e-f733-45d7-b17d-0bd9423c555b None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:16.210817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47913b7e-f733-45d7-b17d-0bd9423c555b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:16.211115 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47913b7e-f733-45d7-b17d-0bd9423c555b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:16.282545 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47913b7e-f733-45d7-b17d-0bd9423c555b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:16.283933 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47913b7e-f733-45d7-b17d-0bd9423c555b None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:16.325726 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:16.388071 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 568/1115] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:20:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 16:20:16.394642 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb71dd5-7d4a-489e-8453-31c1ff2d3c66 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:16.508686 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb71dd5-7d4a-489e-8453-31c1ff2d3c66 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:16.543991 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe0cb3-ebee-4cd4-a5e2-6002c5ff5948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:16.544550 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe0cb3-ebee-4cd4-a5e2-6002c5ff5948 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:16.544825 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe0cb3-ebee-4cd4-a5e2-6002c5ff5948 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:16.545095 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe0cb3-ebee-4cd4-a5e2-6002c5ff5948 None admin] PATH_INFO: `/v3/projects/478a9d2ceaf74552b5afb8fe408f3658` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:16.546347 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe0cb3-ebee-4cd4-a5e2-6002c5ff5948 None admin] RBAC: Authorizing `identity:get_project(project_id=478a9d2ceaf74552b5afb8fe408f3658)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:16.547815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe0cb3-ebee-4cd4-a5e2-6002c5ff5948 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:16.549472 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 548/1116] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:20:16 2022] GET /identity/v3/projects/478a9d2ceaf74552b5afb8fe408f3658 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:16.556620 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47913b7e-f733-45d7-b17d-0bd9423c555b None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:16.662225 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47913b7e-f733-45d7-b17d-0bd9423c555b None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:16.697796 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f99067-a0fa-4d3b-a388-b4655b067b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:16.698403 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f99067-a0fa-4d3b-a388-b4655b067b75 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:16.698678 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f99067-a0fa-4d3b-a388-b4655b067b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:16.698949 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f99067-a0fa-4d3b-a388-b4655b067b75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:16.699697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f99067-a0fa-4d3b-a388-b4655b067b75 None admin] RBAC: Adding query filter params (role.id=2497938af8354a00a7e4ec59ad8b9582, scope.project.id=478a9d2ceaf74552b5afb8fe408f3658, user.id=a823c4b444bb410cab7cdff1b1e98d5f) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:16.699999 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f99067-a0fa-4d3b-a388-b4655b067b75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:16.701417 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f99067-a0fa-4d3b-a388-b4655b067b75 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:16.706862 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 569/1117] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:20:16 2022] GET /identity/v3/role_assignments?user.id=a823c4b444bb410cab7cdff1b1e98d5f&scope.project.id=478a9d2ceaf74552b5afb8fe408f3658&role.id=2497938af8354a00a7e4ec59ad8b9582 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:18.838004 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1fb5e-edd6-4cd1-b56d-09dea124473a None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:18.838644 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1fb5e-edd6-4cd1-b56d-09dea124473a None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:18.838644 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1fb5e-edd6-4cd1-b56d-09dea124473a None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:18.839870 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 549/1118] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:20:18.846084 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023d29b-8791-426a-b474-6897086e5f26 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:18.846493 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023d29b-8791-426a-b474-6897086e5f26 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:18.846690 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023d29b-8791-426a-b474-6897086e5f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:18.863795 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:18.870638 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-e023d29b-8791-426a-b474-6897086e5f26 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:20:18.871918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-e023d29b-8791-426a-b474-6897086e5f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:20:18.958066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 570/1119] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:20:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:20:19.224480 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1fb5e-edd6-4cd1-b56d-09dea124473a None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:19.275986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:19.352776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1fb5e-edd6-4cd1-b56d-09dea124473a None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:19.392588 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfbbfe-c7cb-4e90-9cb0-773998e5693a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:19.393222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfbbfe-c7cb-4e90-9cb0-773998e5693a None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:19.393497 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfbbfe-c7cb-4e90-9cb0-773998e5693a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:19.393768 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfbbfe-c7cb-4e90-9cb0-773998e5693a None admin] PATH_INFO: `/v3/roles/2497938af8354a00a7e4ec59ad8b9582` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:19.395266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfbbfe-c7cb-4e90-9cb0-773998e5693a None admin] RBAC: Authorizing `identity:get_role(role_id=2497938af8354a00a7e4ec59ad8b9582)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:19.396649 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfbbfe-c7cb-4e90-9cb0-773998e5693a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:19.398115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 550/1120] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:20:19 2022] GET /identity/v3/roles/2497938af8354a00a7e4ec59ad8b9582 => generated 223 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:19.405261 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023d29b-8791-426a-b474-6897086e5f26 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:19.514249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023d29b-8791-426a-b474-6897086e5f26 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:19.552724 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0aa91-b1a3-4c8c-870d-709d2f43ad73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:19.553365 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0aa91-b1a3-4c8c-870d-709d2f43ad73 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:19.553640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0aa91-b1a3-4c8c-870d-709d2f43ad73 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:19.553909 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0aa91-b1a3-4c8c-870d-709d2f43ad73 None admin] PATH_INFO: `/v3/users/a823c4b444bb410cab7cdff1b1e98d5f` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:19.555120 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0aa91-b1a3-4c8c-870d-709d2f43ad73 None admin] RBAC: Authorizing `identity:get_user(user_id=a823c4b444bb410cab7cdff1b1e98d5f)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:19.556562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0aa91-b1a3-4c8c-870d-709d2f43ad73 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:19.558190 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 571/1121] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:20:19 2022] GET /identity/v3/users/a823c4b444bb410cab7cdff1b1e98d5f => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:19.564274 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfbbfe-c7cb-4e90-9cb0-773998e5693a None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:19.677476 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfbbfe-c7cb-4e90-9cb0-773998e5693a None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:19.692052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:19.713681 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae75ab9-60f6-4400-ae3b-2a3e9f717f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:19.714318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae75ab9-60f6-4400-ae3b-2a3e9f717f85 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:19.714594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae75ab9-60f6-4400-ae3b-2a3e9f717f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:19.714863 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae75ab9-60f6-4400-ae3b-2a3e9f717f85 None admin] PATH_INFO: `/v3/projects/478a9d2ceaf74552b5afb8fe408f3658` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:19.716043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae75ab9-60f6-4400-ae3b-2a3e9f717f85 None admin] RBAC: Authorizing `identity:get_project(project_id=478a9d2ceaf74552b5afb8fe408f3658)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:19.717496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae75ab9-60f6-4400-ae3b-2a3e9f717f85 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:19.719192 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 551/1122] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:20:19 2022] GET /identity/v3/projects/478a9d2ceaf74552b5afb8fe408f3658 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:19.725574 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0aa91-b1a3-4c8c-870d-709d2f43ad73 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:19.729896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:19.831634 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0aa91-b1a3-4c8c-870d-709d2f43ad73 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:19.869239 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c2f56-2b37-44a9-b35e-554746c46a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:19.869975 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c2f56-2b37-44a9-b35e-554746c46a06 None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:19.870255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c2f56-2b37-44a9-b35e-554746c46a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:19.870528 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c2f56-2b37-44a9-b35e-554746c46a06 None admin] PATH_INFO: `/v3/projects/478a9d2ceaf74552b5afb8fe408f3658/users/a823c4b444bb410cab7cdff1b1e98d5f/roles/2497938af8354a00a7e4ec59ad8b9582` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:19.872933 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c2f56-2b37-44a9-b35e-554746c46a06 None admin] RBAC: Authorizing `identity:create_grant(project_id=478a9d2ceaf74552b5afb8fe408f3658, user_id=a823c4b444bb410cab7cdff1b1e98d5f, role_id=2497938af8354a00a7e4ec59ad8b9582)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:19.874379 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c2f56-2b37-44a9-b35e-554746c46a06 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:19.888425 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 572/1123] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Oct 4 16:20:19 2022] PUT /identity/v3/projects/478a9d2ceaf74552b5afb8fe408f3658/users/a823c4b444bb410cab7cdff1b1e98d5f/roles/2497938af8354a00a7e4ec59ad8b9582 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:20:22.026755 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bda68-03dc-47bd-a2e3-b2fbf9f8cf85 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:22.027319 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bda68-03dc-47bd-a2e3-b2fbf9f8cf85 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:22.027319 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bda68-03dc-47bd-a2e3-b2fbf9f8cf85 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:22.028596 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 552/1124] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:20:22.034220 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de8840-b178-42d9-a28b-6a22484d6ba1 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:22.034701 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de8840-b178-42d9-a28b-6a22484d6ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:22.034793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de8840-b178-42d9-a28b-6a22484d6ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:22.054799 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-80de8840-b178-42d9-a28b-6a22484d6ba1 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:20:22.056175 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-80de8840-b178-42d9-a28b-6a22484d6ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:20:22.134322 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:22.150796 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 573/1125] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:20:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:20:22.412021 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bda68-03dc-47bd-a2e3-b2fbf9f8cf85 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:22.515236 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bda68-03dc-47bd-a2e3-b2fbf9f8cf85 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:22.550090 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b65a1-8879-4f3f-b073-47d3d45531e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:22.550721 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b65a1-8879-4f3f-b073-47d3d45531e5 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:22.551014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b65a1-8879-4f3f-b073-47d3d45531e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:22.551284 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b65a1-8879-4f3f-b073-47d3d45531e5 None admin] PATH_INFO: `/v3/roles/2497938af8354a00a7e4ec59ad8b9582` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:22.552698 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b65a1-8879-4f3f-b073-47d3d45531e5 None admin] RBAC: Authorizing `identity:get_role(role_id=2497938af8354a00a7e4ec59ad8b9582)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:22.554061 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b65a1-8879-4f3f-b073-47d3d45531e5 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:22.555437 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 553/1126] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:20:22 2022] GET /identity/v3/roles/2497938af8354a00a7e4ec59ad8b9582 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:22.561547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de8840-b178-42d9-a28b-6a22484d6ba1 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:22.666817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de8840-b178-42d9-a28b-6a22484d6ba1 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:22.700464 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3fb25-d86a-483d-9c34-f30d40746f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:22.701093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3fb25-d86a-483d-9c34-f30d40746f75 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:22.701372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3fb25-d86a-483d-9c34-f30d40746f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:22.701641 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3fb25-d86a-483d-9c34-f30d40746f75 None admin] PATH_INFO: `/v3/users/a823c4b444bb410cab7cdff1b1e98d5f` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:22.702771 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3fb25-d86a-483d-9c34-f30d40746f75 None admin] RBAC: Authorizing `identity:get_user(user_id=a823c4b444bb410cab7cdff1b1e98d5f)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:22.704244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3fb25-d86a-483d-9c34-f30d40746f75 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:22.705868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 574/1127] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:20:22 2022] GET /identity/v3/users/a823c4b444bb410cab7cdff1b1e98d5f => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:20:22.711976 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b65a1-8879-4f3f-b073-47d3d45531e5 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:22.775825 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:22.829373 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b65a1-8879-4f3f-b073-47d3d45531e5 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:22.864187 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63626e-03fe-43bd-8cb7-3f079eb2db1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:22.864796 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63626e-03fe-43bd-8cb7-3f079eb2db1f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:22.865076 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63626e-03fe-43bd-8cb7-3f079eb2db1f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:22.865338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63626e-03fe-43bd-8cb7-3f079eb2db1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:22.936538 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63626e-03fe-43bd-8cb7-3f079eb2db1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:22.937913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63626e-03fe-43bd-8cb7-3f079eb2db1f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:22.990520 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:23.044067 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 554/1128] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:20:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 16:20:23.050335 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3fb25-d86a-483d-9c34-f30d40746f75 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:23.111044 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:23.158239 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3fb25-d86a-483d-9c34-f30d40746f75 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:23.195324 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7667e1-0587-46de-9032-42a7b4a9e2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:23.195887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7667e1-0587-46de-9032-42a7b4a9e2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:23.196165 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7667e1-0587-46de-9032-42a7b4a9e2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:23.196434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7667e1-0587-46de-9032-42a7b4a9e2e5 None admin] PATH_INFO: `/v3/projects/478a9d2ceaf74552b5afb8fe408f3658` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:23.197628 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7667e1-0587-46de-9032-42a7b4a9e2e5 None admin] RBAC: Authorizing `identity:get_project(project_id=478a9d2ceaf74552b5afb8fe408f3658)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:23.199100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7667e1-0587-46de-9032-42a7b4a9e2e5 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:23.200798 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 575/1129] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:20:23 2022] GET /identity/v3/projects/478a9d2ceaf74552b5afb8fe408f3658 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:23.207288 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63626e-03fe-43bd-8cb7-3f079eb2db1f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:23.314861 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63626e-03fe-43bd-8cb7-3f079eb2db1f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:23.368581 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b819f25-8675-40ad-a46f-84df809838fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:23.369586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b819f25-8675-40ad-a46f-84df809838fc None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:23.370062 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b819f25-8675-40ad-a46f-84df809838fc None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:23.370554 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b819f25-8675-40ad-a46f-84df809838fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:23.371952 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b819f25-8675-40ad-a46f-84df809838fc None admin] RBAC: Adding query filter params (role.id=2497938af8354a00a7e4ec59ad8b9582, scope.project.id=478a9d2ceaf74552b5afb8fe408f3658, user.id=a823c4b444bb410cab7cdff1b1e98d5f) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:23.372503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b819f25-8675-40ad-a46f-84df809838fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:23.375123 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b819f25-8675-40ad-a46f-84df809838fc None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:23.384027 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 555/1130] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:20:23 2022] GET /identity/v3/role_assignments?user.id=a823c4b444bb410cab7cdff1b1e98d5f&scope.project.id=478a9d2ceaf74552b5afb8fe408f3658&role.id=2497938af8354a00a7e4ec59ad8b9582 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:25.569061 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c334f-e747-48ec-a11b-c47948e900e0 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:25.569609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c334f-e747-48ec-a11b-c47948e900e0 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:25.569609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c334f-e747-48ec-a11b-c47948e900e0 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:25.570997 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 576/1131] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:20:25.576629 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d375ec-9364-4f14-8e00-e9d308d8cddf None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:25.577095 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d375ec-9364-4f14-8e00-e9d308d8cddf None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:25.577180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d375ec-9364-4f14-8e00-e9d308d8cddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:25.597070 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-05d375ec-9364-4f14-8e00-e9d308d8cddf None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:20:25.598272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-05d375ec-9364-4f14-8e00-e9d308d8cddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:20:25.608598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:25.669900 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 556/1132] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:20:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:20:25.935055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c334f-e747-48ec-a11b-c47948e900e0 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:26.038297 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c334f-e747-48ec-a11b-c47948e900e0 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:26.079379 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:26.086537 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05db07-b652-4d7b-b464-67ab0a6827e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:26.087213 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05db07-b652-4d7b-b464-67ab0a6827e1 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:26.087494 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05db07-b652-4d7b-b464-67ab0a6827e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:26.087767 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05db07-b652-4d7b-b464-67ab0a6827e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:26.089022 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05db07-b652-4d7b-b464-67ab0a6827e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:26.090470 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05db07-b652-4d7b-b464-67ab0a6827e1 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:26.092117 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 577/1133] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:20:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:26.098318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d375ec-9364-4f14-8e00-e9d308d8cddf None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:26.196769 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d375ec-9364-4f14-8e00-e9d308d8cddf None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:26.233001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b6dd3-beb5-452d-bb92-086902c7d527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:26.233603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b6dd3-beb5-452d-bb92-086902c7d527 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:26.233871 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b6dd3-beb5-452d-bb92-086902c7d527 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:26.234131 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b6dd3-beb5-452d-bb92-086902c7d527 None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:26.234756 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b6dd3-beb5-452d-bb92-086902c7d527 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:26.236248 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b6dd3-beb5-452d-bb92-086902c7d527 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:26.251089 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:26.266644 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 557/1134] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Oct 4 16:20:26 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:20:28.483503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94437ba-03af-4b94-944d-8fe7bef563d3 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:28.484130 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94437ba-03af-4b94-944d-8fe7bef563d3 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:28.484130 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94437ba-03af-4b94-944d-8fe7bef563d3 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:28.485377 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 578/1135] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:20:28.491790 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61544b-88b7-4505-8852-921eaf8167c1 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:28.492505 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61544b-88b7-4505-8852-921eaf8167c1 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:28.492663 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61544b-88b7-4505-8852-921eaf8167c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:28.517612 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-5f61544b-88b7-4505-8852-921eaf8167c1 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:20:28.518817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-5f61544b-88b7-4505-8852-921eaf8167c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:20:28.589677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 558/1136] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:20:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:20:28.855611 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94437ba-03af-4b94-944d-8fe7bef563d3 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:28.966448 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94437ba-03af-4b94-944d-8fe7bef563d3 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:29.003179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d261af7-c348-4e59-83d3-01a61cd90288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:29.003810 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d261af7-c348-4e59-83d3-01a61cd90288 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:29.004088 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d261af7-c348-4e59-83d3-01a61cd90288 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:29.004354 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d261af7-c348-4e59-83d3-01a61cd90288 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:29.005480 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d261af7-c348-4e59-83d3-01a61cd90288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:29.006937 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d261af7-c348-4e59-83d3-01a61cd90288 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:29.008568 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 579/1137] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:20:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:29.014607 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61544b-88b7-4505-8852-921eaf8167c1 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:29.119337 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61544b-88b7-4505-8852-921eaf8167c1 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:29.146815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:29.157470 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa2167-c073-4858-a2a3-9d78ea7281d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:29.158090 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa2167-c073-4858-a2a3-9d78ea7281d9 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:29.158364 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa2167-c073-4858-a2a3-9d78ea7281d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:29.158643 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa2167-c073-4858-a2a3-9d78ea7281d9 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:29.159392 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa2167-c073-4858-a2a3-9d78ea7281d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:29.160829 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa2167-c073-4858-a2a3-9d78ea7281d9 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:29.188251 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 559/1138] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Oct 4 16:20:29 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:20:31.396158 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a262d2-687a-49a1-b646-7fe713180268 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:31.396739 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a262d2-687a-49a1-b646-7fe713180268 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:31.396739 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a262d2-687a-49a1-b646-7fe713180268 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:31.398163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 580/1139] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:20:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:20:31.404177 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f14b2b-0405-4000-8c45-7c96bf241b47 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:31.404746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f14b2b-0405-4000-8c45-7c96bf241b47 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:31.404746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f14b2b-0405-4000-8c45-7c96bf241b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:31.426326 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-25f14b2b-0405-4000-8c45-7c96bf241b47 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:20:31.427586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-25f14b2b-0405-4000-8c45-7c96bf241b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:20:31.502759 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 560/1140] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:20:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 16:20:31.787242 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a262d2-687a-49a1-b646-7fe713180268 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:31.854397 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:31.891807 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a262d2-687a-49a1-b646-7fe713180268 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:31.928879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c5dab-352f-4a1c-bb22-551137e210ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:31.929503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c5dab-352f-4a1c-bb22-551137e210ce None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:31.929774 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c5dab-352f-4a1c-bb22-551137e210ce None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:31.930045 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c5dab-352f-4a1c-bb22-551137e210ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:31.940295 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c5dab-352f-4a1c-bb22-551137e210ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:20:31.945020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-0f6c5dab-352f-4a1c-bb22-551137e210ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:20:31.945020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:20:31.945020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:20:31.945020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:20:31.945020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:20:31.945020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:20:31.945020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:20:31.945020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:20:31.945020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:20:31.945020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:20:31.945020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:20:31.945020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:20:31.945020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:20:31.945020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:20:31.945020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:20:31.945020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:20:31.946151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:20:31.946151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:20:31.946151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:20:31.946151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:20:31.946151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:20:31.946151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:20:31.946151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:20:31.946151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:20:31.946151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:20:31.946151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:20:31.946151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:20:31.946151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:20:31.946151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:20:31.946151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:20:31.946151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:20:31.946151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:20:31.947338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:20:31.947338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:20:31.947338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:20:31.947338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:20:31.947338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:20:31.947338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:20:31.947338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:20:31.947338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:20:31.947338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:20:31.947338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:20:31.947338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:20:31.947338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:20:31.947338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 581/1141] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:20:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:20:31.952481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f14b2b-0405-4000-8c45-7c96bf241b47 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:32.053897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f14b2b-0405-4000-8c45-7c96bf241b47 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:32.068234 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:32.091229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abcdd25-6afc-43e5-ad68-6cd6d8b14687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:32.091844 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcdd25-6afc-43e5-ad68-6cd6d8b14687 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:32.092121 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcdd25-6afc-43e5-ad68-6cd6d8b14687 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:32.092391 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcdd25-6afc-43e5-ad68-6cd6d8b14687 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:32.093053 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abcdd25-6afc-43e5-ad68-6cd6d8b14687 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:32.093355 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abcdd25-6afc-43e5-ad68-6cd6d8b14687 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:32.094730 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abcdd25-6afc-43e5-ad68-6cd6d8b14687 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:32.103318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 561/1142] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:20:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:32.109666 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c5dab-352f-4a1c-bb22-551137e210ce None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:32.217874 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c5dab-352f-4a1c-bb22-551137e210ce None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:32.243526 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:32.253776 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fe7bf-88dc-4636-831f-169a242f9e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:32.254407 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fe7bf-88dc-4636-831f-169a242f9e20 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:32.254683 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fe7bf-88dc-4636-831f-169a242f9e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:32.254953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fe7bf-88dc-4636-831f-169a242f9e20 None admin] PATH_INFO: `/v3/users/e9261e2bb2114aff96c33e6b0d6efb0e` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:32.268444 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fe7bf-88dc-4636-831f-169a242f9e20 None admin] RBAC: Authorizing `identity:get_user(user_id=e9261e2bb2114aff96c33e6b0d6efb0e)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:32.269877 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fe7bf-88dc-4636-831f-169a242f9e20 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:32.271594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 582/1143] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:20:32 2022] GET /identity/v3/users/e9261e2bb2114aff96c33e6b0d6efb0e => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:32.277723 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abcdd25-6afc-43e5-ad68-6cd6d8b14687 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:32.381929 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abcdd25-6afc-43e5-ad68-6cd6d8b14687 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:32.420352 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a92ea-68aa-41aa-9bd0-f9fd18e56eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:32.421413 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a92ea-68aa-41aa-9bd0-f9fd18e56eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:32.421413 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a92ea-68aa-41aa-9bd0-f9fd18e56eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:32.421726 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a92ea-68aa-41aa-9bd0-f9fd18e56eb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:32.464997 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:32.508228 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a92ea-68aa-41aa-9bd0-f9fd18e56eb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:32.510626 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a92ea-68aa-41aa-9bd0-f9fd18e56eb3 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:32.615211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 562/1144] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:20:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 16:20:32.621525 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fe7bf-88dc-4636-831f-169a242f9e20 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:32.726486 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fe7bf-88dc-4636-831f-169a242f9e20 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:32.761724 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cb0a4-8d95-443d-a7c2-e3a975fc034a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:32.762355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cb0a4-8d95-443d-a7c2-e3a975fc034a None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:32.762627 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cb0a4-8d95-443d-a7c2-e3a975fc034a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:32.762898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cb0a4-8d95-443d-a7c2-e3a975fc034a None admin] PATH_INFO: `/v3/projects/a850d22907174807b76558b479afa561` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:32.764053 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cb0a4-8d95-443d-a7c2-e3a975fc034a None admin] RBAC: Authorizing `identity:get_project(project_id=a850d22907174807b76558b479afa561)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:32.765487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cb0a4-8d95-443d-a7c2-e3a975fc034a None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:32.767215 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 583/1145] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:20:32 2022] GET /identity/v3/projects/a850d22907174807b76558b479afa561 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:32.774308 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a92ea-68aa-41aa-9bd0-f9fd18e56eb3 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:32.851054 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:32.877440 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a92ea-68aa-41aa-9bd0-f9fd18e56eb3 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:32.913391 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d47d9-d019-4015-ae37-1f4cda1b0ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:32.913984 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d47d9-d019-4015-ae37-1f4cda1b0ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:32.914252 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d47d9-d019-4015-ae37-1f4cda1b0ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:32.914514 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d47d9-d019-4015-ae37-1f4cda1b0ad6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:32.915259 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d47d9-d019-4015-ae37-1f4cda1b0ad6 None admin] RBAC: Adding query filter params (role.id=066f46534195417295e63a5316632eae, scope.project.id=a850d22907174807b76558b479afa561, user.id=e9261e2bb2114aff96c33e6b0d6efb0e) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:32.915556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d47d9-d019-4015-ae37-1f4cda1b0ad6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:32.917817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d47d9-d019-4015-ae37-1f4cda1b0ad6 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:32.925071 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 563/1146] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:20:32 2022] GET /identity/v3/role_assignments?user.id=e9261e2bb2114aff96c33e6b0d6efb0e&scope.project.id=a850d22907174807b76558b479afa561&role.id=066f46534195417295e63a5316632eae => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:35.014924 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b5cb3-53d4-4a5a-a8b0-7ece6c9e1eb1 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:35.015484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b5cb3-53d4-4a5a-a8b0-7ece6c9e1eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:35.015484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b5cb3-53d4-4a5a-a8b0-7ece6c9e1eb1 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:35.016759 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 584/1147] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:20:35.022597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015fbf2-8cd8-4e09-b7b8-f05ffa0d3da2 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:35.023077 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015fbf2-8cd8-4e09-b7b8-f05ffa0d3da2 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:35.023180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015fbf2-8cd8-4e09-b7b8-f05ffa0d3da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:35.052907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-1015fbf2-8cd8-4e09-b7b8-f05ffa0d3da2 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:20:35.054709 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-1015fbf2-8cd8-4e09-b7b8-f05ffa0d3da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:20:35.129489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 564/1148] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:20:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:20:35.395004 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b5cb3-53d4-4a5a-a8b0-7ece6c9e1eb1 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:35.449830 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:35.498012 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b5cb3-53d4-4a5a-a8b0-7ece6c9e1eb1 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:35.532444 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847e470-7465-413e-afac-30a71a3ef558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:35.533066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847e470-7465-413e-afac-30a71a3ef558 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:35.533340 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847e470-7465-413e-afac-30a71a3ef558 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:35.533681 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847e470-7465-413e-afac-30a71a3ef558 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:35.544486 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4847e470-7465-413e-afac-30a71a3ef558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:20:35.549287 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-4847e470-7465-413e-afac-30a71a3ef558 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:20:35.549287 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:20:35.549287 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:20:35.549287 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:20:35.549287 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:20:35.549287 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:20:35.549287 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:20:35.549287 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:20:35.549287 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:20:35.549287 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:20:35.549287 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:20:35.549287 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:20:35.549287 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:20:35.549287 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:20:35.549287 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:20:35.549287 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:20:35.550372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:20:35.550372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:20:35.550372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:20:35.550372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:20:35.550372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:20:35.550372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:20:35.550372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:20:35.550372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:20:35.550372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:20:35.550372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:20:35.550372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:20:35.550372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:20:35.550372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:20:35.550372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:20:35.550372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:20:35.550372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:20:35.551672 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:20:35.551672 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:20:35.551672 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:20:35.551672 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:20:35.551672 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:20:35.551672 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:20:35.551672 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:20:35.551672 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:20:35.551672 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:20:35.551672 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:20:35.551672 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:20:35.551672 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:20:35.551672 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 585/1149] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:20:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:20:35.556718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015fbf2-8cd8-4e09-b7b8-f05ffa0d3da2 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:35.625064 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:35.665056 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015fbf2-8cd8-4e09-b7b8-f05ffa0d3da2 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:35.701540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab15b5-8ca4-494a-b877-dcef3aee831d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:35.702156 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab15b5-8ca4-494a-b877-dcef3aee831d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:35.702435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab15b5-8ca4-494a-b877-dcef3aee831d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:35.702702 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab15b5-8ca4-494a-b877-dcef3aee831d None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:35.703413 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab15b5-8ca4-494a-b877-dcef3aee831d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:35.703718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab15b5-8ca4-494a-b877-dcef3aee831d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:35.705093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab15b5-8ca4-494a-b877-dcef3aee831d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:35.713211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 565/1150] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:20:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:35.719382 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847e470-7465-413e-afac-30a71a3ef558 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:35.822233 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847e470-7465-413e-afac-30a71a3ef558 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:35.835998 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:35.858078 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a798ecc-e533-437e-8d5e-27cc286844f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:35.858714 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a798ecc-e533-437e-8d5e-27cc286844f7 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:35.859021 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a798ecc-e533-437e-8d5e-27cc286844f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:35.859299 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a798ecc-e533-437e-8d5e-27cc286844f7 None admin] PATH_INFO: `/v3/users/e9261e2bb2114aff96c33e6b0d6efb0e` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:35.860439 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a798ecc-e533-437e-8d5e-27cc286844f7 None admin] RBAC: Authorizing `identity:get_user(user_id=e9261e2bb2114aff96c33e6b0d6efb0e)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:35.861876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a798ecc-e533-437e-8d5e-27cc286844f7 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:35.863507 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 586/1151] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:20:35 2022] GET /identity/v3/users/e9261e2bb2114aff96c33e6b0d6efb0e => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:35.869713 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab15b5-8ca4-494a-b877-dcef3aee831d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:35.988293 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab15b5-8ca4-494a-b877-dcef3aee831d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:36.017306 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:36.023841 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363a3db-6ac3-49da-93ee-a649c0c7341d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:36.024450 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363a3db-6ac3-49da-93ee-a649c0c7341d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:36.024743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363a3db-6ac3-49da-93ee-a649c0c7341d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:36.025012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363a3db-6ac3-49da-93ee-a649c0c7341d None admin] PATH_INFO: `/v3/projects/a850d22907174807b76558b479afa561` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:36.026178 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363a3db-6ac3-49da-93ee-a649c0c7341d None admin] RBAC: Authorizing `identity:get_project(project_id=a850d22907174807b76558b479afa561)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:36.027668 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363a3db-6ac3-49da-93ee-a649c0c7341d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:36.029307 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 566/1152] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:20:35 2022] GET /identity/v3/projects/a850d22907174807b76558b479afa561 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:36.035662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a798ecc-e533-437e-8d5e-27cc286844f7 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:36.137445 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a798ecc-e533-437e-8d5e-27cc286844f7 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:36.173097 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b67d1-675e-4f8b-aebc-59d4826d8e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:36.173761 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b67d1-675e-4f8b-aebc-59d4826d8e1f None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:36.174045 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b67d1-675e-4f8b-aebc-59d4826d8e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:36.174323 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b67d1-675e-4f8b-aebc-59d4826d8e1f None admin] PATH_INFO: `/v3/projects/a850d22907174807b76558b479afa561/users/e9261e2bb2114aff96c33e6b0d6efb0e/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:36.176309 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b67d1-675e-4f8b-aebc-59d4826d8e1f None admin] RBAC: Authorizing `identity:create_grant(project_id=a850d22907174807b76558b479afa561, user_id=e9261e2bb2114aff96c33e6b0d6efb0e, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:36.177745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b67d1-675e-4f8b-aebc-59d4826d8e1f None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:36.192873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 587/1153] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Oct 4 16:20:36 2022] PUT /identity/v3/projects/a850d22907174807b76558b479afa561/users/e9261e2bb2114aff96c33e6b0d6efb0e/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:20:38.322388 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94336fb4-5b66-42ba-a01d-9b5241a4be0f None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:38.323144 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94336fb4-5b66-42ba-a01d-9b5241a4be0f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:38.323144 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94336fb4-5b66-42ba-a01d-9b5241a4be0f None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:38.324344 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 567/1154] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:20:38.330865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb9b91-e8cf-4fb7-860f-0bc2f6cebf65 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:38.331431 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb9b91-e8cf-4fb7-860f-0bc2f6cebf65 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:38.331431 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb9b91-e8cf-4fb7-860f-0bc2f6cebf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:38.361206 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-70fb9b91-e8cf-4fb7-860f-0bc2f6cebf65 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:20:38.362403 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-70fb9b91-e8cf-4fb7-860f-0bc2f6cebf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:20:38.399292 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:38.433571 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 588/1155] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:20:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:20:38.719886 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94336fb4-5b66-42ba-a01d-9b5241a4be0f None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:38.827437 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94336fb4-5b66-42ba-a01d-9b5241a4be0f None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:38.862178 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0bd83-042e-4949-8fe9-170e52226654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:38.862734 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0bd83-042e-4949-8fe9-170e52226654 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:38.863010 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0bd83-042e-4949-8fe9-170e52226654 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:38.863299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0bd83-042e-4949-8fe9-170e52226654 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:38.875720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0bd83-042e-4949-8fe9-170e52226654 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:20:38.880880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-ffd0bd83-042e-4949-8fe9-170e52226654 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:20:38.880880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:20:38.880880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:20:38.880880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:20:38.880880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:20:38.880880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:20:38.880880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:20:38.880880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:20:38.880880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:20:38.880880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:20:38.880880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:20:38.880880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:20:38.880880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:20:38.880880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:20:38.880880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:20:38.880880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:20:38.882063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:20:38.882063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:20:38.882063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:20:38.882063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:20:38.882063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:20:38.882063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:20:38.882063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:20:38.882063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:20:38.882063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:20:38.882063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:20:38.882063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:20:38.882063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:20:38.882063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:20:38.882063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:20:38.882063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:20:38.882063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:20:38.883112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:20:38.883112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:20:38.883112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:20:38.883112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:20:38.883112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:20:38.883112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:20:38.883112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:20:38.883112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:20:38.883112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:20:38.883112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:20:38.883112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:20:38.883112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:20:38.887227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 568/1156] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:20:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:20:38.888752 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb9b91-e8cf-4fb7-860f-0bc2f6cebf65 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:38.991852 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb9b91-e8cf-4fb7-860f-0bc2f6cebf65 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:39.028200 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857f468-715a-4b4c-8c36-dcf2e337509e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:39.028816 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857f468-715a-4b4c-8c36-dcf2e337509e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:39.029094 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857f468-715a-4b4c-8c36-dcf2e337509e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:39.029374 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857f468-715a-4b4c-8c36-dcf2e337509e None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:39.030055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8857f468-715a-4b4c-8c36-dcf2e337509e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:39.030355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8857f468-715a-4b4c-8c36-dcf2e337509e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:39.031775 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8857f468-715a-4b4c-8c36-dcf2e337509e None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:39.040995 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 589/1157] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:20:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:39.048659 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0bd83-042e-4949-8fe9-170e52226654 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:39.124071 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:39.168113 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0bd83-042e-4949-8fe9-170e52226654 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:39.203471 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c354a0f-78ac-4f75-8dd9-326fee9b28f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:39.204095 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c354a0f-78ac-4f75-8dd9-326fee9b28f2 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:39.204380 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c354a0f-78ac-4f75-8dd9-326fee9b28f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:39.204646 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c354a0f-78ac-4f75-8dd9-326fee9b28f2 None admin] PATH_INFO: `/v3/users/e9261e2bb2114aff96c33e6b0d6efb0e` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:39.205827 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c354a0f-78ac-4f75-8dd9-326fee9b28f2 None admin] RBAC: Authorizing `identity:get_user(user_id=e9261e2bb2114aff96c33e6b0d6efb0e)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:39.207296 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c354a0f-78ac-4f75-8dd9-326fee9b28f2 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:39.208894 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 569/1158] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:20:39 2022] GET /identity/v3/users/e9261e2bb2114aff96c33e6b0d6efb0e => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:39.215282 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857f468-715a-4b4c-8c36-dcf2e337509e None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:39.248699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:39.316248 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857f468-715a-4b4c-8c36-dcf2e337509e None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:39.350835 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320244a-0b5c-4589-b1d9-ac0b3d77bffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:39.351475 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320244a-0b5c-4589-b1d9-ac0b3d77bffe None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:39.351726 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320244a-0b5c-4589-b1d9-ac0b3d77bffe None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:39.351996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320244a-0b5c-4589-b1d9-ac0b3d77bffe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:39.447151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320244a-0b5c-4589-b1d9-ac0b3d77bffe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:39.448520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320244a-0b5c-4589-b1d9-ac0b3d77bffe None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:39.480441 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:39.554752 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 590/1159] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:20:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 16:20:39.561115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c354a0f-78ac-4f75-8dd9-326fee9b28f2 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:39.665758 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c354a0f-78ac-4f75-8dd9-326fee9b28f2 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:39.691762 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:39.701391 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e6285-5f03-4d4c-9a9d-6f9f4b796cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:39.701955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e6285-5f03-4d4c-9a9d-6f9f4b796cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:39.702220 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e6285-5f03-4d4c-9a9d-6f9f4b796cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:39.702488 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e6285-5f03-4d4c-9a9d-6f9f4b796cd7 None admin] PATH_INFO: `/v3/projects/a850d22907174807b76558b479afa561` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:39.703608 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e6285-5f03-4d4c-9a9d-6f9f4b796cd7 None admin] RBAC: Authorizing `identity:get_project(project_id=a850d22907174807b76558b479afa561)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:39.705041 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e6285-5f03-4d4c-9a9d-6f9f4b796cd7 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:39.706702 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 570/1160] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:20:39 2022] GET /identity/v3/projects/a850d22907174807b76558b479afa561 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:39.713367 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320244a-0b5c-4589-b1d9-ac0b3d77bffe None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:39.816772 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320244a-0b5c-4589-b1d9-ac0b3d77bffe None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:39.846786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:39.852817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdce29d-48c9-4413-9b6f-b6f9d07a6f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:39.853480 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdce29d-48c9-4413-9b6f-b6f9d07a6f12 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:39.853759 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdce29d-48c9-4413-9b6f-b6f9d07a6f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:39.854033 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdce29d-48c9-4413-9b6f-b6f9d07a6f12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:39.854749 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdce29d-48c9-4413-9b6f-b6f9d07a6f12 None admin] RBAC: Adding query filter params (role.id=066f46534195417295e63a5316632eae, scope.project.id=a850d22907174807b76558b479afa561, user.id=e9261e2bb2114aff96c33e6b0d6efb0e) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:39.855080 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdce29d-48c9-4413-9b6f-b6f9d07a6f12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:39.856508 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdce29d-48c9-4413-9b6f-b6f9d07a6f12 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:39.862501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 591/1161] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:20:39 2022] GET /identity/v3/role_assignments?user.id=e9261e2bb2114aff96c33e6b0d6efb0e&scope.project.id=a850d22907174807b76558b479afa561&role.id=066f46534195417295e63a5316632eae => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:42.018126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952021c-1cb4-4524-a58a-1078c0e91581 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:42.018665 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952021c-1cb4-4524-a58a-1078c0e91581 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:42.018665 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952021c-1cb4-4524-a58a-1078c0e91581 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:42.020034 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 571/1162] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:20:42.025702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd95735-890e-47c0-b0b9-5716d70911ee None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:42.026115 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd95735-890e-47c0-b0b9-5716d70911ee None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:42.026224 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd95735-890e-47c0-b0b9-5716d70911ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:42.045919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-ccd95735-890e-47c0-b0b9-5716d70911ee None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:20:42.047253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ccd95735-890e-47c0-b0b9-5716d70911ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:20:42.124344 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 592/1163] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:20:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:20:42.389910 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952021c-1cb4-4524-a58a-1078c0e91581 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:42.500365 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952021c-1cb4-4524-a58a-1078c0e91581 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:42.534374 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9ca57-c5d2-41c1-b0cc-a457ca9df5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:42.534973 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9ca57-c5d2-41c1-b0cc-a457ca9df5b3 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:42.535265 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9ca57-c5d2-41c1-b0cc-a457ca9df5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:42.535535 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9ca57-c5d2-41c1-b0cc-a457ca9df5b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:42.603756 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:42.612186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9ca57-c5d2-41c1-b0cc-a457ca9df5b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:42.613673 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9ca57-c5d2-41c1-b0cc-a457ca9df5b3 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:42.718608 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 572/1164] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:20:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 16:20:42.724750 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd95735-890e-47c0-b0b9-5716d70911ee None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:42.823384 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd95735-890e-47c0-b0b9-5716d70911ee None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:42.849966 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:42.860175 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8289e-f1b0-4b23-9453-68c501b474c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:42.860831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8289e-f1b0-4b23-9453-68c501b474c3 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:42.861106 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8289e-f1b0-4b23-9453-68c501b474c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:42.861369 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8289e-f1b0-4b23-9453-68c501b474c3 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:42.868148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8289e-f1b0-4b23-9453-68c501b474c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:42.869621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8289e-f1b0-4b23-9453-68c501b474c3 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:42.881046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-77c8289e-f1b0-4b23-9453-68c501b474c3 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 04 16:20:42.881046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:20:42.881046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 16:20:42.881046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 16:20:42.881046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:20:42.881046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:20:42.881046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:20:42.881046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:20:42.881046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 04 16:20:42.881046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:20:42.881046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:20:42.881046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:20:42.881046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:20:42.881046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:20:42.881046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:20:42.881046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:20:42.881046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:20:42.882315 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:20:42.882315 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:20:42.882315 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:20:42.882315 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:20:42.882315 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:20:42.882315 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:20:42.882315 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:20:42.882315 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:20:42.882315 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:20:42.882315 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:20:42.882315 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:20:42.882315 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:20:42.882315 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:20:42.882315 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:20:42.882315 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:20:42.882315 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:20:42.883496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:20:42.883496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:20:42.883496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:20:42.883496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:20:42.883496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:20:42.883496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:20:42.883496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:20:42.883496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:20:42.883496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:20:42.883496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:20:42.883496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 16:20:42.883496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:20:42.883496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 04 16:20:42.883496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:20:42.883496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 593/1165] 10.222.0.55 () {56 vars in 1117 bytes} [Tue Oct 4 16:20:42 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:20:42.888466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9ca57-c5d2-41c1-b0cc-a457ca9df5b3 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:42.991801 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:42.998718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9ca57-c5d2-41c1-b0cc-a457ca9df5b3 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:43.032807 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3f6fa-fc0f-4eb3-989c-f1c4c6b12116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:43.033439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3f6fa-fc0f-4eb3-989c-f1c4c6b12116 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:43.033666 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3f6fa-fc0f-4eb3-989c-f1c4c6b12116 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:43.033944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3f6fa-fc0f-4eb3-989c-f1c4c6b12116 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:43.034580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3f6fa-fc0f-4eb3-989c-f1c4c6b12116 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:43.034877 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3f6fa-fc0f-4eb3-989c-f1c4c6b12116 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:43.036274 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3f6fa-fc0f-4eb3-989c-f1c4c6b12116 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:43.043978 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 573/1166] 10.222.0.55 () {56 vars in 1115 bytes} [Tue Oct 4 16:20:42 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:45.179670 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981fc18-080b-4b82-bf42-02c26387f767 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:45.180255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981fc18-080b-4b82-bf42-02c26387f767 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:45.180255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981fc18-080b-4b82-bf42-02c26387f767 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:45.181622 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 594/1167] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:20:45.186933 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b09a6-9de7-43e8-b6f2-afa65122670f None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:45.187383 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b09a6-9de7-43e8-b6f2-afa65122670f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:45.187499 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b09a6-9de7-43e8-b6f2-afa65122670f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:45.207121 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-ee8b09a6-9de7-43e8-b6f2-afa65122670f None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:20:45.208342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ee8b09a6-9de7-43e8-b6f2-afa65122670f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:20:45.277128 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 574/1168] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:20:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:20:45.541775 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981fc18-080b-4b82-bf42-02c26387f767 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:45.651405 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981fc18-080b-4b82-bf42-02c26387f767 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:45.691722 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2799cf-e2ac-45fe-a398-1d3055ecafe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:45.692331 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2799cf-e2ac-45fe-a398-1d3055ecafe5 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:45.692606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2799cf-e2ac-45fe-a398-1d3055ecafe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:45.692879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2799cf-e2ac-45fe-a398-1d3055ecafe5 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:45.693553 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2799cf-e2ac-45fe-a398-1d3055ecafe5 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:45.694932 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2799cf-e2ac-45fe-a398-1d3055ecafe5 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:45.712554 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 595/1169] 10.222.0.55 () {60 vars in 1138 bytes} [Tue Oct 4 16:20:45 2022] POST /identity/v3/domains => generated 267 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:20:47.889850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549d359-23eb-4b3d-ba87-dcb88a019211 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:47.890478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549d359-23eb-4b3d-ba87-dcb88a019211 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:47.890478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549d359-23eb-4b3d-ba87-dcb88a019211 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:47.891704 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 575/1170] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:20:47.898022 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c6ffc-0dd1-4363-bcd2-56dda6bb4646 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:47.898587 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c6ffc-0dd1-4363-bcd2-56dda6bb4646 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:47.898587 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c6ffc-0dd1-4363-bcd2-56dda6bb4646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:47.919423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-4a7c6ffc-0dd1-4363-bcd2-56dda6bb4646 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:20:47.920658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-4a7c6ffc-0dd1-4363-bcd2-56dda6bb4646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:20:47.967944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:47.997335 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 596/1171] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:20:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:20:48.263756 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549d359-23eb-4b3d-ba87-dcb88a019211 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:48.355354 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:48.372712 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549d359-23eb-4b3d-ba87-dcb88a019211 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:48.410405 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec1bbc-f09a-4d3f-a07d-8e016946ae2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:48.411033 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec1bbc-f09a-4d3f-a07d-8e016946ae2d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:48.411329 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec1bbc-f09a-4d3f-a07d-8e016946ae2d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:48.411592 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec1bbc-f09a-4d3f-a07d-8e016946ae2d None admin] PATH_INFO: `/v3/domains/0c8df1d5bfa4450dac3d55779a89b5bf` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:48.423244 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec1bbc-f09a-4d3f-a07d-8e016946ae2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=0c8df1d5bfa4450dac3d55779a89b5bf)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:48.424734 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec1bbc-f09a-4d3f-a07d-8e016946ae2d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:48.426374 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 576/1172] 10.222.0.55 () {56 vars in 1183 bytes} [Tue Oct 4 16:20:48 2022] GET /identity/v3/domains/0c8df1d5bfa4450dac3d55779a89b5bf => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:48.434580 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c6ffc-0dd1-4363-bcd2-56dda6bb4646 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:48.531959 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c6ffc-0dd1-4363-bcd2-56dda6bb4646 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:48.573774 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52a250-0cf1-4151-a996-2902829348c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:48.577298 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52a250-0cf1-4151-a996-2902829348c9 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:48.577590 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52a250-0cf1-4151-a996-2902829348c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:48.577861 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52a250-0cf1-4151-a996-2902829348c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:48.578742 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52a250-0cf1-4151-a996-2902829348c9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:48.580025 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52a250-0cf1-4151-a996-2902829348c9 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:48.609145 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 597/1173] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Oct 4 16:20:48 2022] POST /identity/v3/projects => generated 361 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:20:50.783035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d1ef9-1a65-4dda-9868-a9f626b78985 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:50.783589 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d1ef9-1a65-4dda-9868-a9f626b78985 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:50.783589 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d1ef9-1a65-4dda-9868-a9f626b78985 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:50.785020 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 577/1174] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:20:50.791737 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a867a2e-529b-4821-a71e-67f5895113dd None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:50.792481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a867a2e-529b-4821-a71e-67f5895113dd None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:50.792626 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a867a2e-529b-4821-a71e-67f5895113dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:50.817483 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-2a867a2e-529b-4821-a71e-67f5895113dd None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:20:50.818681 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-2a867a2e-529b-4821-a71e-67f5895113dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:20:50.842300 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:50.887787 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 598/1175] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:20:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:20:51.152078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d1ef9-1a65-4dda-9868-a9f626b78985 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:51.262575 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d1ef9-1a65-4dda-9868-a9f626b78985 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:51.297510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ec65a-0036-4311-be96-d1d5c1fca1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:51.298128 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ec65a-0036-4311-be96-d1d5c1fca1d2 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:51.298400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ec65a-0036-4311-be96-d1d5c1fca1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:51.298671 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ec65a-0036-4311-be96-d1d5c1fca1d2 None admin] PATH_INFO: `/v3/domains/0c8df1d5bfa4450dac3d55779a89b5bf` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:51.299957 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ec65a-0036-4311-be96-d1d5c1fca1d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0c8df1d5bfa4450dac3d55779a89b5bf)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:51.301389 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ec65a-0036-4311-be96-d1d5c1fca1d2 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:51.303001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 578/1176] 10.222.0.55 () {56 vars in 1183 bytes} [Tue Oct 4 16:20:51 2022] GET /identity/v3/domains/0c8df1d5bfa4450dac3d55779a89b5bf => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:51.309113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a867a2e-529b-4821-a71e-67f5895113dd None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:51.409421 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a867a2e-529b-4821-a71e-67f5895113dd None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:51.443645 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457c821-84f5-45eb-82ca-2d3538a261f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:51.444260 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457c821-84f5-45eb-82ca-2d3538a261f0 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:51.444537 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457c821-84f5-45eb-82ca-2d3538a261f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:51.444799 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457c821-84f5-45eb-82ca-2d3538a261f0 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:51.445443 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457c821-84f5-45eb-82ca-2d3538a261f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:51.446898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457c821-84f5-45eb-82ca-2d3538a261f0 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:51.469042 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 599/1177] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Oct 4 16:20:51 2022] POST /identity/v3/users => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:20:53.666274 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d4ab5-96d0-41e3-a2ba-dc8e1393e7cb None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:53.666817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d4ab5-96d0-41e3-a2ba-dc8e1393e7cb None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:53.666817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d4ab5-96d0-41e3-a2ba-dc8e1393e7cb None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:53.668594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 579/1178] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:20:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:20:53.674124 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d64f1-be2a-4295-a570-32e090d4fa81 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:53.674539 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d64f1-be2a-4295-a570-32e090d4fa81 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:53.674630 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d64f1-be2a-4295-a570-32e090d4fa81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:53.693282 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-123d64f1-be2a-4295-a570-32e090d4fa81 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:20:53.694472 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-123d64f1-be2a-4295-a570-32e090d4fa81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:20:53.703803 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:53.763929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 600/1179] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:20:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:20:54.033165 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d4ab5-96d0-41e3-a2ba-dc8e1393e7cb None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:54.064271 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:54.157464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d4ab5-96d0-41e3-a2ba-dc8e1393e7cb None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:54.195495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3115a-325a-4f89-9a83-c7f6914c9e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:54.196118 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3115a-325a-4f89-9a83-c7f6914c9e8d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:54.196398 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3115a-325a-4f89-9a83-c7f6914c9e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:54.196657 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3115a-325a-4f89-9a83-c7f6914c9e8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:54.207424 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3115a-325a-4f89-9a83-c7f6914c9e8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:20:54.212185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-cfc3115a-325a-4f89-9a83-c7f6914c9e8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:20:54.212185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:20:54.212185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:20:54.212185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:20:54.212185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:20:54.212185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:20:54.212185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:20:54.212185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:20:54.212185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:20:54.212185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:20:54.212185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:20:54.212185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:20:54.212185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:20:54.212185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:20:54.212185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:20:54.212185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:20:54.213266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:20:54.213266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:20:54.213266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:20:54.213266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:20:54.213266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:20:54.213266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:20:54.213266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:20:54.213266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:20:54.213266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:20:54.213266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:20:54.213266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:20:54.213266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:20:54.213266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:20:54.213266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:20:54.213266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:20:54.213266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:20:54.214660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:20:54.214660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:20:54.214660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:20:54.214660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:20:54.214660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:20:54.214660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:20:54.214660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:20:54.214660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:20:54.214660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:20:54.214660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:20:54.214660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:20:54.214660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:20:54.214660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 580/1180] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:20:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:20:54.222916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d64f1-be2a-4295-a570-32e090d4fa81 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:54.331040 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d64f1-be2a-4295-a570-32e090d4fa81 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:54.367410 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6cff9-013d-4bb7-8fdb-627ef61b3fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:54.368028 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6cff9-013d-4bb7-8fdb-627ef61b3fac None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:54.368313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6cff9-013d-4bb7-8fdb-627ef61b3fac None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:54.368582 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6cff9-013d-4bb7-8fdb-627ef61b3fac None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:54.369336 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6cff9-013d-4bb7-8fdb-627ef61b3fac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:54.369703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6cff9-013d-4bb7-8fdb-627ef61b3fac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:54.371087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6cff9-013d-4bb7-8fdb-627ef61b3fac None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:54.379475 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 601/1181] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:20:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:54.385729 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3115a-325a-4f89-9a83-c7f6914c9e8d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:54.463770 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:54.487805 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3115a-325a-4f89-9a83-c7f6914c9e8d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:54.527982 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d82a0-89b9-49a9-8d29-1774e1e0bb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:54.528608 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d82a0-89b9-49a9-8d29-1774e1e0bb87 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:54.528879 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d82a0-89b9-49a9-8d29-1774e1e0bb87 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:54.529139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d82a0-89b9-49a9-8d29-1774e1e0bb87 None admin] PATH_INFO: `/v3/users/c4e6af0e26574b02b3404d85890bf521` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:54.542751 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d82a0-89b9-49a9-8d29-1774e1e0bb87 None admin] RBAC: Authorizing `identity:get_user(user_id=c4e6af0e26574b02b3404d85890bf521)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:54.544574 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d82a0-89b9-49a9-8d29-1774e1e0bb87 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:54.546180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 581/1182] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:20:54 2022] GET /identity/v3/users/c4e6af0e26574b02b3404d85890bf521 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:54.552345 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6cff9-013d-4bb7-8fdb-627ef61b3fac None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:54.562210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:54.656403 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6cff9-013d-4bb7-8fdb-627ef61b3fac None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:54.690950 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e5841-1c25-4fec-b356-acc4ac7d864f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:54.691607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e5841-1c25-4fec-b356-acc4ac7d864f None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:54.691846 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e5841-1c25-4fec-b356-acc4ac7d864f None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:54.692113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e5841-1c25-4fec-b356-acc4ac7d864f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:54.767783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e5841-1c25-4fec-b356-acc4ac7d864f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:54.769206 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e5841-1c25-4fec-b356-acc4ac7d864f None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:54.777843 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:54.874255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 602/1183] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:20:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 16:20:54.880493 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d82a0-89b9-49a9-8d29-1774e1e0bb87 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:54.985901 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d82a0-89b9-49a9-8d29-1774e1e0bb87 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:55.024833 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c329ff-efa2-4f19-83ab-4b253b45a7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:55.025532 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c329ff-efa2-4f19-83ab-4b253b45a7d6 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:55.025800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c329ff-efa2-4f19-83ab-4b253b45a7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:55.026060 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c329ff-efa2-4f19-83ab-4b253b45a7d6 None admin] PATH_INFO: `/v3/projects/4b983c26697e4e599d2f9dbd91bb1a58` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:55.027298 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c329ff-efa2-4f19-83ab-4b253b45a7d6 None admin] RBAC: Authorizing `identity:get_project(project_id=4b983c26697e4e599d2f9dbd91bb1a58)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:55.028752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c329ff-efa2-4f19-83ab-4b253b45a7d6 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:55.030433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 582/1184] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:20:54 2022] GET /identity/v3/projects/4b983c26697e4e599d2f9dbd91bb1a58 => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:55.036970 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e5841-1c25-4fec-b356-acc4ac7d864f None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:55.164115 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e5841-1c25-4fec-b356-acc4ac7d864f None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:55.172712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:55.201449 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a455e-1608-40c4-b984-482847d9bc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:55.202051 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a455e-1608-40c4-b984-482847d9bc0e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:55.202325 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a455e-1608-40c4-b984-482847d9bc0e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:55.202596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a455e-1608-40c4-b984-482847d9bc0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:55.203322 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a455e-1608-40c4-b984-482847d9bc0e None admin] RBAC: Adding query filter params (role.id=066f46534195417295e63a5316632eae, scope.project.id=4b983c26697e4e599d2f9dbd91bb1a58, user.id=c4e6af0e26574b02b3404d85890bf521) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:55.203654 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a455e-1608-40c4-b984-482847d9bc0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:55.206055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a455e-1608-40c4-b984-482847d9bc0e None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:55.211418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 603/1185] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:20:55 2022] GET /identity/v3/role_assignments?user.id=c4e6af0e26574b02b3404d85890bf521&scope.project.id=4b983c26697e4e599d2f9dbd91bb1a58&role.id=066f46534195417295e63a5316632eae => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:57.327656 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196ebd0-4541-49a1-ab30-69bd330643d8 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:57.328305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196ebd0-4541-49a1-ab30-69bd330643d8 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:57.328305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196ebd0-4541-49a1-ab30-69bd330643d8 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:57.329516 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 583/1186] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:20:57.335045 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14ffb2-917b-47dd-8842-e88c46fda299 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:57.335458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14ffb2-917b-47dd-8842-e88c46fda299 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:57.335592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14ffb2-917b-47dd-8842-e88c46fda299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:57.354749 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-0d14ffb2-917b-47dd-8842-e88c46fda299 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:20:57.355978 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-0d14ffb2-917b-47dd-8842-e88c46fda299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:20:57.427760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 604/1187] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:20:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:20:57.691789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196ebd0-4541-49a1-ab30-69bd330643d8 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:57.694947 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:57.797661 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196ebd0-4541-49a1-ab30-69bd330643d8 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:57.835154 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cd6de-d204-49d2-9411-19107b03ad96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:57.835705 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cd6de-d204-49d2-9411-19107b03ad96 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:57.835983 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cd6de-d204-49d2-9411-19107b03ad96 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:57.836253 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cd6de-d204-49d2-9411-19107b03ad96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:57.847161 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88cd6de-d204-49d2-9411-19107b03ad96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:20:57.852008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-e88cd6de-d204-49d2-9411-19107b03ad96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:20:57.852008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:20:57.852008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:20:57.852008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:20:57.852008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:20:57.852008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:20:57.852008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:20:57.852008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:20:57.852008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:20:57.852008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:20:57.852008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:20:57.852008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:20:57.852008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:20:57.852008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:20:57.852008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:20:57.852008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:20:57.853377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:20:57.853377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:20:57.853377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:20:57.853377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:20:57.853377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:20:57.853377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:20:57.853377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:20:57.853377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:20:57.853377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:20:57.853377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:20:57.853377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:20:57.853377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:20:57.853377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:20:57.853377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:20:57.853377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:20:57.853377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:20:57.854423 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:20:57.854423 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:20:57.854423 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:20:57.854423 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:20:57.854423 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:20:57.854423 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:20:57.854423 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:20:57.854423 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:20:57.854423 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:20:57.854423 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:20:57.854423 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:20:57.854423 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:20:57.854423 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 584/1188] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:20:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:20:57.860233 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14ffb2-917b-47dd-8842-e88c46fda299 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:57.961821 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:57.965018 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14ffb2-917b-47dd-8842-e88c46fda299 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:57.999031 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe94b7-050e-4000-9d14-c236fdeaf8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:57.999662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe94b7-050e-4000-9d14-c236fdeaf8b3 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:57.999944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe94b7-050e-4000-9d14-c236fdeaf8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:58.000220 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe94b7-050e-4000-9d14-c236fdeaf8b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:58.000883 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe94b7-050e-4000-9d14-c236fdeaf8b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:20:58.001181 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe94b7-050e-4000-9d14-c236fdeaf8b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:58.002553 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe94b7-050e-4000-9d14-c236fdeaf8b3 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:58.010558 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 605/1189] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:20:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:58.016848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cd6de-d204-49d2-9411-19107b03ad96 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:58.081242 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:58.121085 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cd6de-d204-49d2-9411-19107b03ad96 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:58.155972 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c988d-3700-4b19-9458-05e8f21fdbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:58.156649 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c988d-3700-4b19-9458-05e8f21fdbee None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:58.156916 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c988d-3700-4b19-9458-05e8f21fdbee None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:58.157182 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c988d-3700-4b19-9458-05e8f21fdbee None admin] PATH_INFO: `/v3/users/c4e6af0e26574b02b3404d85890bf521` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:58.158328 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c988d-3700-4b19-9458-05e8f21fdbee None admin] RBAC: Authorizing `identity:get_user(user_id=c4e6af0e26574b02b3404d85890bf521)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:58.159783 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c988d-3700-4b19-9458-05e8f21fdbee None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:58.161357 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 585/1190] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:20:58 2022] GET /identity/v3/users/c4e6af0e26574b02b3404d85890bf521 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:58.167506 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe94b7-050e-4000-9d14-c236fdeaf8b3 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:58.272884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe94b7-050e-4000-9d14-c236fdeaf8b3 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:58.309478 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c7772-a92b-4f8a-9b12-d9b95d47d472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:58.310096 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c7772-a92b-4f8a-9b12-d9b95d47d472 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:58.310369 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c7772-a92b-4f8a-9b12-d9b95d47d472 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:58.310634 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c7772-a92b-4f8a-9b12-d9b95d47d472 None admin] PATH_INFO: `/v3/projects/4b983c26697e4e599d2f9dbd91bb1a58` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:58.311797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c7772-a92b-4f8a-9b12-d9b95d47d472 None admin] RBAC: Authorizing `identity:get_project(project_id=4b983c26697e4e599d2f9dbd91bb1a58)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:58.313268 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c7772-a92b-4f8a-9b12-d9b95d47d472 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:58.314922 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 606/1191] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:20:58 2022] GET /identity/v3/projects/4b983c26697e4e599d2f9dbd91bb1a58 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:20:58.322758 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c988d-3700-4b19-9458-05e8f21fdbee None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:20:58.437027 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c988d-3700-4b19-9458-05e8f21fdbee None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:20:58.465368 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:20:58.471850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89e521-8f57-4d77-981c-8070fe374796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:20:58.472507 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89e521-8f57-4d77-981c-8070fe374796 None admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:20:58.472785 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89e521-8f57-4d77-981c-8070fe374796 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:20:58.473058 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89e521-8f57-4d77-981c-8070fe374796 None admin] PATH_INFO: `/v3/projects/4b983c26697e4e599d2f9dbd91bb1a58/users/c4e6af0e26574b02b3404d85890bf521/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:20:58.475097 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89e521-8f57-4d77-981c-8070fe374796 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b983c26697e4e599d2f9dbd91bb1a58, user_id=c4e6af0e26574b02b3404d85890bf521, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:20:58.476520 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89e521-8f57-4d77-981c-8070fe374796 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:20:58.490246 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 586/1192] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Oct 4 16:20:58 2022] PUT /identity/v3/projects/4b983c26697e4e599d2f9dbd91bb1a58/users/c4e6af0e26574b02b3404d85890bf521/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:21:00.588918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7979b97-6ce9-4f06-ab59-b9b49e6bc101 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:21:00.589394 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7979b97-6ce9-4f06-ab59-b9b49e6bc101 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:21:00.589394 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7979b97-6ce9-4f06-ab59-b9b49e6bc101 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:21:00.590805 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 607/1193] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:21:00.596354 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c143d-91c2-4723-ba1b-afa4e797363b None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:21:00.596808 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c143d-91c2-4723-ba1b-afa4e797363b None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:21:00.596901 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c143d-91c2-4723-ba1b-afa4e797363b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:21:00.630453 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-a07c143d-91c2-4723-ba1b-afa4e797363b None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:21:00.631693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a07c143d-91c2-4723-ba1b-afa4e797363b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:21:00.704726 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 587/1194] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:21:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:21:00.983110 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7979b97-6ce9-4f06-ab59-b9b49e6bc101 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:21:01.017037 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:21:01.093288 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7979b97-6ce9-4f06-ab59-b9b49e6bc101 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:21:01.128401 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45637f60-1390-4e2a-91cc-2c18c7ece49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:21:01.129033 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45637f60-1390-4e2a-91cc-2c18c7ece49c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:21:01.129306 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45637f60-1390-4e2a-91cc-2c18c7ece49c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:21:01.129573 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45637f60-1390-4e2a-91cc-2c18c7ece49c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:21:01.140100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45637f60-1390-4e2a-91cc-2c18c7ece49c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:21:01.144900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-45637f60-1390-4e2a-91cc-2c18c7ece49c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:21:01.144900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:21:01.144900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:21:01.144900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:21:01.144900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:21:01.144900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:21:01.144900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:21:01.144900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:21:01.144900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:21:01.144900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:21:01.144900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:21:01.144900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:21:01.144900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:21:01.144900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:21:01.144900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:21:01.144900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:21:01.145973 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:21:01.145973 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:21:01.145973 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:21:01.145973 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:21:01.145973 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:21:01.145973 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:21:01.145973 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:21:01.145973 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:21:01.145973 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:21:01.145973 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:21:01.145973 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:21:01.145973 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:21:01.145973 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:21:01.145973 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:21:01.145973 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:21:01.145973 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:21:01.147095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:21:01.147095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:21:01.147095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:21:01.147095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:21:01.147095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:21:01.147095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:21:01.147095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:21:01.147095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:21:01.147095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:21:01.147095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:21:01.147095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:21:01.147095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:21:01.147095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 608/1195] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:21:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:21:01.152813 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c143d-91c2-4723-ba1b-afa4e797363b None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:21:01.256651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c143d-91c2-4723-ba1b-afa4e797363b None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:21:01.276893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:21:01.292116 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33fc39-489b-476a-a696-ab18de9f7ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:21:01.292740 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33fc39-489b-476a-a696-ab18de9f7ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:21:01.293385 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33fc39-489b-476a-a696-ab18de9f7ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:21:01.293652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33fc39-489b-476a-a696-ab18de9f7ff9 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:21:01.294316 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33fc39-489b-476a-a696-ab18de9f7ff9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:21:01.294615 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33fc39-489b-476a-a696-ab18de9f7ff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:21:01.296032 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33fc39-489b-476a-a696-ab18de9f7ff9 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:21:01.304373 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 588/1196] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:21:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:21:01.310675 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45637f60-1390-4e2a-91cc-2c18c7ece49c None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:21:01.401783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:21:01.411437 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45637f60-1390-4e2a-91cc-2c18c7ece49c None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:21:01.443898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2a858-2f2c-4a1d-b8a4-bd44e3e71bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:21:01.444517 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2a858-2f2c-4a1d-b8a4-bd44e3e71bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:21:01.444790 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2a858-2f2c-4a1d-b8a4-bd44e3e71bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:21:01.445052 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2a858-2f2c-4a1d-b8a4-bd44e3e71bf2 None admin] PATH_INFO: `/v3/users/c4e6af0e26574b02b3404d85890bf521` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:21:01.446152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2a858-2f2c-4a1d-b8a4-bd44e3e71bf2 None admin] RBAC: Authorizing `identity:get_user(user_id=c4e6af0e26574b02b3404d85890bf521)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:21:01.447625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2a858-2f2c-4a1d-b8a4-bd44e3e71bf2 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:21:01.449208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 609/1197] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Oct 4 16:21:01 2022] GET /identity/v3/users/c4e6af0e26574b02b3404d85890bf521 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:21:01.455328 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33fc39-489b-476a-a696-ab18de9f7ff9 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:21:01.562863 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33fc39-489b-476a-a696-ab18de9f7ff9 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:21:01.600714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302e105-3b9e-450c-83b6-dfdce842689b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:21:01.601431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302e105-3b9e-450c-83b6-dfdce842689b None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:21:01.601604 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302e105-3b9e-450c-83b6-dfdce842689b None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:21:01.601869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302e105-3b9e-450c-83b6-dfdce842689b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:21:01.653289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:21:01.674342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302e105-3b9e-450c-83b6-dfdce842689b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:21:01.675829 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302e105-3b9e-450c-83b6-dfdce842689b None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:21:01.774195 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 589/1198] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:21:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 16:21:01.780542 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2a858-2f2c-4a1d-b8a4-bd44e3e71bf2 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:21:01.884393 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2a858-2f2c-4a1d-b8a4-bd44e3e71bf2 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:21:01.919373 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05185a5-3bc5-4c54-8be4-0eb57c54b761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:21:01.920000 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05185a5-3bc5-4c54-8be4-0eb57c54b761 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:21:01.920273 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05185a5-3bc5-4c54-8be4-0eb57c54b761 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:21:01.920538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05185a5-3bc5-4c54-8be4-0eb57c54b761 None admin] PATH_INFO: `/v3/projects/4b983c26697e4e599d2f9dbd91bb1a58` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:21:01.921688 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05185a5-3bc5-4c54-8be4-0eb57c54b761 None admin] RBAC: Authorizing `identity:get_project(project_id=4b983c26697e4e599d2f9dbd91bb1a58)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:21:01.923186 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05185a5-3bc5-4c54-8be4-0eb57c54b761 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:21:01.924831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 610/1199] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Oct 4 16:21:01 2022] GET /identity/v3/projects/4b983c26697e4e599d2f9dbd91bb1a58 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:21:01.931360 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302e105-3b9e-450c-83b6-dfdce842689b None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:21:02.009898 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:21:02.028595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302e105-3b9e-450c-83b6-dfdce842689b None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:21:02.064105 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e35062-e163-41af-aa4a-7f403747bbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:21:02.064711 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e35062-e163-41af-aa4a-7f403747bbf5 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:21:02.064984 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e35062-e163-41af-aa4a-7f403747bbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:21:02.065256 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e35062-e163-41af-aa4a-7f403747bbf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:21:02.065976 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e35062-e163-41af-aa4a-7f403747bbf5 None admin] RBAC: Adding query filter params (role.id=066f46534195417295e63a5316632eae, scope.project.id=4b983c26697e4e599d2f9dbd91bb1a58, user.id=c4e6af0e26574b02b3404d85890bf521) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:21:02.066274 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e35062-e163-41af-aa4a-7f403747bbf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:21:02.067744 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e35062-e163-41af-aa4a-7f403747bbf5 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:21:02.073454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 590/1200] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:21:01 2022] GET /identity/v3/role_assignments?user.id=c4e6af0e26574b02b3404d85890bf521&scope.project.id=4b983c26697e4e599d2f9dbd91bb1a58&role.id=066f46534195417295e63a5316632eae => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:21:11.914189 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=87 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:21:12.070864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=27 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:21:59.739699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e5acc-02dc-445b-bee9-2f7954928933 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:21:59.740741 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e5acc-02dc-445b-bee9-2f7954928933 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:21:59.741224 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e5acc-02dc-445b-bee9-2f7954928933 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:21:59.742814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 611/1201] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:21:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:21:59.749205 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795640a1-cadf-41ca-ac5c-35af13d4eefb None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:21:59.750056 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795640a1-cadf-41ca-ac5c-35af13d4eefb None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:21:59.750484 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795640a1-cadf-41ca-ac5c-35af13d4eefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:21:59.773396 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-795640a1-cadf-41ca-ac5c-35af13d4eefb None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:21:59.774722 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-795640a1-cadf-41ca-ac5c-35af13d4eefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:21:59.883105 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 591/1202] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:21:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:22:00.164206 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e5acc-02dc-445b-bee9-2f7954928933 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:00.331414 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e5acc-02dc-445b-bee9-2f7954928933 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:00.384639 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67c13c-888b-43bd-a2e3-1c2785167bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:00.385409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67c13c-888b-43bd-a2e3-1c2785167bfe None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:00.385718 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67c13c-888b-43bd-a2e3-1c2785167bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:00.386017 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67c13c-888b-43bd-a2e3-1c2785167bfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:00.407690 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67c13c-888b-43bd-a2e3-1c2785167bfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:00.409177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67c13c-888b-43bd-a2e3-1c2785167bfe None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:00.431103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-3e67c13c-888b-43bd-a2e3-1c2785167bfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:22:00.431103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:00.431103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:00.431103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:00.431103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:00.431103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:00.431103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:00.431103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:00.431103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:00.431103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:00.431103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:00.431103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:00.431103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:22:00.431103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:22:00.431103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:22:00.431103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:22:00.432361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:00.432361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:00.432361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:00.432361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:00.432361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:00.432361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:00.432361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:00.432361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:00.432361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:00.432361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:00.432361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:00.432361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:00.432361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:00.432361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:00.432361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:00.432361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:00.432361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:22:00.433360 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:22:00.433360 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:22:00.433360 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:22:00.440690 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 612/1203] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:22:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:00.442331 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795640a1-cadf-41ca-ac5c-35af13d4eefb None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:00.619055 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795640a1-cadf-41ca-ac5c-35af13d4eefb None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:00.663888 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:00.669704 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ea253-a62b-431c-ba50-01e04f8fb927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:00.671056 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ea253-a62b-431c-ba50-01e04f8fb927 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:00.671837 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ea253-a62b-431c-ba50-01e04f8fb927 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:00.672352 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ea253-a62b-431c-ba50-01e04f8fb927 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:00.673156 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ea253-a62b-431c-ba50-01e04f8fb927 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:00.673536 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ea253-a62b-431c-ba50-01e04f8fb927 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:00.675276 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ea253-a62b-431c-ba50-01e04f8fb927 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:00.693175 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 592/1204] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:00.694363 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67c13c-888b-43bd-a2e3-1c2785167bfe None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:00.767982 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:00.844768 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67c13c-888b-43bd-a2e3-1c2785167bfe None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:00.909739 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e539d9d-bcdd-4984-a8a2-7ca8428f8325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:00.909739 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e539d9d-bcdd-4984-a8a2-7ca8428f8325 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:00.909739 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e539d9d-bcdd-4984-a8a2-7ca8428f8325 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:00.909739 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e539d9d-bcdd-4984-a8a2-7ca8428f8325 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:00.910292 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e539d9d-bcdd-4984-a8a2-7ca8428f8325 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:00.910292 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e539d9d-bcdd-4984-a8a2-7ca8428f8325 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:00.955108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 613/1205] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Oct 4 16:22:00 2022] POST /identity/v3/users => generated 251 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:22:03.424917 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ab25f-087d-4ffa-b0c2-fa5e07a24616 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:03.425588 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ab25f-087d-4ffa-b0c2-fa5e07a24616 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:03.425588 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ab25f-087d-4ffa-b0c2-fa5e07a24616 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:03.426807 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 593/1206] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:22:03.435443 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27f2c5-ecbb-413c-bfcd-f0387306ef9c None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:03.436234 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27f2c5-ecbb-413c-bfcd-f0387306ef9c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:03.436386 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27f2c5-ecbb-413c-bfcd-f0387306ef9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:03.458518 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-ea27f2c5-ecbb-413c-bfcd-f0387306ef9c None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:22:03.459856 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ea27f2c5-ecbb-413c-bfcd-f0387306ef9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:22:03.542472 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 614/1207] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:22:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:22:03.837786 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ab25f-087d-4ffa-b0c2-fa5e07a24616 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:03.972212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ab25f-087d-4ffa-b0c2-fa5e07a24616 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:04.012579 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763867fc-c535-4d41-b7ac-aa5654361398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:04.013591 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763867fc-c535-4d41-b7ac-aa5654361398 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:04.014060 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763867fc-c535-4d41-b7ac-aa5654361398 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:04.014583 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763867fc-c535-4d41-b7ac-aa5654361398 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:04.027147 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763867fc-c535-4d41-b7ac-aa5654361398 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:22:04.032630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-763867fc-c535-4d41-b7ac-aa5654361398 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:22:04.032630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:04.032630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:04.032630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:04.032630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:04.032630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:04.032630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:04.032630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:04.032630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:04.032630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:04.032630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:04.032630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:04.032630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:22:04.032630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:22:04.032630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:22:04.032630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:22:04.034651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:22:04.034651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:22:04.034651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:22:04.034651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:22:04.034651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:04.034651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:04.034651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:04.034651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:04.034651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:04.034651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:04.034651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:04.034651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:04.034651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:04.034651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:04.034651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:04.034651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:04.035743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:04.035743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:04.035743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:04.035743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:04.035743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:22:04.035743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:22:04.035743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:22:04.035743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:22:04.035743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:22:04.035743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:22:04.035743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:22:04.035743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:22:04.035743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 594/1208] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Oct 4 16:22:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:04.040463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27f2c5-ecbb-413c-bfcd-f0387306ef9c None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:04.089324 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:04.172102 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27f2c5-ecbb-413c-bfcd-f0387306ef9c None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:04.211289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeec90a-1c95-4b0a-9e2e-ed4a07c54b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:04.212066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeec90a-1c95-4b0a-9e2e-ed4a07c54b21 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:04.212404 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeec90a-1c95-4b0a-9e2e-ed4a07c54b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:04.212722 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeec90a-1c95-4b0a-9e2e-ed4a07c54b21 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:04.213471 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeec90a-1c95-4b0a-9e2e-ed4a07c54b21 None admin] RBAC: Adding query filter params (name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:04.213804 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeec90a-1c95-4b0a-9e2e-ed4a07c54b21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:04.215325 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeec90a-1c95-4b0a-9e2e-ed4a07c54b21 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:04.225677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 615/1209] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Oct 4 16:22:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:04.232667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763867fc-c535-4d41-b7ac-aa5654361398 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:04.309260 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:04.398269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763867fc-c535-4d41-b7ac-aa5654361398 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:04.445853 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93048b-dfa7-4e2b-ae2a-069710efa031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:04.447417 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93048b-dfa7-4e2b-ae2a-069710efa031 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:04.448075 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93048b-dfa7-4e2b-ae2a-069710efa031 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:04.448363 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93048b-dfa7-4e2b-ae2a-069710efa031 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:04.461652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93048b-dfa7-4e2b-ae2a-069710efa031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:04.463503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93048b-dfa7-4e2b-ae2a-069710efa031 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:04.480211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-3b93048b-dfa7-4e2b-ae2a-069710efa031 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:22:04.480211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:04.480211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:04.480211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:04.480211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:04.480211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:04.480211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:04.480211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:04.480211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:04.480211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:04.480211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:04.480211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:04.480211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:22:04.480211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:22:04.480211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:22:04.480211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:22:04.481299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:04.481299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:04.481299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:04.481299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:04.481299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:04.481299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:04.481299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:04.481299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:04.481299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:04.481299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:04.481299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:04.481299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:04.481299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:04.481299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:04.481299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:04.481299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:04.481299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:22:04.482222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:22:04.482222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:22:04.482222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:22:04.482222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 595/1210] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:22:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:04.492488 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeec90a-1c95-4b0a-9e2e-ed4a07c54b21 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:04.609413 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:04.613030 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeec90a-1c95-4b0a-9e2e-ed4a07c54b21 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:04.650773 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52d529-2738-4747-9e3f-d54fa6735018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:04.651711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52d529-2738-4747-9e3f-d54fa6735018 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:04.652133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52d529-2738-4747-9e3f-d54fa6735018 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:04.652354 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52d529-2738-4747-9e3f-d54fa6735018 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:04.652877 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52d529-2738-4747-9e3f-d54fa6735018 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:04.653175 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52d529-2738-4747-9e3f-d54fa6735018 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:04.654561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52d529-2738-4747-9e3f-d54fa6735018 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:04.668049 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 616/1211] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:04.677071 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93048b-dfa7-4e2b-ae2a-069710efa031 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:04.801687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93048b-dfa7-4e2b-ae2a-069710efa031 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:04.803657 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:04.842115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2cd70-9777-4532-9b54-1b832f4499c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:04.843098 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2cd70-9777-4532-9b54-1b832f4499c7 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:04.843553 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2cd70-9777-4532-9b54-1b832f4499c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:04.843720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2cd70-9777-4532-9b54-1b832f4499c7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:04.853285 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2cd70-9777-4532-9b54-1b832f4499c7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:04.854761 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2cd70-9777-4532-9b54-1b832f4499c7 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:04.875541 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-39a2cd70-9777-4532-9b54-1b832f4499c7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 16:22:04.875541 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:04.875541 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:04.875541 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:04.875541 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:04.875541 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:04.875541 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:04.875541 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:04.875541 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:04.875541 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:04.875541 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:04.875541 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:04.875541 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:22:04.875541 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:22:04.875541 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:22:04.875541 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:22:04.876635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:04.876635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:04.876635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:22:04.876635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:22:04.876635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:22:04.876635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:22:04.876635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:04.876635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:04.876635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:04.876635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:04.876635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:04.876635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:04.876635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:04.876635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:04.876635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:04.876635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:04.876635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:04.876635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:04.877621 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:04.877621 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:04.877621 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:22:04.877621 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:22:04.877621 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:22:04.877621 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:22:04.877621 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:22:04.877621 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:22:04.877621 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 16:22:04.877621 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:22:04.877621 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 596/1212] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:22:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:04.886708 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52d529-2738-4747-9e3f-d54fa6735018 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:05.032934 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52d529-2738-4747-9e3f-d54fa6735018 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:05.084953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b46b5d-af92-4adf-8f31-34e4e59e0d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:05.085579 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b46b5d-af92-4adf-8f31-34e4e59e0d5c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:05.085862 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b46b5d-af92-4adf-8f31-34e4e59e0d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:05.086128 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b46b5d-af92-4adf-8f31-34e4e59e0d5c None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:05.086871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b46b5d-af92-4adf-8f31-34e4e59e0d5c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:05.087223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b46b5d-af92-4adf-8f31-34e4e59e0d5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:05.088752 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b46b5d-af92-4adf-8f31-34e4e59e0d5c None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:05.122911 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 617/1213] 10.222.0.55 () {56 vars in 1143 bytes} [Tue Oct 4 16:22:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:22:05.125454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2cd70-9777-4532-9b54-1b832f4499c7 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:05.250791 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2cd70-9777-4532-9b54-1b832f4499c7 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:05.290541 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ec5bc-6916-45ae-880b-29140179c9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:05.291046 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ec5bc-6916-45ae-880b-29140179c9f0 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:05.293469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ec5bc-6916-45ae-880b-29140179c9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:05.293765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ec5bc-6916-45ae-880b-29140179c9f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:05.341820 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:05.412899 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ec5bc-6916-45ae-880b-29140179c9f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:05.412899 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ec5bc-6916-45ae-880b-29140179c9f0 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:05.534215 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 597/1214] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:22:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 16:22:05.537088 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b46b5d-af92-4adf-8f31-34e4e59e0d5c None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:05.566734 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:05.702740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b46b5d-af92-4adf-8f31-34e4e59e0d5c None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:05.749374 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efdfd73-4e59-453e-b052-fb22f87e5080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:05.750139 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdfd73-4e59-453e-b052-fb22f87e5080 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:05.750424 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdfd73-4e59-453e-b052-fb22f87e5080 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:05.750751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdfd73-4e59-453e-b052-fb22f87e5080 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:05.764070 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efdfd73-4e59-453e-b052-fb22f87e5080 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:05.765249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efdfd73-4e59-453e-b052-fb22f87e5080 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:05.784487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-9efdfd73-4e59-453e-b052-fb22f87e5080 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:22:05.784487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:05.784487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:05.784487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:05.784487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:05.784487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:05.784487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:05.784487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:05.784487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:05.784487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:05.784487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:05.784487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:05.784487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:22:05.784487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:22:05.784487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:22:05.784487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:22:05.785786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:05.785786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:05.785786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:05.785786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:05.785786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:05.785786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:05.785786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:05.785786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:05.785786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:05.785786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:05.785786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:05.785786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:05.785786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:05.785786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:05.785786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:05.785786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:05.785786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:22:05.786811 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:22:05.786811 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:22:05.786811 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:22:05.786811 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 618/1215] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:22:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:05.792336 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ec5bc-6916-45ae-880b-29140179c9f0 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:05.863652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:05.912894 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ec5bc-6916-45ae-880b-29140179c9f0 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:05.954158 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc16438-9dd5-43ec-a5fb-7dd98c8ff022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:05.954906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc16438-9dd5-43ec-a5fb-7dd98c8ff022 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:05.955304 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc16438-9dd5-43ec-a5fb-7dd98c8ff022 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:05.955660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc16438-9dd5-43ec-a5fb-7dd98c8ff022 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:05.956421 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc16438-9dd5-43ec-a5fb-7dd98c8ff022 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:05.956813 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc16438-9dd5-43ec-a5fb-7dd98c8ff022 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:05.958303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc16438-9dd5-43ec-a5fb-7dd98c8ff022 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:05.971672 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 598/1216] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:05.977840 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efdfd73-4e59-453e-b052-fb22f87e5080 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:06.073712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:06.113601 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efdfd73-4e59-453e-b052-fb22f87e5080 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:06.161731 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930f0ff-39c9-4488-950e-14655f07c3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:06.162327 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930f0ff-39c9-4488-950e-14655f07c3b0 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:06.162606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930f0ff-39c9-4488-950e-14655f07c3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:06.162931 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930f0ff-39c9-4488-950e-14655f07c3b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:06.172200 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930f0ff-39c9-4488-950e-14655f07c3b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:06.175180 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930f0ff-39c9-4488-950e-14655f07c3b0 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:06.191196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-2930f0ff-39c9-4488-950e-14655f07c3b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:22:06.191196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:06.191196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:06.191196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:06.191196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:06.191196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:06.191196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:06.191196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:06.191196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:06.191196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:06.191196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:06.191196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:06.191196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:22:06.191196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:22:06.191196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:22:06.192313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:22:06.192313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:06.192313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:06.192313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:06.192313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:06.192313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:06.192313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:06.192313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:06.192313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:06.192313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:06.192313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:06.192313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:06.192313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:06.192313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:06.192313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:06.192313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:06.192313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:06.198817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:22:06.198817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:22:06.198817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:22:06.198817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:22:06.198817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:22:06.198817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:22:06.198817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:22:06.198817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:22:06.198817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 619/1217] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:22:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:06.199473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc16438-9dd5-43ec-a5fb-7dd98c8ff022 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:06.313217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc16438-9dd5-43ec-a5fb-7dd98c8ff022 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:06.341214 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:06.354603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68c1f6-f628-4a78-944f-4592ca918efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:06.355352 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68c1f6-f628-4a78-944f-4592ca918efa None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:06.355627 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68c1f6-f628-4a78-944f-4592ca918efa None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:06.355892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68c1f6-f628-4a78-944f-4592ca918efa None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:06.356601 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68c1f6-f628-4a78-944f-4592ca918efa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:06.359639 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68c1f6-f628-4a78-944f-4592ca918efa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:06.359639 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68c1f6-f628-4a78-944f-4592ca918efa None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:06.372470 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 599/1218] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:22:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:06.378854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930f0ff-39c9-4488-950e-14655f07c3b0 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:06.512148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930f0ff-39c9-4488-950e-14655f07c3b0 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:06.546083 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:06.552835 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f0055-b79c-4897-8566-1bdfadf01ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:06.553670 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f0055-b79c-4897-8566-1bdfadf01ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:06.553948 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f0055-b79c-4897-8566-1bdfadf01ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:06.554291 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f0055-b79c-4897-8566-1bdfadf01ff1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:06.555241 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f0055-b79c-4897-8566-1bdfadf01ff1 None admin] RBAC: Adding query filter params (role.id=2165a726b4034e1584166027f2361b5f, scope.project.id=e480e782c4fa403a913ca7179db0843b, user.id=8cd59eac06e347ee9432185b24fdf773) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:06.555627 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f0055-b79c-4897-8566-1bdfadf01ff1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:06.557956 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f0055-b79c-4897-8566-1bdfadf01ff1 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:06.565632 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 620/1219] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:22:06 2022] GET /identity/v3/role_assignments?user.id=8cd59eac06e347ee9432185b24fdf773&scope.project.id=e480e782c4fa403a913ca7179db0843b&role.id=2165a726b4034e1584166027f2361b5f => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:08.881588 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f888d-e801-4090-9119-bcd644315ade None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:08.882153 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f888d-e801-4090-9119-bcd644315ade None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:08.882153 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f888d-e801-4090-9119-bcd644315ade None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:08.883435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 600/1220] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:22:08.893449 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818d959-f2bc-4494-b9d2-73ab1ae51850 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:08.894266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818d959-f2bc-4494-b9d2-73ab1ae51850 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:08.894266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818d959-f2bc-4494-b9d2-73ab1ae51850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:08.914619 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-2818d959-f2bc-4494-b9d2-73ab1ae51850 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:22:08.915991 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-2818d959-f2bc-4494-b9d2-73ab1ae51850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:22:09.010035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 621/1221] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:22:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 16:22:09.309001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f888d-e801-4090-9119-bcd644315ade None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:09.435620 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f888d-e801-4090-9119-bcd644315ade None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:09.479971 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7e4ca-d419-4fec-9166-216d25ee66e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:09.480660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7e4ca-d419-4fec-9166-216d25ee66e4 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:09.481010 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7e4ca-d419-4fec-9166-216d25ee66e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:09.481388 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7e4ca-d419-4fec-9166-216d25ee66e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:09.493774 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7e4ca-d419-4fec-9166-216d25ee66e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:22:09.499261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-25e7e4ca-d419-4fec-9166-216d25ee66e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:22:09.499261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:09.499261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:09.499261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:09.499261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:09.499261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:09.499261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:09.499261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:09.499261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:09.499261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:09.499261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:09.499261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:09.499261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:22:09.499261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:22:09.499261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:22:09.499261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:22:09.500475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:22:09.500475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:22:09.500475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:22:09.500475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:22:09.500475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:09.500475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:09.500475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:09.500475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:09.500475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:09.500475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:09.500475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:09.500475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:09.500475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:09.500475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:09.500475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:09.500475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:09.501374 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:09.501374 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:09.501374 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:09.501374 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:09.501374 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:22:09.501374 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:22:09.501374 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:22:09.501374 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:22:09.501374 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:22:09.501374 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:22:09.501374 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:22:09.501374 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:22:09.501374 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 601/1222] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Oct 4 16:22:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:22:09.507666 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818d959-f2bc-4494-b9d2-73ab1ae51850 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:09.623657 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818d959-f2bc-4494-b9d2-73ab1ae51850 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:09.663737 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:09.678319 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b6113-5ed1-4075-b587-abf7170f7bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:09.678955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b6113-5ed1-4075-b587-abf7170f7bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:09.679248 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b6113-5ed1-4075-b587-abf7170f7bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:09.679518 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b6113-5ed1-4075-b587-abf7170f7bb5 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:09.680198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b6113-5ed1-4075-b587-abf7170f7bb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:09.680500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b6113-5ed1-4075-b587-abf7170f7bb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:09.681977 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b6113-5ed1-4075-b587-abf7170f7bb5 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:09.690895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 622/1223] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Oct 4 16:22:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:09.698057 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7e4ca-d419-4fec-9166-216d25ee66e4 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:09.780220 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:09.856705 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7e4ca-d419-4fec-9166-216d25ee66e4 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:09.895273 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97010a-7af1-4189-8b75-bc7d9f2f0556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:09.896012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97010a-7af1-4189-8b75-bc7d9f2f0556 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:09.896149 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97010a-7af1-4189-8b75-bc7d9f2f0556 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:09.896445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97010a-7af1-4189-8b75-bc7d9f2f0556 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:09.907453 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97010a-7af1-4189-8b75-bc7d9f2f0556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:09.909213 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97010a-7af1-4189-8b75-bc7d9f2f0556 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:09.935181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-4f97010a-7af1-4189-8b75-bc7d9f2f0556 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:22:09.935181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:09.935181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:09.935181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:09.935181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:09.935181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:09.935181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:09.935181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:09.935181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:09.935181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:09.935181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:09.935181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:09.935181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:22:09.935181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:22:09.935181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:22:09.935181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:22:09.936647 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:09.936647 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:09.936647 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:09.936647 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:09.936647 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:09.936647 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:09.936647 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:09.936647 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:09.936647 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:09.936647 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:09.936647 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:09.936647 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:09.936647 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:09.936647 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:09.936647 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:09.936647 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:09.936647 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:22:09.937563 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:22:09.937563 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:22:09.937563 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:22:09.937563 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 602/1224] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:22:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:09.942721 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b6113-5ed1-4075-b587-abf7170f7bb5 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:10.057420 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b6113-5ed1-4075-b587-abf7170f7bb5 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:10.112526 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58eebf-0b20-400c-868d-ad324296d59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:10.114351 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58eebf-0b20-400c-868d-ad324296d59b None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:10.114351 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58eebf-0b20-400c-868d-ad324296d59b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:10.114351 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58eebf-0b20-400c-868d-ad324296d59b None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:10.114615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58eebf-0b20-400c-868d-ad324296d59b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:10.115001 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58eebf-0b20-400c-868d-ad324296d59b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:10.116582 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58eebf-0b20-400c-868d-ad324296d59b None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:10.130624 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 623/1225] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:10.136818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97010a-7af1-4189-8b75-bc7d9f2f0556 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:10.272323 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:10.279649 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97010a-7af1-4189-8b75-bc7d9f2f0556 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:10.325682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9613777-5fa4-4aff-aef1-b0f8e482efc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:10.326434 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9613777-5fa4-4aff-aef1-b0f8e482efc9 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:10.326713 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9613777-5fa4-4aff-aef1-b0f8e482efc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:10.327002 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9613777-5fa4-4aff-aef1-b0f8e482efc9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:10.335535 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9613777-5fa4-4aff-aef1-b0f8e482efc9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:10.337101 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9613777-5fa4-4aff-aef1-b0f8e482efc9 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:10.350478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-f9613777-5fa4-4aff-aef1-b0f8e482efc9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 16:22:10.350478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:10.350478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:10.350478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:10.350478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:10.350478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:10.350478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:10.350478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:10.350478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:10.350478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:10.350478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:10.350478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:10.350478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:22:10.350478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:22:10.350478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:22:10.350478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:22:10.351695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:10.351695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:10.351695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:22:10.351695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:22:10.351695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:22:10.351695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:22:10.351695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:10.351695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:10.351695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:10.351695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:10.351695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:10.351695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:10.351695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:10.351695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:10.351695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:10.351695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:10.351695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:10.351695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:10.352873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:10.352873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:10.352873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:22:10.352873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:22:10.352873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:22:10.352873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:22:10.352873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:22:10.352873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:22:10.352873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 16:22:10.352873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:22:10.352873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 603/1226] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:22:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:22:10.358266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58eebf-0b20-400c-868d-ad324296d59b None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:10.424394 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:10.502425 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58eebf-0b20-400c-868d-ad324296d59b None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:10.552189 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d8512-0820-46d6-b1b0-7ef3e3701f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:10.552798 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d8512-0820-46d6-b1b0-7ef3e3701f45 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:10.553069 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d8512-0820-46d6-b1b0-7ef3e3701f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:10.553333 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d8512-0820-46d6-b1b0-7ef3e3701f45 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:10.554054 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d8512-0820-46d6-b1b0-7ef3e3701f45 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:10.554352 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d8512-0820-46d6-b1b0-7ef3e3701f45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:10.555840 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d8512-0820-46d6-b1b0-7ef3e3701f45 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:10.585891 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 624/1227] 10.222.0.55 () {56 vars in 1143 bytes} [Tue Oct 4 16:22:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:10.587308 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9613777-5fa4-4aff-aef1-b0f8e482efc9 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:10.720300 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9613777-5fa4-4aff-aef1-b0f8e482efc9 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:10.768210 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51c21c-3198-49be-94d0-234a80fe7224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:10.768848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51c21c-3198-49be-94d0-234a80fe7224 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:10.769166 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51c21c-3198-49be-94d0-234a80fe7224 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:10.769435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51c21c-3198-49be-94d0-234a80fe7224 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:10.783010 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51c21c-3198-49be-94d0-234a80fe7224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:10.784545 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51c21c-3198-49be-94d0-234a80fe7224 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:10.800919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-cc51c21c-3198-49be-94d0-234a80fe7224 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:22:10.800919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:10.800919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:10.800919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:10.800919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:10.800919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:10.800919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:10.800919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:10.800919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:10.800919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:10.800919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:10.800919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:10.800919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:22:10.800919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:22:10.800919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:22:10.800919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:22:10.803269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:10.803269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:10.803269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:10.803269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:10.803269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:10.803269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:10.803269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:10.803269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:10.803269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:10.803269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:10.803269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:10.803269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:10.803269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:10.803269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:10.803269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:10.803269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:10.803269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:22:10.805683 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:22:10.805683 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:22:10.805683 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:22:10.807900 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 604/1228] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:22:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:10.810097 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d8512-0820-46d6-b1b0-7ef3e3701f45 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:10.944320 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d8512-0820-46d6-b1b0-7ef3e3701f45 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:10.947525 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:10.988721 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f985ef6-c8c3-461b-9c7d-f030457a55c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:10.989278 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f985ef6-c8c3-461b-9c7d-f030457a55c9 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:10.989552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f985ef6-c8c3-461b-9c7d-f030457a55c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:10.989823 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f985ef6-c8c3-461b-9c7d-f030457a55c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:10.990516 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f985ef6-c8c3-461b-9c7d-f030457a55c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:10.990851 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f985ef6-c8c3-461b-9c7d-f030457a55c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:10.992323 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f985ef6-c8c3-461b-9c7d-f030457a55c9 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:11.005436 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 625/1229] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:11.011718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51c21c-3198-49be-94d0-234a80fe7224 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:11.021912 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:11.162626 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51c21c-3198-49be-94d0-234a80fe7224 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:11.199329 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2918839-510b-498e-a853-e503d392473c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:11.199921 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2918839-510b-498e-a853-e503d392473c None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:11.200195 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2918839-510b-498e-a853-e503d392473c None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:11.200462 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2918839-510b-498e-a853-e503d392473c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:11.208864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2918839-510b-498e-a853-e503d392473c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:11.210321 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2918839-510b-498e-a853-e503d392473c None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:11.222800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-a2918839-510b-498e-a853-e503d392473c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:22:11.222800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:11.222800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:11.222800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:11.222800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:11.222800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:11.222800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:11.222800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:11.222800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:11.222800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:11.222800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:11.222800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:11.222800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:22:11.222800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:22:11.222800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:22:11.226006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:22:11.226006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:11.226006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:11.226006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:11.226006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:11.226006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:11.226006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:11.226006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:11.226006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:11.226006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:11.226006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:11.226006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:11.226006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:11.226006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:11.226006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:11.226006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:11.226006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:11.227302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:22:11.227302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:22:11.227302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:22:11.227302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:22:11.227302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:22:11.227302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:22:11.227302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:22:11.227302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:22:11.227302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 605/1230] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:22:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:22:11.232238 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f985ef6-c8c3-461b-9c7d-f030457a55c9 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:11.341337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f985ef6-c8c3-461b-9c7d-f030457a55c9 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:11.377363 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a4efc-c5ae-49df-8f86-aa77d9a6aa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:11.377974 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a4efc-c5ae-49df-8f86-aa77d9a6aa96 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:11.378248 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a4efc-c5ae-49df-8f86-aa77d9a6aa96 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:11.378511 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a4efc-c5ae-49df-8f86-aa77d9a6aa96 None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:11.379228 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a4efc-c5ae-49df-8f86-aa77d9a6aa96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:11.379527 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a4efc-c5ae-49df-8f86-aa77d9a6aa96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:11.380948 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a4efc-c5ae-49df-8f86-aa77d9a6aa96 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:11.395740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 626/1231] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:22:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:11.403219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2918839-510b-498e-a853-e503d392473c None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:11.487495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:11.529215 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2918839-510b-498e-a853-e503d392473c None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:11.569602 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ade209-ed0a-465c-9bb0-cb0d50905461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:11.570359 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ade209-ed0a-465c-9bb0-cb0d50905461 None admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:11.570699 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ade209-ed0a-465c-9bb0-cb0d50905461 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:11.570973 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ade209-ed0a-465c-9bb0-cb0d50905461 None admin] PATH_INFO: `/v3/projects/e480e782c4fa403a913ca7179db0843b/users/8cd59eac06e347ee9432185b24fdf773/roles/2165a726b4034e1584166027f2361b5f` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:11.589929 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ade209-ed0a-465c-9bb0-cb0d50905461 None admin] RBAC: Authorizing `identity:create_grant(project_id=e480e782c4fa403a913ca7179db0843b, user_id=8cd59eac06e347ee9432185b24fdf773, role_id=2165a726b4034e1584166027f2361b5f)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:11.591753 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ade209-ed0a-465c-9bb0-cb0d50905461 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:11.607029 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 606/1232] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Oct 4 16:22:11 2022] PUT /identity/v3/projects/e480e782c4fa403a913ca7179db0843b/users/8cd59eac06e347ee9432185b24fdf773/roles/2165a726b4034e1584166027f2361b5f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:22:13.826120 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d7bd8-8a2e-4568-a06a-691477e73b58 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:13.827368 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d7bd8-8a2e-4568-a06a-691477e73b58 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:13.827368 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d7bd8-8a2e-4568-a06a-691477e73b58 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:13.831123 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 627/1233] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:22:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:22:13.842152 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f67ed3-d6ee-4ee1-85d1-f4b2c1bbec4a None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:13.842960 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f67ed3-d6ee-4ee1-85d1-f4b2c1bbec4a None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:13.842960 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f67ed3-d6ee-4ee1-85d1-f4b2c1bbec4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:13.864259 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-38f67ed3-d6ee-4ee1-85d1-f4b2c1bbec4a None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:22:13.865595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-38f67ed3-d6ee-4ee1-85d1-f4b2c1bbec4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:22:13.949381 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 607/1234] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:22:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 16:22:14.257857 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d7bd8-8a2e-4568-a06a-691477e73b58 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:14.288600 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:14.385272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d7bd8-8a2e-4568-a06a-691477e73b58 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:14.427475 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641fcdd-3420-4234-8452-12fe68a92704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:14.428121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641fcdd-3420-4234-8452-12fe68a92704 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:14.428402 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641fcdd-3420-4234-8452-12fe68a92704 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:14.428672 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641fcdd-3420-4234-8452-12fe68a92704 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:14.441361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641fcdd-3420-4234-8452-12fe68a92704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:22:14.446434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-9641fcdd-3420-4234-8452-12fe68a92704 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:22:14.446434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:14.446434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:14.446434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:14.446434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:14.446434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:14.446434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:14.446434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:14.446434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:14.446434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:14.446434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:14.446434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:14.446434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:22:14.446434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:22:14.446434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:22:14.446434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:22:14.447725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:22:14.447725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:22:14.447725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:22:14.447725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:22:14.447725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:14.447725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:14.447725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:14.447725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:14.447725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:14.447725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:14.447725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:14.447725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:14.447725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:14.447725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:14.447725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:14.447725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:14.448604 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:14.448604 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:14.448604 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:14.448604 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:14.448604 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:22:14.448604 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:22:14.448604 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:22:14.448604 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:22:14.448604 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:22:14.448604 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:22:14.448604 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 16:22:14.448604 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:22:14.448604 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 628/1235] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Oct 4 16:22:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:14.453960 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f67ed3-d6ee-4ee1-85d1-f4b2c1bbec4a None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:14.506057 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:14.572928 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f67ed3-d6ee-4ee1-85d1-f4b2c1bbec4a None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:14.611296 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bad846-fbba-4f5e-9b1c-53f94418cfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:14.611921 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bad846-fbba-4f5e-9b1c-53f94418cfca None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:14.612198 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bad846-fbba-4f5e-9b1c-53f94418cfca None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:14.612464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bad846-fbba-4f5e-9b1c-53f94418cfca None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:14.613131 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bad846-fbba-4f5e-9b1c-53f94418cfca None admin] RBAC: Adding query filter params (name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:14.613490 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bad846-fbba-4f5e-9b1c-53f94418cfca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:14.614913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bad846-fbba-4f5e-9b1c-53f94418cfca None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:14.624790 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 608/1236] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Oct 4 16:22:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:22:14.631474 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641fcdd-3420-4234-8452-12fe68a92704 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:14.761574 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:14.781195 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641fcdd-3420-4234-8452-12fe68a92704 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:14.827056 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06df28-577e-4c8d-b2eb-64a9dcc13ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:14.827772 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06df28-577e-4c8d-b2eb-64a9dcc13ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:14.827938 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06df28-577e-4c8d-b2eb-64a9dcc13ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:14.828206 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06df28-577e-4c8d-b2eb-64a9dcc13ac9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:14.839277 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06df28-577e-4c8d-b2eb-64a9dcc13ac9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:14.841452 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06df28-577e-4c8d-b2eb-64a9dcc13ac9 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:14.860451 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-bf06df28-577e-4c8d-b2eb-64a9dcc13ac9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:22:14.860451 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:14.860451 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:14.860451 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:14.860451 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:14.860451 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:14.860451 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:14.860451 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:14.860451 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:14.860451 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:14.860451 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:14.860451 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:14.860451 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:22:14.860451 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:22:14.860451 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:22:14.860451 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:22:14.861728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:14.861728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:14.861728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:14.861728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:14.861728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:14.861728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:14.861728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:14.861728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:14.861728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:14.861728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:14.861728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:14.861728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:14.861728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:14.861728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:14.861728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:14.861728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:14.861728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:22:14.862826 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:22:14.862826 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:22:14.862826 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:22:14.866942 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 629/1237] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:22:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:14.868359 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bad846-fbba-4f5e-9b1c-53f94418cfca None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:14.992064 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bad846-fbba-4f5e-9b1c-53f94418cfca None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:15.006532 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:15.034197 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce9793-fbb3-4e11-a50f-73aa62d84ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:15.035199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce9793-fbb3-4e11-a50f-73aa62d84ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:15.035643 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce9793-fbb3-4e11-a50f-73aa62d84ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:15.036086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce9793-fbb3-4e11-a50f-73aa62d84ac4 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:15.037233 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce9793-fbb3-4e11-a50f-73aa62d84ac4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:15.037751 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce9793-fbb3-4e11-a50f-73aa62d84ac4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:15.040192 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce9793-fbb3-4e11-a50f-73aa62d84ac4 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:15.060687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 609/1238] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:22:15.062013 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06df28-577e-4c8d-b2eb-64a9dcc13ac9 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:15.183323 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06df28-577e-4c8d-b2eb-64a9dcc13ac9 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:15.227145 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88f1b6-0315-43af-8ea2-55cc75d54c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:15.227799 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88f1b6-0315-43af-8ea2-55cc75d54c85 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:15.228104 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88f1b6-0315-43af-8ea2-55cc75d54c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:15.228363 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88f1b6-0315-43af-8ea2-55cc75d54c85 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:15.231932 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:15.238092 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88f1b6-0315-43af-8ea2-55cc75d54c85 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:15.239774 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88f1b6-0315-43af-8ea2-55cc75d54c85 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:15.254423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-2c88f1b6-0315-43af-8ea2-55cc75d54c85 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 16:22:15.254423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:15.254423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:15.254423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:15.254423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:15.254423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:15.254423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:15.254423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:15.254423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:15.254423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:15.254423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:15.254423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:15.254423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:22:15.254423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:22:15.254423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:22:15.254423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:22:15.255609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:15.255609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:15.255609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:22:15.255609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:22:15.255609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:22:15.255609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:22:15.255609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:15.255609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:15.255609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:15.255609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:15.255609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:15.255609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:15.255609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:15.255609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:15.255609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:15.255609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:15.255609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:15.255609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:15.256652 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:15.256652 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:15.256652 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:22:15.256652 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:22:15.256652 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:22:15.256652 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:22:15.256652 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:22:15.256652 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:22:15.256652 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 16:22:15.256652 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:22:15.256652 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 630/1239] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:22:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:15.265043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce9793-fbb3-4e11-a50f-73aa62d84ac4 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:15.401247 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce9793-fbb3-4e11-a50f-73aa62d84ac4 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:15.444122 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c307d3-4be0-4348-951d-e053a6e08f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:15.444882 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c307d3-4be0-4348-951d-e053a6e08f3f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:15.445183 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c307d3-4be0-4348-951d-e053a6e08f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:15.445555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c307d3-4be0-4348-951d-e053a6e08f3f None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:15.446469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c307d3-4be0-4348-951d-e053a6e08f3f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:15.447107 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c307d3-4be0-4348-951d-e053a6e08f3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:15.448566 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c307d3-4be0-4348-951d-e053a6e08f3f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:15.467731 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 610/1240] 10.222.0.55 () {56 vars in 1143 bytes} [Tue Oct 4 16:22:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:15.474745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88f1b6-0315-43af-8ea2-55cc75d54c85 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:15.601852 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88f1b6-0315-43af-8ea2-55cc75d54c85 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:15.638753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d580ef9-8721-4794-a317-2dd64d55d381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:15.639399 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d580ef9-8721-4794-a317-2dd64d55d381 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:15.639673 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d580ef9-8721-4794-a317-2dd64d55d381 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:15.639939 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d580ef9-8721-4794-a317-2dd64d55d381 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:15.721375 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:15.728716 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d580ef9-8721-4794-a317-2dd64d55d381 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:15.730169 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d580ef9-8721-4794-a317-2dd64d55d381 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:15.891019 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 631/1241] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:22:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 16:22:15.899322 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c307d3-4be0-4348-951d-e053a6e08f3f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:15.932361 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:16.025461 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c307d3-4be0-4348-951d-e053a6e08f3f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:16.072189 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0f1b3-4c01-4900-8fab-98f8f80d0a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:16.072964 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0f1b3-4c01-4900-8fab-98f8f80d0a89 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:16.073411 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0f1b3-4c01-4900-8fab-98f8f80d0a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:16.073687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0f1b3-4c01-4900-8fab-98f8f80d0a89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:16.094717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0f1b3-4c01-4900-8fab-98f8f80d0a89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:16.097222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0f1b3-4c01-4900-8fab-98f8f80d0a89 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:16.116043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-69e0f1b3-4c01-4900-8fab-98f8f80d0a89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:22:16.116043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:16.116043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:16.116043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:16.116043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:16.116043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:16.116043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:16.116043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:16.116043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:16.116043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:16.116043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:16.116043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:16.116043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:22:16.116043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:22:16.116043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:22:16.116043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:22:16.117305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:16.117305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:16.117305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:16.117305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:16.117305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:16.117305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:16.117305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:16.117305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:16.117305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:16.117305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:16.117305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:16.117305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:16.117305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:16.117305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:16.117305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:16.117305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:16.117305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:22:16.118561 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:22:16.118561 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:22:16.118561 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:22:16.118561 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 611/1242] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:22:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:22:16.124401 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d580ef9-8721-4794-a317-2dd64d55d381 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:16.231021 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:16.237453 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d580ef9-8721-4794-a317-2dd64d55d381 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:16.282598 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fdcc14-a212-4b34-95c3-adab93a00ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:16.283214 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdcc14-a212-4b34-95c3-adab93a00ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:16.283468 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdcc14-a212-4b34-95c3-adab93a00ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:16.283732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdcc14-a212-4b34-95c3-adab93a00ca5 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:16.284479 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fdcc14-a212-4b34-95c3-adab93a00ca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:16.284843 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fdcc14-a212-4b34-95c3-adab93a00ca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:16.286325 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fdcc14-a212-4b34-95c3-adab93a00ca5 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:16.300603 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 632/1243] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:16.307001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0f1b3-4c01-4900-8fab-98f8f80d0a89 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:16.439526 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:16.467843 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0f1b3-4c01-4900-8fab-98f8f80d0a89 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:16.508068 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8839b52-b3b6-4cc9-84be-0bc7f84cb941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:16.508880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8839b52-b3b6-4cc9-84be-0bc7f84cb941 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:16.509202 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8839b52-b3b6-4cc9-84be-0bc7f84cb941 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:16.509494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8839b52-b3b6-4cc9-84be-0bc7f84cb941 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:16.517163 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8839b52-b3b6-4cc9-84be-0bc7f84cb941 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:16.518661 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8839b52-b3b6-4cc9-84be-0bc7f84cb941 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:16.531166 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-b8839b52-b3b6-4cc9-84be-0bc7f84cb941 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:22:16.531166 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:16.531166 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:16.531166 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:16.531166 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:16.531166 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:16.531166 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:16.531166 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:16.531166 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:16.531166 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:16.531166 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:16.531166 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:16.531166 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:22:16.531166 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:22:16.531166 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:22:16.532528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:22:16.532528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:16.532528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:16.532528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:16.532528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:16.532528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:16.532528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:16.532528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:16.532528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:16.532528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:16.532528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:16.532528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:16.532528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:16.532528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:16.532528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:16.532528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:16.532528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:16.533839 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:22:16.533839 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:22:16.533839 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:22:16.533839 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:22:16.533839 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:22:16.533839 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:22:16.533839 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:22:16.533839 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:22:16.533839 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 612/1244] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:22:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:16.538376 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fdcc14-a212-4b34-95c3-adab93a00ca5 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:16.668130 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fdcc14-a212-4b34-95c3-adab93a00ca5 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:16.709020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1446f32-08ad-45c8-b55e-2817bb216a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:16.709743 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1446f32-08ad-45c8-b55e-2817bb216a11 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:16.710107 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1446f32-08ad-45c8-b55e-2817bb216a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:16.710424 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1446f32-08ad-45c8-b55e-2817bb216a11 None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:16.711351 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1446f32-08ad-45c8-b55e-2817bb216a11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:16.711726 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1446f32-08ad-45c8-b55e-2817bb216a11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:16.713541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1446f32-08ad-45c8-b55e-2817bb216a11 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:16.729011 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 633/1245] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:22:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:22:16.735429 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8839b52-b3b6-4cc9-84be-0bc7f84cb941 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:16.869055 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8839b52-b3b6-4cc9-84be-0bc7f84cb941 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:16.926303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f088e-af13-4a8f-9c9a-6696dfd3a373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:16.927066 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f088e-af13-4a8f-9c9a-6696dfd3a373 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:16.927164 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f088e-af13-4a8f-9c9a-6696dfd3a373 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:16.927597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f088e-af13-4a8f-9c9a-6696dfd3a373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:16.928444 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f088e-af13-4a8f-9c9a-6696dfd3a373 None admin] RBAC: Adding query filter params (role.id=2165a726b4034e1584166027f2361b5f, scope.project.id=e480e782c4fa403a913ca7179db0843b, user.id=8cd59eac06e347ee9432185b24fdf773) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:16.928723 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f088e-af13-4a8f-9c9a-6696dfd3a373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:16.930146 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f088e-af13-4a8f-9c9a-6696dfd3a373 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:16.937288 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 613/1246] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:22:16 2022] GET /identity/v3/role_assignments?user.id=8cd59eac06e347ee9432185b24fdf773&scope.project.id=e480e782c4fa403a913ca7179db0843b&role.id=2165a726b4034e1584166027f2361b5f => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:19.573734 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e229f-0d1f-4aa0-ae2a-09e0ee3f0b48 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:19.574369 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e229f-0d1f-4aa0-ae2a-09e0ee3f0b48 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:19.574369 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e229f-0d1f-4aa0-ae2a-09e0ee3f0b48 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:19.575936 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 634/1247] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:22:19.582022 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff0387-bb4b-4398-98e0-1eaecaf701d6 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:19.582414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff0387-bb4b-4398-98e0-1eaecaf701d6 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:19.582567 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff0387-bb4b-4398-98e0-1eaecaf701d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:19.589244 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:19.605049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-c7ff0387-bb4b-4398-98e0-1eaecaf701d6 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:22:19.606478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c7ff0387-bb4b-4398-98e0-1eaecaf701d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:22:19.702639 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 614/1248] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:22:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 16:22:19.987377 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e229f-0d1f-4aa0-ae2a-09e0ee3f0b48 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:20.007564 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:20.107612 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e229f-0d1f-4aa0-ae2a-09e0ee3f0b48 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:20.160210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15610d8-b6af-4ae4-8b48-1a0bb0bca942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:20.160897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15610d8-b6af-4ae4-8b48-1a0bb0bca942 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:20.161176 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15610d8-b6af-4ae4-8b48-1a0bb0bca942 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:20.161447 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15610d8-b6af-4ae4-8b48-1a0bb0bca942 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:20.173713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15610d8-b6af-4ae4-8b48-1a0bb0bca942 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:22:20.178643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-d15610d8-b6af-4ae4-8b48-1a0bb0bca942 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:22:20.178643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:20.178643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:20.178643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:20.178643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:20.178643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:20.178643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:20.178643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:20.178643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:20.178643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:20.178643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:20.178643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:20.178643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:22:20.178643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:22:20.178643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:22:20.178643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:22:20.179896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:22:20.179896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:22:20.179896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:22:20.179896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:22:20.179896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:20.179896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:20.179896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:20.179896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:20.179896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:20.179896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:20.179896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:20.179896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:20.179896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:20.179896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:20.179896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:20.179896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:20.180758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:20.180758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:20.180758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:20.180758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:20.180758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:22:20.180758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:22:20.180758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:22:20.180758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:22:20.180758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:22:20.180758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:22:20.180758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:22:20.180758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:22:20.180758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 635/1249] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:22:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:20.186649 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff0387-bb4b-4398-98e0-1eaecaf701d6 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:20.336018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff0387-bb4b-4398-98e0-1eaecaf701d6 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:20.382520 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:20.389763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17eaf2-97a9-4013-af00-6a300f948d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:20.390666 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17eaf2-97a9-4013-af00-6a300f948d79 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:20.391045 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17eaf2-97a9-4013-af00-6a300f948d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:20.391429 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17eaf2-97a9-4013-af00-6a300f948d79 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:20.392274 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17eaf2-97a9-4013-af00-6a300f948d79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:20.392729 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17eaf2-97a9-4013-af00-6a300f948d79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:20.394366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17eaf2-97a9-4013-af00-6a300f948d79 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:20.404818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 615/1250] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:22:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:20.411940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15610d8-b6af-4ae4-8b48-1a0bb0bca942 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:20.524273 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:20.553929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15610d8-b6af-4ae4-8b48-1a0bb0bca942 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:20.594042 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f2427-e2f3-49c3-b649-d823620e391a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:20.594696 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f2427-e2f3-49c3-b649-d823620e391a None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:20.594965 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f2427-e2f3-49c3-b649-d823620e391a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:20.595269 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f2427-e2f3-49c3-b649-d823620e391a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:20.607921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f2427-e2f3-49c3-b649-d823620e391a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:20.609391 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f2427-e2f3-49c3-b649-d823620e391a None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:20.627366 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-a94f2427-e2f3-49c3-b649-d823620e391a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:22:20.627366 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:20.627366 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:20.627366 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:20.627366 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:20.627366 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:20.627366 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:20.627366 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:20.627366 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:20.627366 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:20.627366 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:20.627366 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:20.627366 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:22:20.627366 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:22:20.627366 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:22:20.627366 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:22:20.628586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:20.628586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:20.628586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:20.628586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:20.628586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:20.628586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:20.628586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:20.628586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:20.628586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:20.628586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:20.628586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:20.628586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:20.628586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:20.628586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:20.628586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:20.628586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:20.628586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:22:20.629970 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:22:20.629970 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:22:20.629970 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:22:20.629970 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 636/1251] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:22:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:20.635401 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17eaf2-97a9-4013-af00-6a300f948d79 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:20.781177 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17eaf2-97a9-4013-af00-6a300f948d79 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:20.823219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f56d0-bd17-43da-babe-55f18a2157ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:20.823840 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f56d0-bd17-43da-babe-55f18a2157ad None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:20.824113 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f56d0-bd17-43da-babe-55f18a2157ad None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:20.824401 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f56d0-bd17-43da-babe-55f18a2157ad None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:20.825031 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f56d0-bd17-43da-babe-55f18a2157ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:20.825327 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f56d0-bd17-43da-babe-55f18a2157ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:20.827090 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f56d0-bd17-43da-babe-55f18a2157ad None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:20.842350 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 616/1252] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:20.851056 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f2427-e2f3-49c3-b649-d823620e391a None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:20.977019 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f2427-e2f3-49c3-b649-d823620e391a None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:21.009944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:21.018912 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa596c36-4e0a-43eb-842c-8030b09a77ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:21.019660 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa596c36-4e0a-43eb-842c-8030b09a77ec None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:21.019938 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa596c36-4e0a-43eb-842c-8030b09a77ec None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:21.020247 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa596c36-4e0a-43eb-842c-8030b09a77ec None admin] PATH_INFO: `/v3/users/placement` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:21.030446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa596c36-4e0a-43eb-842c-8030b09a77ec None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:21.033430 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa596c36-4e0a-43eb-842c-8030b09a77ec None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:21.051677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-aa596c36-4e0a-43eb-842c-8030b09a77ec None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 16:22:21.051677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:21.051677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:21.051677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:21.051677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:21.051677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:21.051677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:21.051677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:21.051677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:21.051677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:21.051677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:21.051677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:21.051677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:22:21.051677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:22:21.051677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:22:21.051677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:22:21.052919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:21.052919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:21.052919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:22:21.052919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:22:21.052919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:22:21.052919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:22:21.052919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:21.052919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:21.052919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:21.052919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:21.052919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:21.052919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:21.052919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:21.052919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:21.052919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:21.052919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:21.052919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:21.052919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:21.054034 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:21.054034 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:21.054034 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:22:21.054034 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:22:21.054034 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:22:21.054034 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:22:21.054034 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:22:21.054034 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:22:21.054034 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 16:22:21.054034 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:22:21.054034 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 637/1253] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:22:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:21.057495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f56d0-bd17-43da-babe-55f18a2157ad None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:21.146455 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:21.204693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f56d0-bd17-43da-babe-55f18a2157ad None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:21.246080 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001dae9-a632-4feb-9a70-887f40099c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:21.247413 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001dae9-a632-4feb-9a70-887f40099c40 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:21.247791 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001dae9-a632-4feb-9a70-887f40099c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:21.248318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001dae9-a632-4feb-9a70-887f40099c40 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:21.249888 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001dae9-a632-4feb-9a70-887f40099c40 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:21.250443 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001dae9-a632-4feb-9a70-887f40099c40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:21.252142 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001dae9-a632-4feb-9a70-887f40099c40 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:21.271681 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 617/1254] 10.222.0.55 () {56 vars in 1143 bytes} [Tue Oct 4 16:22:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:21.283814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa596c36-4e0a-43eb-842c-8030b09a77ec None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:21.403475 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa596c36-4e0a-43eb-842c-8030b09a77ec None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:21.449371 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe023d-bac4-4b68-9bb1-29a8db746793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:21.450003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe023d-bac4-4b68-9bb1-29a8db746793 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:21.450278 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe023d-bac4-4b68-9bb1-29a8db746793 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:21.450548 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe023d-bac4-4b68-9bb1-29a8db746793 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:21.517566 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:21.536569 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe023d-bac4-4b68-9bb1-29a8db746793 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:21.538193 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe023d-bac4-4b68-9bb1-29a8db746793 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:21.666712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 638/1255] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:22:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 16:22:21.673356 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001dae9-a632-4feb-9a70-887f40099c40 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:21.809491 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001dae9-a632-4feb-9a70-887f40099c40 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:21.826760 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:21.849992 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26be7b-db97-4800-a83c-3a0767739dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:21.850636 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26be7b-db97-4800-a83c-3a0767739dbc None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:21.850919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26be7b-db97-4800-a83c-3a0767739dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:21.851301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26be7b-db97-4800-a83c-3a0767739dbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:21.866904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26be7b-db97-4800-a83c-3a0767739dbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:21.868593 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26be7b-db97-4800-a83c-3a0767739dbc None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:21.885524 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-fc26be7b-db97-4800-a83c-3a0767739dbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:22:21.885524 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:21.885524 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:21.885524 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:21.885524 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:21.885524 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:21.885524 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:21.885524 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:21.885524 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:21.885524 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:21.885524 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:21.885524 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:21.885524 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:22:21.885524 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:22:21.885524 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:22:21.885524 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:22:21.886763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:21.886763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:21.886763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:21.886763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:21.886763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:21.886763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:21.886763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:21.886763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:21.886763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:21.886763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:21.886763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:21.886763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:21.886763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:21.886763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:21.886763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:21.886763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:21.886763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:22:21.888112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:22:21.888112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:22:21.888112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:22:21.888112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 618/1256] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:22:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:21.892949 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe023d-bac4-4b68-9bb1-29a8db746793 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:21.992030 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:22.004692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe023d-bac4-4b68-9bb1-29a8db746793 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:22.040445 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e307d-029e-4c14-91c1-c6137f3aa06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:22.041071 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e307d-029e-4c14-91c1-c6137f3aa06a None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:22.041725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e307d-029e-4c14-91c1-c6137f3aa06a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:22.042003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e307d-029e-4c14-91c1-c6137f3aa06a None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:22.042616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e307d-029e-4c14-91c1-c6137f3aa06a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:22.042915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e307d-029e-4c14-91c1-c6137f3aa06a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:22.044383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e307d-029e-4c14-91c1-c6137f3aa06a None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:22.058616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 639/1257] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:22:22.064463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26be7b-db97-4800-a83c-3a0767739dbc None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:22.181196 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26be7b-db97-4800-a83c-3a0767739dbc None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:22.221747 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5b752-7982-4783-87f5-2c218db60505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:22.222395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5b752-7982-4783-87f5-2c218db60505 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:22.222695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5b752-7982-4783-87f5-2c218db60505 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:22.222965 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5b752-7982-4783-87f5-2c218db60505 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:22.230426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5b752-7982-4783-87f5-2c218db60505 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:22.231909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5b752-7982-4783-87f5-2c218db60505 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:22.249454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-2ef5b752-7982-4783-87f5-2c218db60505 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:22:22.249454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:22.249454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:22.249454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:22.249454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:22.249454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:22.249454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:22.249454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:22.249454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:22.249454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:22.249454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:22.249454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:22.249454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:22:22.249454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:22:22.249454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:22:22.250512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:22:22.250512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:22.250512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:22.250512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:22.250512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:22.250512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:22.250512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:22.250512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:22.250512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:22.250512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:22.250512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:22.250512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:22.250512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:22.250512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:22.250512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:22.250512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:22.250512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:22.251595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:22:22.251595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:22:22.251595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:22:22.251595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:22:22.251595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:22:22.251595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:22:22.251595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:22:22.251595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:22:22.251595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 619/1258] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:22:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:22.256945 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e307d-029e-4c14-91c1-c6137f3aa06a None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:22.387334 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e307d-029e-4c14-91c1-c6137f3aa06a None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:22.426347 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044017c-3e30-4616-8be9-e85ba676566e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:22.427070 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044017c-3e30-4616-8be9-e85ba676566e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:22.427347 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044017c-3e30-4616-8be9-e85ba676566e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:22.427724 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044017c-3e30-4616-8be9-e85ba676566e None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:22.428534 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044017c-3e30-4616-8be9-e85ba676566e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:22.429009 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044017c-3e30-4616-8be9-e85ba676566e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:22.430594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044017c-3e30-4616-8be9-e85ba676566e None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:22.446878 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 640/1259] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:22:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:22.453762 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5b752-7982-4783-87f5-2c218db60505 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:22.479956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:22.570094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5b752-7982-4783-87f5-2c218db60505 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:22.614300 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f5100-f6e4-42b6-95cf-c75147179a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:22.618181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f5100-f6e4-42b6-95cf-c75147179a52 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:22.618181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f5100-f6e4-42b6-95cf-c75147179a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:22.618181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f5100-f6e4-42b6-95cf-c75147179a52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:22.618181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f5100-f6e4-42b6-95cf-c75147179a52 None admin] RBAC: Adding query filter params (role.id=066f46534195417295e63a5316632eae, scope.project.id=e480e782c4fa403a913ca7179db0843b, user.id=8cd59eac06e347ee9432185b24fdf773) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:22.618181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f5100-f6e4-42b6-95cf-c75147179a52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:22.618649 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f5100-f6e4-42b6-95cf-c75147179a52 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:22.624606 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 620/1260] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:22:22 2022] GET /identity/v3/role_assignments?user.id=8cd59eac06e347ee9432185b24fdf773&scope.project.id=e480e782c4fa403a913ca7179db0843b&role.id=066f46534195417295e63a5316632eae => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:24.846364 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c400a38-efd4-4009-b68d-109c7d75fc94 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:24.846914 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c400a38-efd4-4009-b68d-109c7d75fc94 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:24.846914 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c400a38-efd4-4009-b68d-109c7d75fc94 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:24.848150 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 641/1261] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:22:24.854230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e622d-9c36-4905-bfa9-98da3e83b554 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:24.854864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e622d-9c36-4905-bfa9-98da3e83b554 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:24.854864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e622d-9c36-4905-bfa9-98da3e83b554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:24.873739 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-ef0e622d-9c36-4905-bfa9-98da3e83b554 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:22:24.874949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ef0e622d-9c36-4905-bfa9-98da3e83b554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:22:24.946504 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 621/1262] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:22:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 16:22:25.234381 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c400a38-efd4-4009-b68d-109c7d75fc94 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:25.245894 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:25.349553 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c400a38-efd4-4009-b68d-109c7d75fc94 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:25.392261 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb5103-3c84-456e-82d3-e0a41a97638a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:25.392894 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb5103-3c84-456e-82d3-e0a41a97638a None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:25.393166 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb5103-3c84-456e-82d3-e0a41a97638a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:25.393441 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb5103-3c84-456e-82d3-e0a41a97638a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:25.405025 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb5103-3c84-456e-82d3-e0a41a97638a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:22:25.409921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-55eb5103-3c84-456e-82d3-e0a41a97638a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:22:25.409921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:25.409921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:25.409921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:25.409921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:25.409921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:25.409921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:25.409921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:25.409921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:25.409921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:25.409921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:25.409921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:25.409921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:22:25.409921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:22:25.409921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:22:25.409921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:22:25.411048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:22:25.411048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:22:25.411048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:22:25.411048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:22:25.411048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:25.411048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:25.411048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:25.411048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:25.411048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:25.411048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:25.411048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:25.411048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:25.411048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:25.411048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:25.411048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:25.411048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:25.412265 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:25.412265 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:25.412265 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:25.412265 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:25.412265 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:22:25.412265 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:22:25.412265 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:22:25.412265 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:22:25.412265 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:22:25.412265 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:22:25.412265 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:22:25.412265 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:22:25.415235 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 642/1263] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:22:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 16:22:25.418148 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e622d-9c36-4905-bfa9-98da3e83b554 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:25.439927 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:25.529180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e622d-9c36-4905-bfa9-98da3e83b554 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:25.572611 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be411d1-f2dd-4bf7-970c-3ece24b95947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:25.573223 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be411d1-f2dd-4bf7-970c-3ece24b95947 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:25.573497 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be411d1-f2dd-4bf7-970c-3ece24b95947 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:25.573774 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be411d1-f2dd-4bf7-970c-3ece24b95947 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:25.574447 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be411d1-f2dd-4bf7-970c-3ece24b95947 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:25.574746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be411d1-f2dd-4bf7-970c-3ece24b95947 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:25.576255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be411d1-f2dd-4bf7-970c-3ece24b95947 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:25.586194 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 622/1264] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:22:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:25.594668 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb5103-3c84-456e-82d3-e0a41a97638a None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:25.676419 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:25.724836 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb5103-3c84-456e-82d3-e0a41a97638a None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:25.764053 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8fb9a-3122-4d64-a079-715de6bfa6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:25.764700 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8fb9a-3122-4d64-a079-715de6bfa6e6 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:25.764973 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8fb9a-3122-4d64-a079-715de6bfa6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:25.765242 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8fb9a-3122-4d64-a079-715de6bfa6e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:25.782297 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8fb9a-3122-4d64-a079-715de6bfa6e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:25.783712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8fb9a-3122-4d64-a079-715de6bfa6e6 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:25.799875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-c6a8fb9a-3122-4d64-a079-715de6bfa6e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:22:25.799875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:25.799875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:25.799875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:25.799875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:25.799875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:25.799875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:25.799875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:25.799875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:25.799875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:25.799875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:25.799875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:25.799875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:22:25.799875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:22:25.799875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:22:25.799875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:22:25.801087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:25.801087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:25.801087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:25.801087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:25.801087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:25.801087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:25.801087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:25.801087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:25.801087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:25.801087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:25.801087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:25.801087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:25.801087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:25.801087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:25.801087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:25.801087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:25.801087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:22:25.802324 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:22:25.802324 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:22:25.802324 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:22:25.802324 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 643/1265] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:22:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:25.807152 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be411d1-f2dd-4bf7-970c-3ece24b95947 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:25.896681 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:25.919413 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be411d1-f2dd-4bf7-970c-3ece24b95947 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:25.962674 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915b344-9aae-4651-a432-cdf4de422b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:25.963314 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915b344-9aae-4651-a432-cdf4de422b2d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:25.963587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915b344-9aae-4651-a432-cdf4de422b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:25.963847 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915b344-9aae-4651-a432-cdf4de422b2d None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:25.964490 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915b344-9aae-4651-a432-cdf4de422b2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:25.964783 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915b344-9aae-4651-a432-cdf4de422b2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:25.966147 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915b344-9aae-4651-a432-cdf4de422b2d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:25.978359 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 623/1266] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:25.984455 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8fb9a-3122-4d64-a079-715de6bfa6e6 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:26.100970 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8fb9a-3122-4d64-a079-715de6bfa6e6 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:26.123476 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:26.139603 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ca7bc-d13c-4907-b5bd-28080be08ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:26.140256 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ca7bc-d13c-4907-b5bd-28080be08ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:26.140526 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ca7bc-d13c-4907-b5bd-28080be08ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:26.140801 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ca7bc-d13c-4907-b5bd-28080be08ff7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:26.149287 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ca7bc-d13c-4907-b5bd-28080be08ff7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:26.150873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ca7bc-d13c-4907-b5bd-28080be08ff7 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:26.163448 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-2c2ca7bc-d13c-4907-b5bd-28080be08ff7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 16:22:26.163448 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:26.163448 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:26.163448 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:26.163448 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:26.163448 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:26.163448 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:26.163448 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:26.163448 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:26.163448 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:26.163448 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:26.163448 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:26.163448 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:22:26.163448 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:22:26.163448 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:22:26.163448 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:22:26.164544 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:26.164544 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:26.164544 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:22:26.164544 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:22:26.164544 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:22:26.164544 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:22:26.164544 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:26.164544 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:26.164544 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:26.164544 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:26.164544 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:26.164544 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:26.164544 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:26.164544 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:26.164544 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:26.164544 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:26.164544 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:26.164544 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:26.165578 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:26.165578 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:26.165578 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:22:26.165578 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:22:26.165578 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:22:26.165578 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:22:26.165578 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:22:26.165578 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:22:26.165578 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 16:22:26.165578 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:22:26.165578 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 644/1267] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:22:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:26.171172 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915b344-9aae-4651-a432-cdf4de422b2d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:26.288948 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915b344-9aae-4651-a432-cdf4de422b2d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:26.333422 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56918dae-d033-4b24-a591-463ce46751e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:26.334267 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56918dae-d033-4b24-a591-463ce46751e5 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:26.334602 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56918dae-d033-4b24-a591-463ce46751e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:26.334872 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56918dae-d033-4b24-a591-463ce46751e5 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:26.335657 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56918dae-d033-4b24-a591-463ce46751e5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:26.335957 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56918dae-d033-4b24-a591-463ce46751e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:26.337471 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56918dae-d033-4b24-a591-463ce46751e5 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:26.346850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:26.355794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 624/1268] 10.222.0.55 () {56 vars in 1143 bytes} [Tue Oct 4 16:22:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:26.361887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ca7bc-d13c-4907-b5bd-28080be08ff7 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:26.471416 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ca7bc-d13c-4907-b5bd-28080be08ff7 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:26.511265 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d35c7-f82a-4258-9f44-410f32300876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:26.511890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d35c7-f82a-4258-9f44-410f32300876 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:26.512172 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d35c7-f82a-4258-9f44-410f32300876 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:26.512447 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d35c7-f82a-4258-9f44-410f32300876 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:26.524085 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d35c7-f82a-4258-9f44-410f32300876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:26.525569 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d35c7-f82a-4258-9f44-410f32300876 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:26.541118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-0d4d35c7-f82a-4258-9f44-410f32300876 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:22:26.541118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:26.541118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:26.541118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:26.541118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:26.541118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:26.541118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:26.541118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:26.541118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:26.541118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:26.541118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:26.541118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:26.541118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:22:26.541118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:22:26.541118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:22:26.541118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:22:26.542706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:26.542706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:26.542706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:26.542706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:26.542706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:26.542706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:26.542706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:26.542706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:26.542706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:26.542706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:26.542706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:26.542706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:26.542706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:26.542706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:26.542706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:26.542706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:26.542706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:22:26.543920 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:22:26.543920 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:22:26.543920 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:22:26.543920 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 645/1269] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:22:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:26.548653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56918dae-d033-4b24-a591-463ce46751e5 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:26.671987 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56918dae-d033-4b24-a591-463ce46751e5 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:26.707595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ebdc4-e96b-43f1-80f3-3de3dae1e861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:26.708168 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ebdc4-e96b-43f1-80f3-3de3dae1e861 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:26.708445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ebdc4-e96b-43f1-80f3-3de3dae1e861 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:26.708713 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ebdc4-e96b-43f1-80f3-3de3dae1e861 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:26.709374 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ebdc4-e96b-43f1-80f3-3de3dae1e861 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:26.709672 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ebdc4-e96b-43f1-80f3-3de3dae1e861 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:26.711078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ebdc4-e96b-43f1-80f3-3de3dae1e861 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:26.722793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 625/1270] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:26.728683 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d35c7-f82a-4258-9f44-410f32300876 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:26.761277 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:26.835506 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d35c7-f82a-4258-9f44-410f32300876 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:26.874627 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8a508-ee58-4cd5-ba28-c3c4f8f28fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:26.875307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8a508-ee58-4cd5-ba28-c3c4f8f28fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:26.875585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8a508-ee58-4cd5-ba28-c3c4f8f28fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:26.875833 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8a508-ee58-4cd5-ba28-c3c4f8f28fc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:26.883713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8a508-ee58-4cd5-ba28-c3c4f8f28fc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:26.885432 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8a508-ee58-4cd5-ba28-c3c4f8f28fc4 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:26.898410 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-99e8a508-ee58-4cd5-ba28-c3c4f8f28fc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:22:26.898410 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:26.898410 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:26.898410 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:26.898410 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:26.898410 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:26.898410 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:26.898410 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:26.898410 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:26.898410 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:26.898410 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:26.898410 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:26.898410 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:22:26.898410 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:22:26.898410 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:22:26.899490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:22:26.899490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:26.899490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:26.899490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:26.899490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:26.899490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:26.899490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:26.899490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:26.899490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:26.899490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:26.899490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:26.899490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:26.899490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:26.899490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:26.899490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:26.899490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:26.899490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:26.900530 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:22:26.900530 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:22:26.900530 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:22:26.900530 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:22:26.900530 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:22:26.900530 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:22:26.900530 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:22:26.900530 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:22:26.900530 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 646/1271] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:22:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:26.908428 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ebdc4-e96b-43f1-80f3-3de3dae1e861 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:26.973656 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:27.022356 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ebdc4-e96b-43f1-80f3-3de3dae1e861 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:27.060150 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee31e2-0c81-4419-b4e2-7fe3c025c348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:27.060808 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee31e2-0c81-4419-b4e2-7fe3c025c348 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:27.061078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee31e2-0c81-4419-b4e2-7fe3c025c348 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:27.061342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee31e2-0c81-4419-b4e2-7fe3c025c348 None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:27.062041 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee31e2-0c81-4419-b4e2-7fe3c025c348 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:27.062341 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee31e2-0c81-4419-b4e2-7fe3c025c348 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:27.063829 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee31e2-0c81-4419-b4e2-7fe3c025c348 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:27.079742 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 626/1272] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:22:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:27.086706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8a508-ee58-4cd5-ba28-c3c4f8f28fc4 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:27.207249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:27.219919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8a508-ee58-4cd5-ba28-c3c4f8f28fc4 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:27.261439 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46312eb6-0b8d-4b80-9972-9a3159d2de8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:27.262025 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46312eb6-0b8d-4b80-9972-9a3159d2de8a None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:27.262306 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46312eb6-0b8d-4b80-9972-9a3159d2de8a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:27.262570 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46312eb6-0b8d-4b80-9972-9a3159d2de8a None admin] PATH_INFO: `/v3/projects/e480e782c4fa403a913ca7179db0843b/users/8cd59eac06e347ee9432185b24fdf773/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:27.264600 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46312eb6-0b8d-4b80-9972-9a3159d2de8a None admin] RBAC: Authorizing `identity:create_grant(project_id=e480e782c4fa403a913ca7179db0843b, user_id=8cd59eac06e347ee9432185b24fdf773, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:27.266074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46312eb6-0b8d-4b80-9972-9a3159d2de8a None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:27.281007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 647/1273] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Oct 4 16:22:27 2022] PUT /identity/v3/projects/e480e782c4fa403a913ca7179db0843b/users/8cd59eac06e347ee9432185b24fdf773/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:22:29.416991 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58721c12-4494-4047-946a-731dc244b37c None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:29.417598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58721c12-4494-4047-946a-731dc244b37c None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:29.417598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58721c12-4494-4047-946a-731dc244b37c None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:29.418878 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 627/1274] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:22:29.424750 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e59a51-381f-40a3-aaad-1e5063b9250b None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:29.425308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e59a51-381f-40a3-aaad-1e5063b9250b None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:29.425308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e59a51-381f-40a3-aaad-1e5063b9250b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:29.444752 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-c1e59a51-381f-40a3-aaad-1e5063b9250b None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:22:29.446017 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-c1e59a51-381f-40a3-aaad-1e5063b9250b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:22:29.524452 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 648/1275] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:22:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:22:29.789501 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58721c12-4494-4047-946a-731dc244b37c None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:29.895140 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58721c12-4494-4047-946a-731dc244b37c None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:29.914710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:29.936113 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa38194-ac7c-4a4e-a111-b38f6802a9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:29.936677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa38194-ac7c-4a4e-a111-b38f6802a9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:29.936937 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa38194-ac7c-4a4e-a111-b38f6802a9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:29.937225 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa38194-ac7c-4a4e-a111-b38f6802a9b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:29.948825 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa38194-ac7c-4a4e-a111-b38f6802a9b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 16:22:29.953710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-0fa38194-ac7c-4a4e-a111-b38f6802a9b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:22:29.953710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:29.953710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:29.953710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:29.953710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:29.953710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:29.953710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:29.953710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:29.953710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:29.953710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:29.953710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:29.953710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:29.953710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 16:22:29.953710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 16:22:29.953710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 16:22:29.953710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 16:22:29.954975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 16:22:29.954975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 16:22:29.954975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 16:22:29.954975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 16:22:29.954975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:29.954975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:29.954975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:29.954975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:29.954975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:29.954975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:29.954975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:29.954975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:29.954975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:29.954975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:29.954975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:29.954975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:29.957292 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:29.957292 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:29.957292 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:29.957292 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:29.957292 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 16:22:29.957292 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 16:22:29.957292 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 16:22:29.957292 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 16:22:29.957292 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 16:22:29.957292 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 16:22:29.957292 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 16:22:29.957292 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:22:29.957292 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 628/1276] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Oct 4 16:22:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:29.962923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e59a51-381f-40a3-aaad-1e5063b9250b None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:30.051927 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:30.072277 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e59a51-381f-40a3-aaad-1e5063b9250b None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:30.116513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97ce7e-a2f4-4c77-a8b8-889542b67eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:30.117139 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97ce7e-a2f4-4c77-a8b8-889542b67eaa None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:30.117411 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97ce7e-a2f4-4c77-a8b8-889542b67eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:30.117674 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97ce7e-a2f4-4c77-a8b8-889542b67eaa None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:30.118486 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97ce7e-a2f4-4c77-a8b8-889542b67eaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:30.118838 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97ce7e-a2f4-4c77-a8b8-889542b67eaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:30.120305 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97ce7e-a2f4-4c77-a8b8-889542b67eaa None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:30.130889 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 649/1277] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Oct 4 16:22:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:30.137096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa38194-ac7c-4a4e-a111-b38f6802a9b1 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:30.250461 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa38194-ac7c-4a4e-a111-b38f6802a9b1 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:30.286079 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c28477-6bd0-460d-b024-df0bb64e0b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:30.286709 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c28477-6bd0-460d-b024-df0bb64e0b15 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:30.287017 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c28477-6bd0-460d-b024-df0bb64e0b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:30.287282 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c28477-6bd0-460d-b024-df0bb64e0b15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:30.299076 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c28477-6bd0-460d-b024-df0bb64e0b15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:30.300566 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c28477-6bd0-460d-b024-df0bb64e0b15 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:30.316048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-f5c28477-6bd0-460d-b024-df0bb64e0b15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:22:30.316048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:30.316048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:30.316048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:30.316048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:30.316048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:30.316048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:30.316048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:30.316048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:30.316048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:30.316048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:30.316048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:30.316048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:22:30.316048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:22:30.316048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:22:30.316048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:22:30.317246 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:30.317246 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:30.317246 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:30.317246 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:30.317246 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:30.317246 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:30.317246 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:30.317246 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:30.317246 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:30.317246 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:30.317246 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:30.317246 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:30.317246 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:30.317246 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:30.317246 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:30.317246 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:30.317246 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:22:30.318332 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:22:30.318332 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:22:30.318332 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:22:30.318332 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 629/1278] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:22:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:30.323543 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97ce7e-a2f4-4c77-a8b8-889542b67eaa None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:30.434562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97ce7e-a2f4-4c77-a8b8-889542b67eaa None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:30.472219 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3c9d0-8b92-45db-9ac9-cba97215b435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:30.472838 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3c9d0-8b92-45db-9ac9-cba97215b435 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:30.473114 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3c9d0-8b92-45db-9ac9-cba97215b435 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:30.473387 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3c9d0-8b92-45db-9ac9-cba97215b435 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:30.474034 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3c9d0-8b92-45db-9ac9-cba97215b435 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:30.474337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3c9d0-8b92-45db-9ac9-cba97215b435 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:30.475737 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3c9d0-8b92-45db-9ac9-cba97215b435 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:30.488350 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 650/1279] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:30.494747 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c28477-6bd0-460d-b024-df0bb64e0b15 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:30.540448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:30.622395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c28477-6bd0-460d-b024-df0bb64e0b15 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:30.660396 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba42286-2d45-45fd-b747-1ce346109a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:30.661418 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba42286-2d45-45fd-b747-1ce346109a0f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:30.661874 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba42286-2d45-45fd-b747-1ce346109a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:30.662315 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba42286-2d45-45fd-b747-1ce346109a0f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:30.672908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba42286-2d45-45fd-b747-1ce346109a0f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:30.674374 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba42286-2d45-45fd-b747-1ce346109a0f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:30.686718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-6ba42286-2d45-45fd-b747-1ce346109a0f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 16:22:30.686718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:30.686718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:30.686718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:30.686718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:30.686718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:30.686718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:30.686718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:30.686718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:30.686718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:30.686718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:30.686718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:30.686718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 16:22:30.686718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 16:22:30.686718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 16:22:30.686718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 16:22:30.692605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:30.692605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:30.692605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 16:22:30.692605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:22:30.692605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 16:22:30.692605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 16:22:30.692605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:30.692605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:30.692605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:30.692605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:30.692605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:30.692605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:30.692605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:30.692605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:30.692605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:30.692605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:30.692605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:30.692605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:30.693811 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:30.693811 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:30.693811 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 16:22:30.693811 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 16:22:30.693811 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 16:22:30.693811 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 16:22:30.693811 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 16:22:30.693811 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 16:22:30.693811 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 16:22:30.693811 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:22:30.693811 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 630/1280] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:22:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:30.694674 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3c9d0-8b92-45db-9ac9-cba97215b435 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:30.698139 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:30.804180 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3c9d0-8b92-45db-9ac9-cba97215b435 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:30.839940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914eea29-7780-45f2-b2fb-cf946474b2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:30.840471 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914eea29-7780-45f2-b2fb-cf946474b2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:30.840755 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914eea29-7780-45f2-b2fb-cf946474b2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:30.841025 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914eea29-7780-45f2-b2fb-cf946474b2c3 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:30.841762 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914eea29-7780-45f2-b2fb-cf946474b2c3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:30.842066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914eea29-7780-45f2-b2fb-cf946474b2c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:30.843551 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914eea29-7780-45f2-b2fb-cf946474b2c3 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:30.862247 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 651/1281] 10.222.0.55 () {56 vars in 1143 bytes} [Tue Oct 4 16:22:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:22:30.868298 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba42286-2d45-45fd-b747-1ce346109a0f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:30.974862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:30.985677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba42286-2d45-45fd-b747-1ce346109a0f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:31.022029 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a49d70-085c-4ef5-8a28-71a4a74ee60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:31.022647 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a49d70-085c-4ef5-8a28-71a4a74ee60c None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:31.022925 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a49d70-085c-4ef5-8a28-71a4a74ee60c None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:31.023233 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a49d70-085c-4ef5-8a28-71a4a74ee60c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:31.106228 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a49d70-085c-4ef5-8a28-71a4a74ee60c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:31.107671 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a49d70-085c-4ef5-8a28-71a4a74ee60c None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:31.209077 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:31.220598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 631/1282] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Oct 4 16:22:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 16:22:31.226851 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914eea29-7780-45f2-b2fb-cf946474b2c3 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:31.294665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:31.334762 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914eea29-7780-45f2-b2fb-cf946474b2c3 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:31.373062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253cbf4e-6c98-4e1f-a8ac-827cd2f47fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:31.373617 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253cbf4e-6c98-4e1f-a8ac-827cd2f47fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:31.373893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253cbf4e-6c98-4e1f-a8ac-827cd2f47fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:31.374158 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253cbf4e-6c98-4e1f-a8ac-827cd2f47fd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:31.384735 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253cbf4e-6c98-4e1f-a8ac-827cd2f47fd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:31.386218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253cbf4e-6c98-4e1f-a8ac-827cd2f47fd7 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:31.401355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-253cbf4e-6c98-4e1f-a8ac-827cd2f47fd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:22:31.401355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:31.401355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:31.401355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:31.401355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:31.401355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:31.401355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:31.401355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:31.401355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:31.401355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:31.401355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:31.401355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:31.401355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 16:22:31.401355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 16:22:31.401355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 16:22:31.401355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 16:22:31.402909 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:31.402909 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:31.402909 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:31.402909 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:31.402909 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:31.402909 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:31.402909 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:31.402909 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:31.402909 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:31.402909 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:31.402909 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:31.402909 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:31.402909 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:31.402909 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:31.402909 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:31.402909 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:31.402909 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 16:22:31.404290 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 16:22:31.404290 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 16:22:31.404290 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:22:31.404290 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 652/1283] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:22:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:31.408693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a49d70-085c-4ef5-8a28-71a4a74ee60c None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:31.519666 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a49d70-085c-4ef5-8a28-71a4a74ee60c None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:31.555600 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd13900-5755-4a43-93ec-d32d72b02523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:31.556309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd13900-5755-4a43-93ec-d32d72b02523 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:31.556605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd13900-5755-4a43-93ec-d32d72b02523 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:31.556882 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd13900-5755-4a43-93ec-d32d72b02523 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:31.557535 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd13900-5755-4a43-93ec-d32d72b02523 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:31.557841 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd13900-5755-4a43-93ec-d32d72b02523 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:31.559244 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd13900-5755-4a43-93ec-d32d72b02523 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:31.570798 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 632/1284] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Oct 4 16:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:31.577449 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253cbf4e-6c98-4e1f-a8ac-827cd2f47fd7 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:31.698899 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253cbf4e-6c98-4e1f-a8ac-827cd2f47fd7 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:31.713551 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:31.739716 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d43f3-fdb1-4ac1-816a-74ea7fe95403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:31.740362 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d43f3-fdb1-4ac1-816a-74ea7fe95403 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:31.740638 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d43f3-fdb1-4ac1-816a-74ea7fe95403 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:31.740905 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d43f3-fdb1-4ac1-816a-74ea7fe95403 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:31.748292 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d43f3-fdb1-4ac1-816a-74ea7fe95403 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:31.749773 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d43f3-fdb1-4ac1-816a-74ea7fe95403 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:31.761918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-4e1d43f3-fdb1-4ac1-816a-74ea7fe95403 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:22:31.761918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:31.761918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:31.761918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:31.761918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:31.761918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:31.761918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:31.761918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:31.761918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:31.761918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:31.761918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:31.761918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:31.761918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 16:22:31.761918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 16:22:31.761918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 16:22:31.763068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 16:22:31.763068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:31.763068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:31.763068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:31.763068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:31.763068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:31.763068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:31.763068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:31.763068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:31.763068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:31.763068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:31.763068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:31.763068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:31.763068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:31.763068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:31.763068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:31.763068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:31.764181 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 16:22:31.764181 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 16:22:31.764181 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 16:22:31.764181 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 16:22:31.764181 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 16:22:31.764181 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 16:22:31.764181 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 16:22:31.764181 dv-cinder-749155-14-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 04 16:22:31.764181 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 653/1285] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Oct 4 16:22:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:31.770526 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd13900-5755-4a43-93ec-d32d72b02523 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:31.827786 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:31.884323 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd13900-5755-4a43-93ec-d32d72b02523 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:31.920935 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7af29-397b-4604-b832-aa2a49253cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:31.921559 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7af29-397b-4604-b832-aa2a49253cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:31.921833 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7af29-397b-4604-b832-aa2a49253cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:31.922102 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7af29-397b-4604-b832-aa2a49253cd1 None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:31.922791 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7af29-397b-4604-b832-aa2a49253cd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:31.923120 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7af29-397b-4604-b832-aa2a49253cd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:31.924560 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7af29-397b-4604-b832-aa2a49253cd1 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:31.937068 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 633/1286] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Oct 4 16:22:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:31.943584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d43f3-fdb1-4ac1-816a-74ea7fe95403 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:32.053561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d43f3-fdb1-4ac1-816a-74ea7fe95403 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:32.090311 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbdb4e-c038-44cb-a2ac-4402b0a320ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:32.091318 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbdb4e-c038-44cb-a2ac-4402b0a320ee None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:32.091757 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbdb4e-c038-44cb-a2ac-4402b0a320ee None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:32.092214 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbdb4e-c038-44cb-a2ac-4402b0a320ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:32.093469 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dbdb4e-c038-44cb-a2ac-4402b0a320ee None admin] RBAC: Adding query filter params (role.id=066f46534195417295e63a5316632eae, scope.project.id=e480e782c4fa403a913ca7179db0843b, user.id=8cd59eac06e347ee9432185b24fdf773) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:32.093985 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dbdb4e-c038-44cb-a2ac-4402b0a320ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:32.096324 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dbdb4e-c038-44cb-a2ac-4402b0a320ee None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:32.104208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 654/1287] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Oct 4 16:22:31 2022] GET /identity/v3/role_assignments?user.id=8cd59eac06e347ee9432185b24fdf773&scope.project.id=e480e782c4fa403a913ca7179db0843b&role.id=066f46534195417295e63a5316632eae => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:34.294840 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63599dea-b1e0-465e-be1c-2fd50e9747de None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:34.295439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63599dea-b1e0-465e-be1c-2fd50e9747de None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:34.295439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63599dea-b1e0-465e-be1c-2fd50e9747de None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:34.296765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 634/1288] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:22:34.302856 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3493cc-18fb-47db-8e3d-197febf48cf2 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:34.303408 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3493cc-18fb-47db-8e3d-197febf48cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:34.303408 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3493cc-18fb-47db-8e3d-197febf48cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:34.322682 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-5c3493cc-18fb-47db-8e3d-197febf48cf2 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:22:34.323920 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-5c3493cc-18fb-47db-8e3d-197febf48cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:22:34.355517 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:34.397311 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 655/1289] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:22:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:22:34.665300 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63599dea-b1e0-465e-be1c-2fd50e9747de None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:34.795898 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63599dea-b1e0-465e-be1c-2fd50e9747de None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:34.807590 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:34.834700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc37ab7-bc3d-4f0e-aea4-c98252b66d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:34.835280 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc37ab7-bc3d-4f0e-aea4-c98252b66d2e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:34.835556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc37ab7-bc3d-4f0e-aea4-c98252b66d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:34.835833 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc37ab7-bc3d-4f0e-aea4-c98252b66d2e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:34.836424 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc37ab7-bc3d-4f0e-aea4-c98252b66d2e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:34.837895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc37ab7-bc3d-4f0e-aea4-c98252b66d2e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:34.847169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-bdc37ab7-bc3d-4f0e-aea4-c98252b66d2e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 16:22:34.847169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:34.847169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 16:22:34.847169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 16:22:34.847169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 16:22:34.847169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 16:22:34.847169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 16:22:34.847169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:22:34.847169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 16:22:34.847169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:22:34.847169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:22:34.847169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:22:34.847169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:34.847169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:34.847169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:34.847169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:34.847169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:34.848494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:34.848494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:34.848494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:34.848494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:34.848494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:34.848494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:34.848494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 16:22:34.848494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 16:22:34.848494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 16:22:34.848494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 16:22:34.848494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:34.848494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:34.848494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:34.848494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:34.848494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:34.848494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:34.849696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:34.849696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:34.849696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:34.849696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:34.849696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:34.849696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:34.849696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:34.849696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:34.849696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:34.849696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:34.849696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 16:22:34.849696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:22:34.849696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 16:22:34.849696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:22:34.849696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 635/1290] 10.222.0.55 () {56 vars in 1117 bytes} [Tue Oct 4 16:22:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:34.854781 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3493cc-18fb-47db-8e3d-197febf48cf2 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:34.960240 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3493cc-18fb-47db-8e3d-197febf48cf2 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:34.998230 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bb00d-39b4-4cee-ab8c-c8cf6f1b59e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:34.998840 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bb00d-39b4-4cee-ab8c-c8cf6f1b59e4 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:34.999145 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bb00d-39b4-4cee-ab8c-c8cf6f1b59e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:34.999416 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bb00d-39b4-4cee-ab8c-c8cf6f1b59e4 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:35.000085 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2bb00d-39b4-4cee-ab8c-c8cf6f1b59e4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:35.000379 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2bb00d-39b4-4cee-ab8c-c8cf6f1b59e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:35.001741 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2bb00d-39b4-4cee-ab8c-c8cf6f1b59e4 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:35.006528 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 656/1291] 10.222.0.55 () {56 vars in 1116 bytes} [Tue Oct 4 16:22:34 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:35.013633 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc37ab7-bc3d-4f0e-aea4-c98252b66d2e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:35.125149 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc37ab7-bc3d-4f0e-aea4-c98252b66d2e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:35.162029 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5851c1-63bf-4330-8eba-1a259b0e7ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:35.162653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5851c1-63bf-4330-8eba-1a259b0e7ddf None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:35.162929 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5851c1-63bf-4330-8eba-1a259b0e7ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:35.163331 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5851c1-63bf-4330-8eba-1a259b0e7ddf None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:35.164233 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5851c1-63bf-4330-8eba-1a259b0e7ddf None admin] RBAC: Adding query filter params (type=placement) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:35.164618 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5851c1-63bf-4330-8eba-1a259b0e7ddf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:35.167306 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5851c1-63bf-4330-8eba-1a259b0e7ddf None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:35.173111 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 636/1292] 10.222.0.55 () {56 vars in 1116 bytes} [Tue Oct 4 16:22:35 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:37.346195 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad924365-cfc1-40d6-a64c-c82639f247db None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:37.346801 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad924365-cfc1-40d6-a64c-c82639f247db None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:37.346801 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad924365-cfc1-40d6-a64c-c82639f247db None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:37.348147 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 657/1293] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:22:37.353919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09f8a2-eb98-4608-b3c7-1e5a0ae6a52e None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:37.354421 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09f8a2-eb98-4608-b3c7-1e5a0ae6a52e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:37.354515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09f8a2-eb98-4608-b3c7-1e5a0ae6a52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:37.374284 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-ac09f8a2-eb98-4608-b3c7-1e5a0ae6a52e None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:22:37.375760 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ac09f8a2-eb98-4608-b3c7-1e5a0ae6a52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:22:37.410577 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:37.462615 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 637/1294] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:22:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:22:37.727757 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad924365-cfc1-40d6-a64c-c82639f247db None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:37.762073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:37.842209 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad924365-cfc1-40d6-a64c-c82639f247db None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:37.878507 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9e457-8e5e-46e9-bdd7-75a460b40b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:37.879158 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9e457-8e5e-46e9-bdd7-75a460b40b2c None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:37.879435 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9e457-8e5e-46e9-bdd7-75a460b40b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:37.879701 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9e457-8e5e-46e9-bdd7-75a460b40b2c None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:37.880360 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9e457-8e5e-46e9-bdd7-75a460b40b2c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:37.881728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9e457-8e5e-46e9-bdd7-75a460b40b2c None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:37.902255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 658/1295] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Oct 4 16:22:37 2022] POST /identity/v3/services => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:22:40.096704 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f8dca-f858-4237-8121-bebfcac60a05 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:40.097399 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f8dca-f858-4237-8121-bebfcac60a05 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:40.097399 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f8dca-f858-4237-8121-bebfcac60a05 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:40.098617 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 638/1296] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:22:40.105093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b579b-e2d3-4ec7-9133-73ff5ceec616 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:40.105594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b579b-e2d3-4ec7-9133-73ff5ceec616 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:40.105594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b579b-e2d3-4ec7-9133-73ff5ceec616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:40.125088 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-7d5b579b-e2d3-4ec7-9133-73ff5ceec616 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:22:40.126298 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-7d5b579b-e2d3-4ec7-9133-73ff5ceec616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:22:40.207425 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 659/1297] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:22:40 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:22:40.480099 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f8dca-f858-4237-8121-bebfcac60a05 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:40.597293 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f8dca-f858-4237-8121-bebfcac60a05 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:40.634944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95243946-c249-40e8-962d-fa39f637bcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:40.635615 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95243946-c249-40e8-962d-fa39f637bcf1 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:40.635907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95243946-c249-40e8-962d-fa39f637bcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:40.636159 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95243946-c249-40e8-962d-fa39f637bcf1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:40.636740 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95243946-c249-40e8-962d-fa39f637bcf1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:40.638139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95243946-c249-40e8-962d-fa39f637bcf1 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:40.648132 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-95243946-c249-40e8-962d-fa39f637bcf1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 16:22:40.648132 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:40.648132 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 16:22:40.648132 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 16:22:40.648132 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 16:22:40.648132 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 16:22:40.648132 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 16:22:40.648132 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:22:40.648132 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 16:22:40.648132 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:22:40.648132 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:22:40.648132 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:22:40.648132 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:40.648132 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:40.648132 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:40.648132 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:40.648132 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:40.649510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:40.649510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:40.649510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:40.649510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:40.649510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:40.649510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:40.649510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 16:22:40.649510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 16:22:40.649510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 16:22:40.649510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 16:22:40.649510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:40.649510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:40.649510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:40.649510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:40.649510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:40.649510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:40.650395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:40.650395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:40.650395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:40.650395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:40.650395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:40.650395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:40.650395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:40.650395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:40.650395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:40.650395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:40.650395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 16:22:40.650395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:22:40.650395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 16:22:40.650395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:22:40.650395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 639/1298] 10.222.0.55 () {56 vars in 1117 bytes} [Tue Oct 4 16:22:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:40.655998 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b579b-e2d3-4ec7-9133-73ff5ceec616 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:40.683229 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:40.778433 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b579b-e2d3-4ec7-9133-73ff5ceec616 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:40.815219 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f30f1f-5927-415c-bfa4-0cd2a36b8fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:40.815839 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f30f1f-5927-415c-bfa4-0cd2a36b8fde None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:40.816110 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f30f1f-5927-415c-bfa4-0cd2a36b8fde None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:40.816371 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f30f1f-5927-415c-bfa4-0cd2a36b8fde None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:40.817003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f30f1f-5927-415c-bfa4-0cd2a36b8fde None admin] RBAC: Adding query filter params (name=placement) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:40.817297 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f30f1f-5927-415c-bfa4-0cd2a36b8fde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:40.818657 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f30f1f-5927-415c-bfa4-0cd2a36b8fde None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:40.826301 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 660/1299] 10.222.0.55 () {56 vars in 1116 bytes} [Tue Oct 4 16:22:40 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:40.832651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95243946-c249-40e8-962d-fa39f637bcf1 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:40.865824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:40.941895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95243946-c249-40e8-962d-fa39f637bcf1 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:40.978031 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a21ab9-947a-492a-befc-1c95200add75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:40.978647 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a21ab9-947a-492a-befc-1c95200add75 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:40.978925 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a21ab9-947a-492a-befc-1c95200add75 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:40.979212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a21ab9-947a-492a-befc-1c95200add75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:40.979929 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a21ab9-947a-492a-befc-1c95200add75 None admin] RBAC: Adding query filter params (interface=public, service_id=bddc00618d64433b9d2096e9d990a2ce, region_id=RegionOne) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:40.980233 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a21ab9-947a-492a-befc-1c95200add75 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:40.981616 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a21ab9-947a-492a-befc-1c95200add75 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:40.986748 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 640/1300] 10.222.0.55 () {56 vars in 1251 bytes} [Tue Oct 4 16:22:40 2022] GET /identity/v3/endpoints?service_id=bddc00618d64433b9d2096e9d990a2ce&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:40.992668 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f30f1f-5927-415c-bfa4-0cd2a36b8fde None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:41.082323 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:41.105278 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f30f1f-5927-415c-bfa4-0cd2a36b8fde None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:41.146737 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7ef88-ca76-4865-96f0-0921342f88bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:41.147391 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7ef88-ca76-4865-96f0-0921342f88bb None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:41.147666 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7ef88-ca76-4865-96f0-0921342f88bb None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:41.147931 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7ef88-ca76-4865-96f0-0921342f88bb None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:41.148534 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7ef88-ca76-4865-96f0-0921342f88bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:41.149897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7ef88-ca76-4865-96f0-0921342f88bb None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:41.157503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 661/1301] 10.222.0.55 () {56 vars in 1087 bytes} [Tue Oct 4 16:22:40 2022] GET /identity/v3/services => generated 2191 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:22:43.336026 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312650e-e81b-43aa-b954-a4106d060d05 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:43.336630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312650e-e81b-43aa-b954-a4106d060d05 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:43.336630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312650e-e81b-43aa-b954-a4106d060d05 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:43.337966 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 641/1302] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:22:43.344308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085ad26-cf4f-4e45-9b0d-fc92f73bde7f None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:43.344782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085ad26-cf4f-4e45-9b0d-fc92f73bde7f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:43.344871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085ad26-cf4f-4e45-9b0d-fc92f73bde7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:43.371159 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-a085ad26-cf4f-4e45-9b0d-fc92f73bde7f None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:22:43.372508 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-a085ad26-cf4f-4e45-9b0d-fc92f73bde7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:22:43.445652 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 662/1303] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:22:43 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 16:22:43.710208 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312650e-e81b-43aa-b954-a4106d060d05 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:43.823040 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:43.831916 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312650e-e81b-43aa-b954-a4106d060d05 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:43.870222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72348b8b-71ae-4558-9534-b4d36cc7479e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:43.870861 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72348b8b-71ae-4558-9534-b4d36cc7479e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:43.871144 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72348b8b-71ae-4558-9534-b4d36cc7479e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:43.871415 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72348b8b-71ae-4558-9534-b4d36cc7479e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:43.872007 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72348b8b-71ae-4558-9534-b4d36cc7479e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:43.873420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72348b8b-71ae-4558-9534-b4d36cc7479e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:43.883139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-72348b8b-71ae-4558-9534-b4d36cc7479e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 16:22:43.883139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:43.883139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 16:22:43.883139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 16:22:43.883139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 16:22:43.883139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 16:22:43.883139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 16:22:43.883139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:22:43.883139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 16:22:43.883139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:22:43.883139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 16:22:43.883139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:22:43.883139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 16:22:43.883139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 16:22:43.883139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 16:22:43.883139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 16:22:43.883139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 16:22:43.884397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 16:22:43.884397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 16:22:43.884397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 16:22:43.884397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 16:22:43.884397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 16:22:43.884397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 16:22:43.884397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 16:22:43.884397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 16:22:43.884397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 16:22:43.884397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 16:22:43.884397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 16:22:43.884397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 16:22:43.884397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 16:22:43.884397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 16:22:43.884397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 16:22:43.884397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 16:22:43.885662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 16:22:43.885662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 04 16:22:43.885662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 16:22:43.885662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 04 16:22:43.885662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 16:22:43.885662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 16:22:43.885662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 16:22:43.885662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 04 16:22:43.885662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 16:22:43.885662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 04 16:22:43.885662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 16:22:43.885662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 16:22:43.885662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 16:22:43.885662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 04 16:22:43.885662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 642/1304] 10.222.0.55 () {56 vars in 1117 bytes} [Tue Oct 4 16:22:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 16:22:43.890567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085ad26-cf4f-4e45-9b0d-fc92f73bde7f None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:43.969521 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:43.993733 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085ad26-cf4f-4e45-9b0d-fc92f73bde7f None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:44.027475 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd278a-3c52-4b14-b564-0b445a0b5ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:44.028088 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd278a-3c52-4b14-b564-0b445a0b5ffb None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:44.028360 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd278a-3c52-4b14-b564-0b445a0b5ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:44.028622 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd278a-3c52-4b14-b564-0b445a0b5ffb None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:44.029247 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd278a-3c52-4b14-b564-0b445a0b5ffb None admin] RBAC: Adding query filter params (name=placement) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:22:44.029541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd278a-3c52-4b14-b564-0b445a0b5ffb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:44.030907 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd278a-3c52-4b14-b564-0b445a0b5ffb None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:44.036054 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 663/1305] 10.222.0.55 () {56 vars in 1116 bytes} [Tue Oct 4 16:22:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:22:44.042476 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72348b8b-71ae-4558-9534-b4d36cc7479e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:22:44.147976 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72348b8b-71ae-4558-9534-b4d36cc7479e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:22:44.184897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3de63e-cce8-45e1-ad5f-2769e5bc93a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:22:44.185511 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3de63e-cce8-45e1-ad5f-2769e5bc93a7 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:22:44.185789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3de63e-cce8-45e1-ad5f-2769e5bc93a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:22:44.186065 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3de63e-cce8-45e1-ad5f-2769e5bc93a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:22:44.186753 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3de63e-cce8-45e1-ad5f-2769e5bc93a7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:22:44.188183 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3de63e-cce8-45e1-ad5f-2769e5bc93a7 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:22:44.211149 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 643/1306] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:22:44 2022] POST /identity/v3/endpoints => generated 331 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:22:54.033133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=30 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:22:54.205908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:23:49.708086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbeef1-4f4f-4a5c-a356-f56d84133677 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:23:49.708584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbeef1-4f4f-4a5c-a356-f56d84133677 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:23:49.708686 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbeef1-4f4f-4a5c-a356-f56d84133677 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:23:49.713908 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 664/1307] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:23:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:23:49.715390 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1c373-0288-4ed2-a9e0-4de920101b86 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:23:49.715810 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1c373-0288-4ed2-a9e0-4de920101b86 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:23:49.715967 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1c373-0288-4ed2-a9e0-4de920101b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:23:49.820228 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-79e1c373-0288-4ed2-a9e0-4de920101b86 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:23:49.822299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-79e1c373-0288-4ed2-a9e0-4de920101b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:23:49.972930 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 644/1308] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:23:50.265039 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b855e-a3fe-425f-a539-ee07801b92ae None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:23:50.265321 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b855e-a3fe-425f-a539-ee07801b92ae None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:23:50.266055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b855e-a3fe-425f-a539-ee07801b92ae None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:23:50.267612 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 665/1309] 10.222.0.55 () {54 vars in 964 bytes} [Tue Oct 4 16:23:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:23:50.274134 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedac59-4608-424a-b0a3-7609bf0bf80e None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:23:50.274451 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedac59-4608-424a-b0a3-7609bf0bf80e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:23:50.274707 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedac59-4608-424a-b0a3-7609bf0bf80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:23:50.369010 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-aaedac59-4608-424a-b0a3-7609bf0bf80e None None] MFA Rules not processed for user `d6ae980afbfd49dea9bbb0adc02b9031`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:23:50.370195 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-aaedac59-4608-424a-b0a3-7609bf0bf80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:23:50.391989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:23:50.453741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 645/1310] 10.222.0.55 () {58 vars in 1061 bytes} [Tue Oct 4 16:23:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:23:50.462914 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b855e-a3fe-425f-a539-ee07801b92ae None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:23:50.464709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-3a8b855e-a3fe-425f-a539-ee07801b92ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:23:50.583707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b855e-a3fe-425f-a539-ee07801b92ae None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:23:50.668379 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b61d5-e132-4f7b-b13c-097d0e98b95b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:23:50.669155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b61d5-e132-4f7b-b13c-097d0e98b95b service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:23:50.669587 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b61d5-e132-4f7b-b13c-097d0e98b95b service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:23:50.669865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b61d5-e132-4f7b-b13c-097d0e98b95b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:23:50.671643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ff0b61d5-e132-4f7b-b13c-097d0e98b95b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:23:50.730670 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:23:50.791259 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b61d5-e132-4f7b-b13c-097d0e98b95b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:23:50.792633 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b61d5-e132-4f7b-b13c-097d0e98b95b service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:23:50.815207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 666/1311] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:23:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:23:53.275282 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1478e44-0009-4016-ae14-2551c807032e None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:23:53.275817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1478e44-0009-4016-ae14-2551c807032e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:23:53.275817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1478e44-0009-4016-ae14-2551c807032e None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:23:53.277675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 646/1312] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:23:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:23:53.283635 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cd88a-2a5f-45cf-bfdb-59954351fd0d None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:23:53.284080 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cd88a-2a5f-45cf-bfdb-59954351fd0d None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:23:53.284173 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cd88a-2a5f-45cf-bfdb-59954351fd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:23:53.373067 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-da3cd88a-2a5f-45cf-bfdb-59954351fd0d None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:23:53.374272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-da3cd88a-2a5f-45cf-bfdb-59954351fd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:23:53.484790 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 667/1313] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:23:53.765686 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1478e44-0009-4016-ae14-2551c807032e None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:23:53.767322 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c1478e44-0009-4016-ae14-2551c807032e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:23:53.889080 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1478e44-0009-4016-ae14-2551c807032e None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:23:53.972463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:23:53.974633 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0a3f6-d53e-468f-9861-778d9efc68a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:23:53.975293 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0a3f6-d53e-468f-9861-778d9efc68a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:23:53.975606 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0a3f6-d53e-468f-9861-778d9efc68a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:23:53.975878 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0a3f6-d53e-468f-9861-778d9efc68a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:23:53.978347 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-48c0a3f6-d53e-468f-9861-778d9efc68a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:23:54.098175 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c0a3f6-d53e-468f-9861-778d9efc68a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:23:54.099655 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c0a3f6-d53e-468f-9861-778d9efc68a9 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:23:54.119131 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 647/1314] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:23:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:23:56.639569 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d99166-f285-4834-a7a4-920dff47d3e7 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:23:56.640160 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d99166-f285-4834-a7a4-920dff47d3e7 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:23:56.640160 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d99166-f285-4834-a7a4-920dff47d3e7 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:23:56.641479 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 668/1315] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:23:56.647221 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6beec-3dcf-468f-bc21-fa9faba8e509 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:23:56.647672 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6beec-3dcf-468f-bc21-fa9faba8e509 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:23:56.647787 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6beec-3dcf-468f-bc21-fa9faba8e509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:23:56.714272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-4da6beec-3dcf-468f-bc21-fa9faba8e509 None None] MFA Rules not processed for user `c4eb360b9ada4b8e844014dd4b1c95a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:23:56.715531 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-4da6beec-3dcf-468f-bc21-fa9faba8e509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:23:56.767754 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:23:56.816542 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 648/1316] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:23:56 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:23:57.109734 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d99166-f285-4834-a7a4-920dff47d3e7 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:23:57.111339 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-95d99166-f285-4834-a7a4-920dff47d3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:23:57.121691 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:23:57.227546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d99166-f285-4834-a7a4-920dff47d3e7 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:23:57.328189 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e050122-8459-4bd2-96fb-a5c73988591c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:23:57.328807 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e050122-8459-4bd2-96fb-a5c73988591c service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:23:57.329086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e050122-8459-4bd2-96fb-a5c73988591c service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:23:57.329356 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e050122-8459-4bd2-96fb-a5c73988591c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:23:57.331006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-5e050122-8459-4bd2-96fb-a5c73988591c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:23:57.397067 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:23:57.452565 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e050122-8459-4bd2-96fb-a5c73988591c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:23:57.454038 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e050122-8459-4bd2-96fb-a5c73988591c service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:23:57.476086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 669/1317] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:23:57 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:24:00.195840 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed4abe-2432-40d7-81b1-e41652c68b8c None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:00.196559 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed4abe-2432-40d7-81b1-e41652c68b8c None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:00.196559 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed4abe-2432-40d7-81b1-e41652c68b8c None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:00.198276 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 649/1318] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:24:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:24:00.204597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74455c-b791-4fcb-91a8-6fddad20c567 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:00.205072 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74455c-b791-4fcb-91a8-6fddad20c567 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:00.205165 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74455c-b791-4fcb-91a8-6fddad20c567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:00.293322 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-4f74455c-b791-4fcb-91a8-6fddad20c567 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:24:00.295019 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-4f74455c-b791-4fcb-91a8-6fddad20c567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:00.418514 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 670/1319] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:24:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:24:00.718904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0903ec-fe3c-4830-8ba6-cf6140977cf1 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:00.719190 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0903ec-fe3c-4830-8ba6-cf6140977cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:00.719459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0903ec-fe3c-4830-8ba6-cf6140977cf1 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:00.720831 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 650/1320] 10.222.0.55 () {54 vars in 964 bytes} [Tue Oct 4 16:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:24:00.727346 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c7c1a-96d6-455d-bf6b-f4c819206e80 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:00.727670 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c7c1a-96d6-455d-bf6b-f4c819206e80 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:00.727980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c7c1a-96d6-455d-bf6b-f4c819206e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:00.751012 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:00.811625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-ec8c7c1a-96d6-455d-bf6b-f4c819206e80 None None] MFA Rules not processed for user `d6ae980afbfd49dea9bbb0adc02b9031`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:24:00.812926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ec8c7c1a-96d6-455d-bf6b-f4c819206e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:00.893363 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 671/1321] 10.222.0.55 () {58 vars in 1061 bytes} [Tue Oct 4 16:24:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:24:00.902644 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0903ec-fe3c-4830-8ba6-cf6140977cf1 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:24:00.904236 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-0c0903ec-fe3c-4830-8ba6-cf6140977cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:01.012268 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0903ec-fe3c-4830-8ba6-cf6140977cf1 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:24:01.095435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f70280-9c49-42ec-9612-e2014d8356a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:24:01.096254 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f70280-9c49-42ec-9612-e2014d8356a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:01.096570 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f70280-9c49-42ec-9612-e2014d8356a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:01.096898 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f70280-9c49-42ec-9612-e2014d8356a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:01.099644 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f9f70280-9c49-42ec-9612-e2014d8356a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:01.108765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:01.219533 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f70280-9c49-42ec-9612-e2014d8356a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:24:01.220889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f70280-9c49-42ec-9612-e2014d8356a2 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:24:01.240349 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 651/1322] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:24:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:24:04.646942 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbe5d7-896b-409e-835b-40184409295e None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:04.647585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbe5d7-896b-409e-835b-40184409295e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:04.647585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbe5d7-896b-409e-835b-40184409295e None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:04.648883 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 672/1323] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:24:04.654453 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d65c3d-d2b8-4466-a3d7-495915b4fb95 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:04.654974 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d65c3d-d2b8-4466-a3d7-495915b4fb95 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:04.655102 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d65c3d-d2b8-4466-a3d7-495915b4fb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:04.728608 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-a1d65c3d-d2b8-4466-a3d7-495915b4fb95 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:24:04.729868 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a1d65c3d-d2b8-4466-a3d7-495915b4fb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:04.805340 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:04.852730 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 652/1324] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:24:05.131318 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbe5d7-896b-409e-835b-40184409295e None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:24:05.132866 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b1cbe5d7-896b-409e-835b-40184409295e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:05.260319 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbe5d7-896b-409e-835b-40184409295e None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:24:05.273212 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:05.347635 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc16e75-a1e3-4b26-bc4a-03054c6472ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:24:05.348265 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc16e75-a1e3-4b26-bc4a-03054c6472ad service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:05.348540 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc16e75-a1e3-4b26-bc4a-03054c6472ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:05.348801 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc16e75-a1e3-4b26-bc4a-03054c6472ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:05.350575 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ddc16e75-a1e3-4b26-bc4a-03054c6472ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:05.478650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc16e75-a1e3-4b26-bc4a-03054c6472ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:24:05.480053 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc16e75-a1e3-4b26-bc4a-03054c6472ad service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:24:05.500787 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 673/1325] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:24:07.719450 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a304180-3551-4b54-bbfa-58b71962a5ed None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:07.720161 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a304180-3551-4b54-bbfa-58b71962a5ed None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:07.720161 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a304180-3551-4b54-bbfa-58b71962a5ed None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:07.721451 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 653/1326] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:24:07.727794 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750fe58-8e91-46a4-a8ea-60e9901a3bcb None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:07.728416 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750fe58-8e91-46a4-a8ea-60e9901a3bcb None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:07.728583 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750fe58-8e91-46a4-a8ea-60e9901a3bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:07.788487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:07.810831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-f750fe58-8e91-46a4-a8ea-60e9901a3bcb None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:24:07.812136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-f750fe58-8e91-46a4-a8ea-60e9901a3bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:07.944633 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 674/1327] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:24:08.221163 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a304180-3551-4b54-bbfa-58b71962a5ed None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:24:08.222824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-1a304180-3551-4b54-bbfa-58b71962a5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:08.350245 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a304180-3551-4b54-bbfa-58b71962a5ed None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:24:08.432861 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5533913-366c-4581-ba09-982e9c4fc268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:24:08.432861 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5533913-366c-4581-ba09-982e9c4fc268 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:08.433256 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5533913-366c-4581-ba09-982e9c4fc268 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:08.433256 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5533913-366c-4581-ba09-982e9c4fc268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:08.434899 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c5533913-366c-4581-ba09-982e9c4fc268 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:08.453900 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:08.565700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5533913-366c-4581-ba09-982e9c4fc268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:24:08.567233 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5533913-366c-4581-ba09-982e9c4fc268 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:24:08.593237 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 654/1328] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:24:10.838302 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb67614-68df-4672-b1a9-d651be9cde43 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:10.838829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb67614-68df-4672-b1a9-d651be9cde43 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:10.838829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb67614-68df-4672-b1a9-d651be9cde43 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:10.840182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 675/1329] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:24:10.845904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d1d16-fe14-422f-bc93-4796d30abb75 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:10.846412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d1d16-fe14-422f-bc93-4796d30abb75 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:10.846412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d1d16-fe14-422f-bc93-4796d30abb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:10.930216 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-884d1d16-fe14-422f-bc93-4796d30abb75 None None] MFA Rules not processed for user `c4eb360b9ada4b8e844014dd4b1c95a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:24:10.931503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-884d1d16-fe14-422f-bc93-4796d30abb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:11.005110 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:11.040487 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 655/1330] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:24:10 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:24:11.332264 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb67614-68df-4672-b1a9-d651be9cde43 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:24:11.334132 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-edb67614-68df-4672-b1a9-d651be9cde43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:11.461760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb67614-68df-4672-b1a9-d651be9cde43 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:24:11.485077 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:11.546886 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed558ba-0ae0-4b86-9e48-4243589c34b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:24:11.547529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed558ba-0ae0-4b86-9e48-4243589c34b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:11.547800 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed558ba-0ae0-4b86-9e48-4243589c34b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:11.548059 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed558ba-0ae0-4b86-9e48-4243589c34b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:11.549695 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-3ed558ba-0ae0-4b86-9e48-4243589c34b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:11.694181 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed558ba-0ae0-4b86-9e48-4243589c34b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:24:11.695681 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed558ba-0ae0-4b86-9e48-4243589c34b5 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:24:11.721777 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 676/1331] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:24:11 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:24:14.179616 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e263b9e-a887-43a9-bbbf-bba9531b8803 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:14.180166 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e263b9e-a887-43a9-bbbf-bba9531b8803 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:14.180166 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e263b9e-a887-43a9-bbbf-bba9531b8803 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:14.181525 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 656/1332] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:24:14.187557 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471646a3-d08a-4b1e-b7a1-679f4f1ec4df None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:14.188038 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471646a3-d08a-4b1e-b7a1-679f4f1ec4df None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:14.188127 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471646a3-d08a-4b1e-b7a1-679f4f1ec4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:14.284192 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:14.288654 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-471646a3-d08a-4b1e-b7a1-679f4f1ec4df None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:24:14.291044 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-471646a3-d08a-4b1e-b7a1-679f4f1ec4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:14.397639 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 677/1333] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:24:14.683081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e263b9e-a887-43a9-bbbf-bba9531b8803 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:24:14.684625 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-0e263b9e-a887-43a9-bbbf-bba9531b8803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:14.805053 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e263b9e-a887-43a9-bbbf-bba9531b8803 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:24:14.882859 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfda698-e0c6-481a-ba7f-6b8f52cb8e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:24:14.883434 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfda698-e0c6-481a-ba7f-6b8f52cb8e62 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:14.883708 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfda698-e0c6-481a-ba7f-6b8f52cb8e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:14.884105 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfda698-e0c6-481a-ba7f-6b8f52cb8e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:14.885779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-abfda698-e0c6-481a-ba7f-6b8f52cb8e62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:14.914922 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:14.999972 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfda698-e0c6-481a-ba7f-6b8f52cb8e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:24:15.001439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfda698-e0c6-481a-ba7f-6b8f52cb8e62 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:24:15.020601 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 657/1334] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:24:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:24:17.254674 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d3f98-93f5-4179-a0af-9f8765aa4e2a None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:17.255373 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d3f98-93f5-4179-a0af-9f8765aa4e2a None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:17.255373 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d3f98-93f5-4179-a0af-9f8765aa4e2a None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:17.256837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 678/1335] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:24:17.263780 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a83a1-a9dc-4209-81f2-f3048912e8a7 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:17.264554 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a83a1-a9dc-4209-81f2-f3048912e8a7 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:17.264554 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a83a1-a9dc-4209-81f2-f3048912e8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:17.340882 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-ee8a83a1-a9dc-4209-81f2-f3048912e8a7 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:24:17.342540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ee8a83a1-a9dc-4209-81f2-f3048912e8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:17.427769 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:17.455084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 658/1336] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:24:17.740294 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d3f98-93f5-4179-a0af-9f8765aa4e2a None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:24:17.741891 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-152d3f98-93f5-4179-a0af-9f8765aa4e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:17.866729 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d3f98-93f5-4179-a0af-9f8765aa4e2a None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:24:17.903220 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:17.960812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9887f13-aaa8-4731-8cb4-5ec9df59688b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:24:17.961433 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9887f13-aaa8-4731-8cb4-5ec9df59688b service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:17.961707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9887f13-aaa8-4731-8cb4-5ec9df59688b service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:17.961976 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9887f13-aaa8-4731-8cb4-5ec9df59688b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:17.963644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-f9887f13-aaa8-4731-8cb4-5ec9df59688b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:18.083310 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9887f13-aaa8-4731-8cb4-5ec9df59688b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:24:18.084849 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9887f13-aaa8-4731-8cb4-5ec9df59688b service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:24:18.105324 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 679/1337] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:24:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:24:20.765685 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8e75e-a00e-4d5c-b217-0692c12a9bea None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:20.766227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8e75e-a00e-4d5c-b217-0692c12a9bea None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:20.766227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8e75e-a00e-4d5c-b217-0692c12a9bea None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:20.767627 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 659/1338] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:24:20.776797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00b755-a628-4d61-8752-39f856602f90 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:20.777340 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00b755-a628-4d61-8752-39f856602f90 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:20.777340 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00b755-a628-4d61-8752-39f856602f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:20.853452 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-ed00b755-a628-4d61-8752-39f856602f90 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:24:20.854607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ed00b755-a628-4d61-8752-39f856602f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:20.864260 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:20.958138 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 680/1339] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:24:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:24:21.243334 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8e75e-a00e-4d5c-b217-0692c12a9bea None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:24:21.244934 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-0dd8e75e-a00e-4d5c-b217-0692c12a9bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:21.354477 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8e75e-a00e-4d5c-b217-0692c12a9bea None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:24:21.439573 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305349c3-eaa1-4dd4-99dd-e1b941d1fe4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:24:21.440194 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305349c3-eaa1-4dd4-99dd-e1b941d1fe4b service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:21.440466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305349c3-eaa1-4dd4-99dd-e1b941d1fe4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:21.440733 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305349c3-eaa1-4dd4-99dd-e1b941d1fe4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:21.442455 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-305349c3-eaa1-4dd4-99dd-e1b941d1fe4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:21.486152 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:21.564808 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305349c3-eaa1-4dd4-99dd-e1b941d1fe4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:24:21.566262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305349c3-eaa1-4dd4-99dd-e1b941d1fe4b service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:24:21.587014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 660/1340] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:24:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:24:25.948359 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25c82e-0e8d-4e7e-9c96-7d3877907d45 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:25.948923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25c82e-0e8d-4e7e-9c96-7d3877907d45 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:25.948923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25c82e-0e8d-4e7e-9c96-7d3877907d45 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:25.950311 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 681/1341] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:24:25.956659 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb996b-151a-45d8-81a4-bc169b558715 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:25.957214 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb996b-151a-45d8-81a4-bc169b558715 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:25.957214 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb996b-151a-45d8-81a4-bc169b558715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:26.039219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-10fb996b-151a-45d8-81a4-bc169b558715 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:24:26.040878 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-10fb996b-151a-45d8-81a4-bc169b558715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:26.141085 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:26.153365 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 661/1342] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:24:26.433622 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25c82e-0e8d-4e7e-9c96-7d3877907d45 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:24:26.435227 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-bc25c82e-0e8d-4e7e-9c96-7d3877907d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:26.551205 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25c82e-0e8d-4e7e-9c96-7d3877907d45 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:24:26.608207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:26.648700 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4dca88-cc2f-46d1-b56f-2dbaf4380041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:24:26.649323 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dca88-cc2f-46d1-b56f-2dbaf4380041 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:26.649598 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dca88-cc2f-46d1-b56f-2dbaf4380041 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:26.649854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dca88-cc2f-46d1-b56f-2dbaf4380041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:26.651521 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8c4dca88-cc2f-46d1-b56f-2dbaf4380041 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:26.785756 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4dca88-cc2f-46d1-b56f-2dbaf4380041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:24:26.787573 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4dca88-cc2f-46d1-b56f-2dbaf4380041 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:24:26.813278 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 682/1343] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:24:29.715382 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7519b7d-48b8-4f08-adfe-b1789c7c5e49 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:29.715932 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7519b7d-48b8-4f08-adfe-b1789c7c5e49 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:29.715932 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7519b7d-48b8-4f08-adfe-b1789c7c5e49 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:29.717123 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 662/1344] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:24:29.723141 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a56b4-a68a-4f52-834c-83e221e83783 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:29.726442 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a56b4-a68a-4f52-834c-83e221e83783 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:29.726442 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a56b4-a68a-4f52-834c-83e221e83783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:29.810031 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-a07a56b4-a68a-4f52-834c-83e221e83783 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:24:29.812013 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-a07a56b4-a68a-4f52-834c-83e221e83783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:29.832080 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:29.925030 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 683/1345] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:24:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:24:30.208861 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7519b7d-48b8-4f08-adfe-b1789c7c5e49 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:24:30.210467 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-e7519b7d-48b8-4f08-adfe-b1789c7c5e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:30.357820 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7519b7d-48b8-4f08-adfe-b1789c7c5e49 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:24:30.450094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d98651-e620-4677-9f17-2696d3548620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:24:30.450714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d98651-e620-4677-9f17-2696d3548620 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:30.451009 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d98651-e620-4677-9f17-2696d3548620 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:30.451293 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d98651-e620-4677-9f17-2696d3548620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:30.452977 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-51d98651-e620-4677-9f17-2696d3548620 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:30.503331 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:30.588260 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d98651-e620-4677-9f17-2696d3548620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:24:30.590029 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d98651-e620-4677-9f17-2696d3548620 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:24:30.613582 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 663/1346] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:24:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:24:35.313254 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434d4cc-3c1f-468f-b9ae-245e692bc93c None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:35.313851 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434d4cc-3c1f-468f-b9ae-245e692bc93c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:35.313851 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434d4cc-3c1f-468f-b9ae-245e692bc93c None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:35.316177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 684/1347] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:24:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:24:35.321628 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfae7d1-ac34-4019-bee8-42663f5a4754 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:35.321628 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfae7d1-ac34-4019-bee8-42663f5a4754 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:35.321628 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfae7d1-ac34-4019-bee8-42663f5a4754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:35.409724 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-6dfae7d1-ac34-4019-bee8-42663f5a4754 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:24:35.411074 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-6dfae7d1-ac34-4019-bee8-42663f5a4754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:35.533499 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:35.539350 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 664/1348] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:24:35.820269 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434d4cc-3c1f-468f-b9ae-245e692bc93c None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:24:35.821879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-6434d4cc-3c1f-468f-b9ae-245e692bc93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:35.940019 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434d4cc-3c1f-468f-b9ae-245e692bc93c None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:24:35.992167 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:36.019529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041df6f-5b8f-474e-a5cc-6b11c4dbf44f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:24:36.020175 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041df6f-5b8f-474e-a5cc-6b11c4dbf44f service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:36.020437 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041df6f-5b8f-474e-a5cc-6b11c4dbf44f service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:36.020697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041df6f-5b8f-474e-a5cc-6b11c4dbf44f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:36.022493 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8041df6f-5b8f-474e-a5cc-6b11c4dbf44f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:36.142401 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041df6f-5b8f-474e-a5cc-6b11c4dbf44f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:24:36.143771 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041df6f-5b8f-474e-a5cc-6b11c4dbf44f service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:24:36.163837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 685/1349] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:24:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:24:41.322008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a92c26-0461-4d9d-99c1-146acee1dcce None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:41.322008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a92c26-0461-4d9d-99c1-146acee1dcce None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:41.322008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a92c26-0461-4d9d-99c1-146acee1dcce None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:41.323044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 665/1350] 10.222.0.55 () {54 vars in 921 bytes} [Tue Oct 4 16:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:24:41.328752 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df66b50-6f83-4f2b-aeb7-b39c9c267625 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:41.329261 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df66b50-6f83-4f2b-aeb7-b39c9c267625 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:41.329498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df66b50-6f83-4f2b-aeb7-b39c9c267625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:41.450124 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-1df66b50-6f83-4f2b-aeb7-b39c9c267625 None None] MFA Rules not processed for user `8cd59eac06e347ee9432185b24fdf773`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:24:41.451524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-1df66b50-6f83-4f2b-aeb7-b39c9c267625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:41.473464 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:41.633863 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 686/1351] 10.222.0.55 () {58 vars in 1018 bytes} [Tue Oct 4 16:24:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:24:46.119527 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe8e1f-2503-4f0d-be3a-80fc070936e6 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:46.120118 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe8e1f-2503-4f0d-be3a-80fc070936e6 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:46.120118 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe8e1f-2503-4f0d-be3a-80fc070936e6 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:46.121594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 666/1352] 10.222.0.55 () {54 vars in 921 bytes} [Tue Oct 4 16:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:24:46.127022 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c493bf-b7ee-435f-943c-f1429fcd08a7 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:46.127845 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c493bf-b7ee-435f-943c-f1429fcd08a7 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:46.128124 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c493bf-b7ee-435f-943c-f1429fcd08a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:46.223443 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-34c493bf-b7ee-435f-943c-f1429fcd08a7 None None] MFA Rules not processed for user `8cd59eac06e347ee9432185b24fdf773`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:24:46.224736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-34c493bf-b7ee-435f-943c-f1429fcd08a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:46.314795 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:46.370813 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 687/1353] 10.222.0.55 () {58 vars in 1018 bytes} [Tue Oct 4 16:24:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:24:47.595373 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e758ca-20fc-4eb0-99b7-b2510b74b604 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:47.596244 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e758ca-20fc-4eb0-99b7-b2510b74b604 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:47.596523 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e758ca-20fc-4eb0-99b7-b2510b74b604 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:47.598683 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 667/1354] 10.222.0.55 () {54 vars in 921 bytes} [Tue Oct 4 16:24:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:24:47.604101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262a0a3-fd1a-4da7-8f9d-fa61a5376ef2 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:47.604628 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262a0a3-fd1a-4da7-8f9d-fa61a5376ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:47.604628 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262a0a3-fd1a-4da7-8f9d-fa61a5376ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:47.698176 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-0262a0a3-fd1a-4da7-8f9d-fa61a5376ef2 None None] MFA Rules not processed for user `8cd59eac06e347ee9432185b24fdf773`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:24:47.699583 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-0262a0a3-fd1a-4da7-8f9d-fa61a5376ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:47.820333 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 688/1355] 10.222.0.55 () {58 vars in 1018 bytes} [Tue Oct 4 16:24:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:24:51.560995 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cee5e-1225-46e1-a294-b8f0f7c1e1a6 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:51.561578 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cee5e-1225-46e1-a294-b8f0f7c1e1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:51.561578 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cee5e-1225-46e1-a294-b8f0f7c1e1a6 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:51.562959 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 668/1356] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:24:51.568882 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3b8e0-9c6b-4fc6-a469-8153634d6631 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:51.569346 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3b8e0-9c6b-4fc6-a469-8153634d6631 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:51.569713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3b8e0-9c6b-4fc6-a469-8153634d6631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:51.638894 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:51.699256 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-4ed3b8e0-9c6b-4fc6-a469-8153634d6631 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:24:51.700749 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-4ed3b8e0-9c6b-4fc6-a469-8153634d6631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:51.844220 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 689/1357] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:24:52.159727 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4258b11-e354-41ac-97c9-4cc16f395751 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:52.160940 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4258b11-e354-41ac-97c9-4cc16f395751 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:52.161527 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4258b11-e354-41ac-97c9-4cc16f395751 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:52.163703 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 669/1358] 10.222.0.55 () {54 vars in 961 bytes} [Tue Oct 4 16:24:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:24:52.172258 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17cda7-503a-45c6-ac91-144548248a9d None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:52.172526 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17cda7-503a-45c6-ac91-144548248a9d None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:52.172814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17cda7-503a-45c6-ac91-144548248a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:52.269232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-4c17cda7-503a-45c6-ac91-144548248a9d None None] MFA Rules not processed for user `6cdee0584fe045028a44c385d032d2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:24:52.270547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-4c17cda7-503a-45c6-ac91-144548248a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:52.342105 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:52.421114 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 690/1359] 10.222.0.55 () {58 vars in 1058 bytes} [Tue Oct 4 16:24:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:24:52.429327 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4258b11-e354-41ac-97c9-4cc16f395751 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:24:52.430802 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-e4258b11-e354-41ac-97c9-4cc16f395751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:52.611533 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4258b11-e354-41ac-97c9-4cc16f395751 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:24:52.707504 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:52.757375 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60448002-a0cb-44ad-94e1-260cd85c1862 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:24:52.758430 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60448002-a0cb-44ad-94e1-260cd85c1862 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:52.759231 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60448002-a0cb-44ad-94e1-260cd85c1862 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:52.759840 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60448002-a0cb-44ad-94e1-260cd85c1862 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:52.762526 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-60448002-a0cb-44ad-94e1-260cd85c1862 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:52.879949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60448002-a0cb-44ad-94e1-260cd85c1862 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:24:52.882093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60448002-a0cb-44ad-94e1-260cd85c1862 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:24:52.904458 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 670/1360] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:24:55.337990 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad022f-097e-4a23-8ce4-53d2bd917e06 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:55.338767 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad022f-097e-4a23-8ce4-53d2bd917e06 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:55.339398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad022f-097e-4a23-8ce4-53d2bd917e06 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:55.343636 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 691/1361] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:24:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:24:55.349010 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf8ccc-53e9-4f55-9999-180f4d1a1dd2 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:55.349444 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf8ccc-53e9-4f55-9999-180f4d1a1dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:55.349748 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf8ccc-53e9-4f55-9999-180f4d1a1dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:55.471685 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-e9cf8ccc-53e9-4f55-9999-180f4d1a1dd2 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:24:55.472931 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-e9cf8ccc-53e9-4f55-9999-180f4d1a1dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:55.524301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:55.598329 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 671/1362] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:24:55.895505 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad022f-097e-4a23-8ce4-53d2bd917e06 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:24:55.897910 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-93ad022f-097e-4a23-8ce4-53d2bd917e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:56.116162 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad022f-097e-4a23-8ce4-53d2bd917e06 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:24:56.131374 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:56.247357 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f358e72-389b-4369-9e90-f694f741c831 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:24:56.247970 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f358e72-389b-4369-9e90-f694f741c831 service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:56.248248 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f358e72-389b-4369-9e90-f694f741c831 service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:56.248521 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f358e72-389b-4369-9e90-f694f741c831 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:56.250159 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-5f358e72-389b-4369-9e90-f694f741c831 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:56.346625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f358e72-389b-4369-9e90-f694f741c831 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:24:56.348384 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f358e72-389b-4369-9e90-f694f741c831 service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:24:56.367976 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 692/1363] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:24:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:24:58.873827 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deace6-4ab0-45c5-b4f0-ea38b8504ea0 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:58.874345 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deace6-4ab0-45c5-b4f0-ea38b8504ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:58.874687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deace6-4ab0-45c5-b4f0-ea38b8504ea0 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:58.876431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 672/1364] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:24:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:24:58.882034 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdde6f4-eb11-486a-8e24-d62b4a5aa18f None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:58.882548 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdde6f4-eb11-486a-8e24-d62b4a5aa18f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:58.882548 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdde6f4-eb11-486a-8e24-d62b4a5aa18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:58.898891 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:58.955656 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-cfdde6f4-eb11-486a-8e24-d62b4a5aa18f None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:24:58.957238 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-cfdde6f4-eb11-486a-8e24-d62b4a5aa18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:59.077314 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 693/1365] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:24:59.365672 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8fae2-d470-40c2-9a86-90d936e5e397 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:59.365952 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8fae2-d470-40c2-9a86-90d936e5e397 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:59.366222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8fae2-d470-40c2-9a86-90d936e5e397 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:59.367863 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 673/1366] 10.222.0.55 () {54 vars in 961 bytes} [Tue Oct 4 16:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:24:59.373500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83dd4f-b5cf-4626-84c5-03080509cb54 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:59.373760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83dd4f-b5cf-4626-84c5-03080509cb54 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:59.374061 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83dd4f-b5cf-4626-84c5-03080509cb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:59.453058 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-3a83dd4f-b5cf-4626-84c5-03080509cb54 None None] MFA Rules not processed for user `6cdee0584fe045028a44c385d032d2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:24:59.454281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-3a83dd4f-b5cf-4626-84c5-03080509cb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:59.491835 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:59.583556 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 694/1367] 10.222.0.55 () {58 vars in 1058 bytes} [Tue Oct 4 16:24:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:24:59.591678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8fae2-d470-40c2-9a86-90d936e5e397 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:24:59.593181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-95a8fae2-d470-40c2-9a86-90d936e5e397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:24:59.751230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8fae2-d470-40c2-9a86-90d936e5e397 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:24:59.782741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:24:59.918192 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9372f57-5f40-4886-9eb9-2c285246ab52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:24:59.918874 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9372f57-5f40-4886-9eb9-2c285246ab52 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:24:59.919151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9372f57-5f40-4886-9eb9-2c285246ab52 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:24:59.919373 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9372f57-5f40-4886-9eb9-2c285246ab52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:24:59.921017 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f9372f57-5f40-4886-9eb9-2c285246ab52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:00.004501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c32c9d-89c2-435f-8fe5-2f57d91c76e8 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:00.005047 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c32c9d-89c2-435f-8fe5-2f57d91c76e8 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:00.005047 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c32c9d-89c2-435f-8fe5-2f57d91c76e8 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:00.006482 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 695/1368] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:25:00.011856 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2937ff-74ba-464b-98a2-30a92e8bfeb0 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:00.012258 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2937ff-74ba-464b-98a2-30a92e8bfeb0 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:00.012371 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2937ff-74ba-464b-98a2-30a92e8bfeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:00.056537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9372f57-5f40-4886-9eb9-2c285246ab52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:25:00.058384 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9372f57-5f40-4886-9eb9-2c285246ab52 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:25:00.081616 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 674/1369] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:24:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:25:00.099885 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-8c2937ff-74ba-464b-98a2-30a92e8bfeb0 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:25:00.101239 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8c2937ff-74ba-464b-98a2-30a92e8bfeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:00.225577 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:00.236337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 696/1370] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:25:00.533178 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab2f52-0dc9-4bbb-af03-821fa626c655 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:00.533477 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab2f52-0dc9-4bbb-af03-821fa626c655 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:00.533734 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab2f52-0dc9-4bbb-af03-821fa626c655 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:00.535630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 675/1371] 10.222.0.55 () {54 vars in 963 bytes} [Tue Oct 4 16:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:25:00.540733 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a91f59-04b9-4e56-a08f-31aed93f6bf3 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:00.540983 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a91f59-04b9-4e56-a08f-31aed93f6bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:00.541285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a91f59-04b9-4e56-a08f-31aed93f6bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:00.639627 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-24a91f59-04b9-4e56-a08f-31aed93f6bf3 None None] MFA Rules not processed for user `7d717575c1d8415fbd09d61d1cbef2d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:25:00.641374 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-24a91f59-04b9-4e56-a08f-31aed93f6bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:00.745041 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 697/1372] 10.222.0.55 () {58 vars in 1060 bytes} [Tue Oct 4 16:25:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:25:00.752654 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab2f52-0dc9-4bbb-af03-821fa626c655 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:25:00.754164 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-e0ab2f52-0dc9-4bbb-af03-821fa626c655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:00.786959 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:00.868839 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab2f52-0dc9-4bbb-af03-821fa626c655 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:25:00.955272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed33d0c-78f0-44c4-b0e5-f4dbed0261ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:25:00.956686 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed33d0c-78f0-44c4-b0e5-f4dbed0261ce service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:00.957260 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed33d0c-78f0-44c4-b0e5-f4dbed0261ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:00.957898 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed33d0c-78f0-44c4-b0e5-f4dbed0261ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:00.959790 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-eed33d0c-78f0-44c4-b0e5-f4dbed0261ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:01.073047 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:01.124563 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed33d0c-78f0-44c4-b0e5-f4dbed0261ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:25:01.126787 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed33d0c-78f0-44c4-b0e5-f4dbed0261ce service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:25:01.159042 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 676/1373] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:25:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:25:02.436592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd41712-c875-4b71-9066-4117f1505ab4 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:02.437146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd41712-c875-4b71-9066-4117f1505ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:02.437146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd41712-c875-4b71-9066-4117f1505ab4 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:02.438633 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 698/1374] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:25:02.444246 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e158c2f-4c0a-46ac-8365-54ec320d871a None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:02.444690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e158c2f-4c0a-46ac-8365-54ec320d871a None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:02.445018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e158c2f-4c0a-46ac-8365-54ec320d871a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:02.513587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-6e158c2f-4c0a-46ac-8365-54ec320d871a None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:25:02.514817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-6e158c2f-4c0a-46ac-8365-54ec320d871a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:02.650125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 677/1375] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:25:02.981830 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd41712-c875-4b71-9066-4117f1505ab4 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:25:02.983741 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-5bd41712-c875-4b71-9066-4117f1505ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:03.112118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:03.194695 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd41712-c875-4b71-9066-4117f1505ab4 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:25:03.341840 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ee3c9-a740-4b7f-9ef8-73bc9cddb72c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:25:03.342466 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ee3c9-a740-4b7f-9ef8-73bc9cddb72c service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:03.342750 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ee3c9-a740-4b7f-9ef8-73bc9cddb72c service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:03.343065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ee3c9-a740-4b7f-9ef8-73bc9cddb72c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:03.344926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-212ee3c9-a740-4b7f-9ef8-73bc9cddb72c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:03.397573 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:03.450367 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ee3c9-a740-4b7f-9ef8-73bc9cddb72c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:25:03.452018 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ee3c9-a740-4b7f-9ef8-73bc9cddb72c service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:25:03.470866 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 699/1376] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:25:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:25:05.732075 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd3031-5f00-42f2-b7b2-c0d52bd10dba None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:05.732706 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd3031-5f00-42f2-b7b2-c0d52bd10dba None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:05.732706 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd3031-5f00-42f2-b7b2-c0d52bd10dba None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:05.734262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 678/1377] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:25:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:25:05.740330 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d23be-82bd-402d-81db-49e6513eaf65 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:05.740883 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d23be-82bd-402d-81db-49e6513eaf65 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:05.740883 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d23be-82bd-402d-81db-49e6513eaf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:05.818549 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-f51d23be-82bd-402d-81db-49e6513eaf65 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:25:05.819884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-f51d23be-82bd-402d-81db-49e6513eaf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:05.930810 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 700/1378] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:25:06.223532 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd3031-5f00-42f2-b7b2-c0d52bd10dba None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:25:06.225043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-babd3031-5f00-42f2-b7b2-c0d52bd10dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:06.283910 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:06.410307 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd3031-5f00-42f2-b7b2-c0d52bd10dba None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:25:06.552427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:06.559242 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8054d-81fb-46d1-920c-d12ceb7d1c25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:25:06.560152 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8054d-81fb-46d1-920c-d12ceb7d1c25 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:06.560861 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8054d-81fb-46d1-920c-d12ceb7d1c25 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:06.561349 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8054d-81fb-46d1-920c-d12ceb7d1c25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:06.563300 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-12b8054d-81fb-46d1-920c-d12ceb7d1c25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:06.682418 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b8054d-81fb-46d1-920c-d12ceb7d1c25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:25:06.684181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b8054d-81fb-46d1-920c-d12ceb7d1c25 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:25:06.716345 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 679/1379] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:25:08.970626 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91257103-bbd8-4346-aa06-5a10e8a3e24f None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:08.971225 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91257103-bbd8-4346-aa06-5a10e8a3e24f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:08.971225 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91257103-bbd8-4346-aa06-5a10e8a3e24f None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:08.972552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 701/1380] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:25:08.978126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815b1fc-17dc-4b7f-9fc7-ef4b6b9cf6ac None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:08.978542 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815b1fc-17dc-4b7f-9fc7-ef4b6b9cf6ac None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:08.978705 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815b1fc-17dc-4b7f-9fc7-ef4b6b9cf6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:09.049929 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-a815b1fc-17dc-4b7f-9fc7-ef4b6b9cf6ac None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:25:09.051257 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a815b1fc-17dc-4b7f-9fc7-ef4b6b9cf6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:09.125048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:09.170137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 680/1381] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:25:09.469801 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91257103-bbd8-4346-aa06-5a10e8a3e24f None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:25:09.471507 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-91257103-bbd8-4346-aa06-5a10e8a3e24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:09.509941 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:09.651577 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91257103-bbd8-4346-aa06-5a10e8a3e24f None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:25:09.758363 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:09.776617 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78575091-5334-4c80-a984-5f28ef21359c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:25:09.777278 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78575091-5334-4c80-a984-5f28ef21359c service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:09.777611 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78575091-5334-4c80-a984-5f28ef21359c service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:09.777871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78575091-5334-4c80-a984-5f28ef21359c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:09.779505 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-78575091-5334-4c80-a984-5f28ef21359c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:09.897356 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78575091-5334-4c80-a984-5f28ef21359c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:25:09.899679 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78575091-5334-4c80-a984-5f28ef21359c service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:25:09.926268 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 702/1382] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:25:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:25:12.173153 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74c5ad-85ea-46c2-b5f1-5e39893a8b01 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:12.174089 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74c5ad-85ea-46c2-b5f1-5e39893a8b01 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:12.174089 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74c5ad-85ea-46c2-b5f1-5e39893a8b01 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:12.175138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 681/1383] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:25:12.181745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2582b84-c537-456b-b78a-ab49614a341a None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:12.182190 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2582b84-c537-456b-b78a-ab49614a341a None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:12.182304 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2582b84-c537-456b-b78a-ab49614a341a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:12.251386 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-f2582b84-c537-456b-b78a-ab49614a341a None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:25:12.252560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-f2582b84-c537-456b-b78a-ab49614a341a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:12.316189 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:12.374386 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 703/1384] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:25:12.832731 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74c5ad-85ea-46c2-b5f1-5e39893a8b01 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:25:12.834329 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-4f74c5ad-85ea-46c2-b5f1-5e39893a8b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:13.027257 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74c5ad-85ea-46c2-b5f1-5e39893a8b01 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:25:13.095133 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:13.188942 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d2e2c-9910-4992-b884-2eab88695556 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:25:13.189694 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d2e2c-9910-4992-b884-2eab88695556 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:13.189808 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d2e2c-9910-4992-b884-2eab88695556 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:13.190097 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d2e2c-9910-4992-b884-2eab88695556 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:13.191847 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-6e9d2e2c-9910-4992-b884-2eab88695556 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:13.323594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d2e2c-9910-4992-b884-2eab88695556 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:25:13.326471 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d2e2c-9910-4992-b884-2eab88695556 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:25:13.358743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 682/1385] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:25:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:25:15.692917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ec7f3-ab2c-4af7-b8ba-d3b9705d40f6 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:15.693476 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ec7f3-ab2c-4af7-b8ba-d3b9705d40f6 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:15.693476 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ec7f3-ab2c-4af7-b8ba-d3b9705d40f6 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:15.694806 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 704/1386] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:25:15.700253 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a25b4-1e8a-4973-8f08-77063a380fc3 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:15.700720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a25b4-1e8a-4973-8f08-77063a380fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:15.700804 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a25b4-1e8a-4973-8f08-77063a380fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:15.772416 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-f68a25b4-1e8a-4973-8f08-77063a380fc3 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:25:15.773681 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f68a25b4-1e8a-4973-8f08-77063a380fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:15.782697 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:15.878076 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 683/1387] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:25:16.169191 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ec7f3-ab2c-4af7-b8ba-d3b9705d40f6 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:25:16.170703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8d4ec7f3-ab2c-4af7-b8ba-d3b9705d40f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:16.334258 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ec7f3-ab2c-4af7-b8ba-d3b9705d40f6 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:25:16.383042 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:16.459414 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae40cf2-8bbc-4300-8bc3-e3fb30302ac7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:25:16.460312 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae40cf2-8bbc-4300-8bc3-e3fb30302ac7 service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:16.460587 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae40cf2-8bbc-4300-8bc3-e3fb30302ac7 service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:16.460857 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae40cf2-8bbc-4300-8bc3-e3fb30302ac7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:16.462519 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-1ae40cf2-8bbc-4300-8bc3-e3fb30302ac7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:16.559840 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae40cf2-8bbc-4300-8bc3-e3fb30302ac7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:25:16.561461 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae40cf2-8bbc-4300-8bc3-e3fb30302ac7 service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:25:16.582061 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 705/1388] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:25:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:25:16.705241 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf1810-49cf-4c84-8afc-a95c97748f7f None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:16.705955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf1810-49cf-4c84-8afc-a95c97748f7f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:16.705955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf1810-49cf-4c84-8afc-a95c97748f7f None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:16.707405 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 684/1389] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:25:16.713706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66437509-dad3-42f3-828e-57e7eba53161 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:16.714262 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66437509-dad3-42f3-828e-57e7eba53161 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:16.714262 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66437509-dad3-42f3-828e-57e7eba53161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:16.798880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:16.803017 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-66437509-dad3-42f3-828e-57e7eba53161 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:25:16.805028 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-66437509-dad3-42f3-828e-57e7eba53161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:16.917721 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 706/1390] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:25:17.220382 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8babb-1406-4eb3-813f-36aa5de19f8f None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:17.220688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8babb-1406-4eb3-813f-36aa5de19f8f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:17.220977 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8babb-1406-4eb3-813f-36aa5de19f8f None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:17.222474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 685/1391] 10.222.0.55 () {54 vars in 962 bytes} [Tue Oct 4 16:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:25:17.228015 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a4671-9e8f-4f45-a245-174d9d8b0e9b None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:17.228393 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a4671-9e8f-4f45-a245-174d9d8b0e9b None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:17.228714 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a4671-9e8f-4f45-a245-174d9d8b0e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:17.314633 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-ab2a4671-9e8f-4f45-a245-174d9d8b0e9b None None] MFA Rules not processed for user `74b3e45a14bd4b539974e9e5e278ee62`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:25:17.315863 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ab2a4671-9e8f-4f45-a245-174d9d8b0e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:17.392215 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:17.399455 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 707/1392] 10.222.0.55 () {58 vars in 1059 bytes} [Tue Oct 4 16:25:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:25:17.408912 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8babb-1406-4eb3-813f-36aa5de19f8f None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:25:17.410830 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-2ca8babb-1406-4eb3-813f-36aa5de19f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:17.530168 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8babb-1406-4eb3-813f-36aa5de19f8f None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:25:17.571619 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:17.615380 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfb0b4-f1d6-4d34-a591-5ef85a3badfc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74b3e45a14bd4b539974e9e5e278ee62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:25:17.616005 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfb0b4-f1d6-4d34-a591-5ef85a3badfc service glance] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:17.616277 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfb0b4-f1d6-4d34-a591-5ef85a3badfc service glance] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:17.616548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfb0b4-f1d6-4d34-a591-5ef85a3badfc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:17.618195 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-93cfb0b4-f1d6-4d34-a591-5ef85a3badfc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:17.731072 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfb0b4-f1d6-4d34-a591-5ef85a3badfc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:25:17.732433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfb0b4-f1d6-4d34-a591-5ef85a3badfc service glance] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:25:17.750754 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 686/1393] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:25:18.515215 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350f5bc-df44-4d4c-8538-e7c5b18ce429 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:18.515810 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350f5bc-df44-4d4c-8538-e7c5b18ce429 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:18.515810 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350f5bc-df44-4d4c-8538-e7c5b18ce429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:18.587373 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-8350f5bc-df44-4d4c-8538-e7c5b18ce429 None None] MFA Rules not processed for user `05cfc9d62a244701a5df524d1c26f107`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:25:18.588657 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8350f5bc-df44-4d4c-8538-e7c5b18ce429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:18.686006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 708/1394] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Oct 4 16:25:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:25:18.731881 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9b468-5ebd-4c41-a283-be6f563fe375 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:18.732442 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9b468-5ebd-4c41-a283-be6f563fe375 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:18.732442 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9b468-5ebd-4c41-a283-be6f563fe375 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:18.733845 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 687/1395] 10.222.0.55 () {54 vars in 943 bytes} [Tue Oct 4 16:25:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:25:18.740547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71e46b-351a-4ace-82e6-9bebf1d02a42 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:18.740847 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71e46b-351a-4ace-82e6-9bebf1d02a42 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:18.741132 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71e46b-351a-4ace-82e6-9bebf1d02a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:18.802853 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67438ff-d96a-4391-8e79-6bf7167d9dbb None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:18.803542 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67438ff-d96a-4391-8e79-6bf7167d9dbb None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:18.803827 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67438ff-d96a-4391-8e79-6bf7167d9dbb None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:18.807022 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 688/1396] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:25:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:25:18.811817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10035547-b89f-4c25-a5ed-8ea9018f8c1c None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:18.812194 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10035547-b89f-4c25-a5ed-8ea9018f8c1c None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:18.812395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10035547-b89f-4c25-a5ed-8ea9018f8c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:18.827518 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-2c71e46b-351a-4ace-82e6-9bebf1d02a42 None None] MFA Rules not processed for user `6590cb6c1c964039b9dea771a647bdac`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:25:18.828748 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-2c71e46b-351a-4ace-82e6-9bebf1d02a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:18.857621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:18.882513 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-10035547-b89f-4c25-a5ed-8ea9018f8c1c None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:25:18.883777 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-10035547-b89f-4c25-a5ed-8ea9018f8c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:18.901982 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:18.944222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 709/1397] 10.222.0.55 () {58 vars in 1040 bytes} [Tue Oct 4 16:25:18 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:25:18.953718 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71e46b-351a-4ace-82e6-9bebf1d02a42 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:25:18.963386 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71e46b-351a-4ace-82e6-9bebf1d02a42 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:25:18.985501 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 689/1398] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:25:19.074365 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f46ae-231b-4c99-9e9a-8eea5cf39a29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6590cb6c1c964039b9dea771a647bdac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:25:19.075273 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f46ae-231b-4c99-9e9a-8eea5cf39a29 service swift] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:19.075555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f46ae-231b-4c99-9e9a-8eea5cf39a29 service swift] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:19.075822 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f46ae-231b-4c99-9e9a-8eea5cf39a29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:19.077518 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-de1f46ae-231b-4c99-9e9a-8eea5cf39a29 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:19.115998 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:19.171309 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f46ae-231b-4c99-9e9a-8eea5cf39a29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:25:19.172941 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f46ae-231b-4c99-9e9a-8eea5cf39a29 service swift] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:25:19.181269 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 710/1399] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Oct 4 16:25:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 16:25:19.276168 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10035547-b89f-4c25-a5ed-8ea9018f8c1c None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:25:19.277418 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-10035547-b89f-4c25-a5ed-8ea9018f8c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:19.431954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10035547-b89f-4c25-a5ed-8ea9018f8c1c None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:25:19.475972 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:19.563880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582f59a-927c-47db-919e-d276e81fbd6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:25:19.564930 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582f59a-927c-47db-919e-d276e81fbd6c service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:19.565203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582f59a-927c-47db-919e-d276e81fbd6c service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:19.565466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582f59a-927c-47db-919e-d276e81fbd6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:19.567083 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a582f59a-927c-47db-919e-d276e81fbd6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:19.682477 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582f59a-927c-47db-919e-d276e81fbd6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:25:19.684430 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582f59a-927c-47db-919e-d276e81fbd6c service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:25:19.704657 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 690/1400] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:25:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:25:21.972772 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e69e3-a364-42e9-a1d0-ee998748624c None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:21.973844 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e69e3-a364-42e9-a1d0-ee998748624c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:21.974304 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e69e3-a364-42e9-a1d0-ee998748624c None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:21.975941 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 711/1401] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:25:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:25:21.981576 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054513e1-74cf-46ac-95c5-7adf2ee3c86b None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:21.982118 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054513e1-74cf-46ac-95c5-7adf2ee3c86b None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:21.982118 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054513e1-74cf-46ac-95c5-7adf2ee3c86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:22.034858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:22.056733 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-054513e1-74cf-46ac-95c5-7adf2ee3c86b None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:25:22.057964 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-054513e1-74cf-46ac-95c5-7adf2ee3c86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:22.237583 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 691/1402] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:25:22.521970 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e69e3-a364-42e9-a1d0-ee998748624c None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:25:22.523688 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-c56e69e3-a364-42e9-a1d0-ee998748624c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:22.693524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e69e3-a364-42e9-a1d0-ee998748624c None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:25:22.722061 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:22.816575 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ba039-182c-4cb6-8866-1c0be271666b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:25:22.817529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ba039-182c-4cb6-8866-1c0be271666b service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:22.817804 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ba039-182c-4cb6-8866-1c0be271666b service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:22.818070 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ba039-182c-4cb6-8866-1c0be271666b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:22.819805 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8e6ba039-182c-4cb6-8866-1c0be271666b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:22.917917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ba039-182c-4cb6-8866-1c0be271666b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:25:22.919564 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ba039-182c-4cb6-8866-1c0be271666b service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:25:22.940983 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 712/1403] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:25:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:25:25.170161 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca8601-8048-469d-82d8-2e5ab2b367b1 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:25.170736 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca8601-8048-469d-82d8-2e5ab2b367b1 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:25.170736 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca8601-8048-469d-82d8-2e5ab2b367b1 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:25.172236 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 692/1404] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:25:25.177584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fd14d-9a3c-4ad5-9d90-883d58aef4b0 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:25.178037 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fd14d-9a3c-4ad5-9d90-883d58aef4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:25.178175 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fd14d-9a3c-4ad5-9d90-883d58aef4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:25.223042 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:25.251707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-884fd14d-9a3c-4ad5-9d90-883d58aef4b0 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:25:25.253062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-884fd14d-9a3c-4ad5-9d90-883d58aef4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:25.369859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 713/1405] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:25:25.662678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca8601-8048-469d-82d8-2e5ab2b367b1 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:25:25.664334 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-d9ca8601-8048-469d-82d8-2e5ab2b367b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:25.792702 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:25.829473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca8601-8048-469d-82d8-2e5ab2b367b1 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:25:25.954600 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6784a46-d094-47fa-b13f-7035c0b3b5cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:25:25.955161 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6784a46-d094-47fa-b13f-7035c0b3b5cf service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:25.955439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6784a46-d094-47fa-b13f-7035c0b3b5cf service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:25.955711 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6784a46-d094-47fa-b13f-7035c0b3b5cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:25.957351 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-e6784a46-d094-47fa-b13f-7035c0b3b5cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:26.044942 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:26.056877 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6784a46-d094-47fa-b13f-7035c0b3b5cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:25:26.058546 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6784a46-d094-47fa-b13f-7035c0b3b5cf service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:25:26.079270 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 693/1406] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:25:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:25:28.369368 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f3a38-42c4-4971-81f9-89028991595e None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:28.369368 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f3a38-42c4-4971-81f9-89028991595e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:28.369368 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f3a38-42c4-4971-81f9-89028991595e None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:28.370100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 714/1407] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:25:28.375704 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd52be-dfaa-4e34-bddb-ffa20e70a3aa None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:28.376207 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd52be-dfaa-4e34-bddb-ffa20e70a3aa None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:28.376311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd52be-dfaa-4e34-bddb-ffa20e70a3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:28.451411 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-21bd52be-dfaa-4e34-bddb-ffa20e70a3aa None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:25:28.452827 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-21bd52be-dfaa-4e34-bddb-ffa20e70a3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:28.553334 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 694/1408] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:25:28.841018 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f3a38-42c4-4971-81f9-89028991595e None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:25:28.844060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-3e2f3a38-42c4-4971-81f9-89028991595e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:28.958940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:29.005944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f3a38-42c4-4971-81f9-89028991595e None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:25:29.134843 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28d4bf-478a-4d52-a365-a471bb38833a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:25:29.135553 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28d4bf-478a-4d52-a365-a471bb38833a service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:29.135838 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28d4bf-478a-4d52-a365-a471bb38833a service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:29.136103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28d4bf-478a-4d52-a365-a471bb38833a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:29.137723 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-fc28d4bf-478a-4d52-a365-a471bb38833a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:29.233409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:29.251369 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28d4bf-478a-4d52-a365-a471bb38833a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:25:29.252986 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28d4bf-478a-4d52-a365-a471bb38833a service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:25:29.272347 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 715/1409] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:25:38.552081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=74 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:39.269877 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=13 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:42.201445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457ccd0-ee45-451e-be1f-1b05d62aefc8 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:42.202235 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457ccd0-ee45-451e-be1f-1b05d62aefc8 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:42.202235 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457ccd0-ee45-451e-be1f-1b05d62aefc8 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:42.203701 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 695/1410] 10.222.0.55 () {54 vars in 918 bytes} [Tue Oct 4 16:25:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:25:42.209399 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b2245-611d-40cf-890b-c49b38c266b6 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:42.209926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b2245-611d-40cf-890b-c49b38c266b6 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:42.209926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b2245-611d-40cf-890b-c49b38c266b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:42.289567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-035b2245-611d-40cf-890b-c49b38c266b6 None None] MFA Rules not processed for user `8cd59eac06e347ee9432185b24fdf773`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:25:42.290795 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-035b2245-611d-40cf-890b-c49b38c266b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:42.424001 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 716/1411] 10.222.0.55 () {58 vars in 1015 bytes} [Tue Oct 4 16:25:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:25:42.441957 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1198e-f6f0-4b6e-a54d-4e0ce970639b None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:42.442234 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1198e-f6f0-4b6e-a54d-4e0ce970639b None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:42.442504 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1198e-f6f0-4b6e-a54d-4e0ce970639b None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:42.443935 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 696/1412] 10.222.0.55 () {54 vars in 918 bytes} [Tue Oct 4 16:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:25:42.450373 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c02e9d-9022-4213-af84-07f95687bcf1 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:42.450684 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c02e9d-9022-4213-af84-07f95687bcf1 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:42.451073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c02e9d-9022-4213-af84-07f95687bcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:42.531589 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:42.535629 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-b7c02e9d-9022-4213-af84-07f95687bcf1 None None] MFA Rules not processed for user `6cdee0584fe045028a44c385d032d2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:25:42.538182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b7c02e9d-9022-4213-af84-07f95687bcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:42.682102 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 717/1413] 10.222.0.55 () {58 vars in 1015 bytes} [Tue Oct 4 16:25:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:25:45.308587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d92242-f183-4c3e-bf69-7c8b2ab6d903 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:45.309206 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d92242-f183-4c3e-bf69-7c8b2ab6d903 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:45.309206 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d92242-f183-4c3e-bf69-7c8b2ab6d903 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:45.310493 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 697/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 16:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:25:45.316357 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c5db9-a0a0-4ccb-a85b-00322c01e30d None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:45.316788 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c5db9-a0a0-4ccb-a85b-00322c01e30d None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:45.316893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c5db9-a0a0-4ccb-a85b-00322c01e30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:45.386409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-8d0c5db9-a0a0-4ccb-a85b-00322c01e30d None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:25:45.387571 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8d0c5db9-a0a0-4ccb-a85b-00322c01e30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:45.444061 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:45.486935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 718/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 16:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:25:45.786594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d92242-f183-4c3e-bf69-7c8b2ab6d903 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:25:45.788367 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f3d92242-f183-4c3e-bf69-7c8b2ab6d903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:45.944599 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d92242-f183-4c3e-bf69-7c8b2ab6d903 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:25:46.028805 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:46.084134 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f93bf-67dd-4f1b-a916-441fda6f7e2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:25:46.084741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f93bf-67dd-4f1b-a916-441fda6f7e2a service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:46.085054 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f93bf-67dd-4f1b-a916-441fda6f7e2a service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:46.085381 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f93bf-67dd-4f1b-a916-441fda6f7e2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:46.088039 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c95f93bf-67dd-4f1b-a916-441fda6f7e2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:46.185244 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f93bf-67dd-4f1b-a916-441fda6f7e2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:25:46.186870 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f93bf-67dd-4f1b-a916-441fda6f7e2a service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:25:46.206418 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 698/1416] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:25:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:25:47.381739 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873f4f8-de48-47f5-9a2c-c6f3f78de84b None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:47.382302 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873f4f8-de48-47f5-9a2c-c6f3f78de84b None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:47.382302 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873f4f8-de48-47f5-9a2c-c6f3f78de84b None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:47.383559 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 719/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 16:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:25:47.390443 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b73598-4fbc-4e11-b02d-b71dbc32c9fd None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:47.390942 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b73598-4fbc-4e11-b02d-b71dbc32c9fd None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:47.390942 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b73598-4fbc-4e11-b02d-b71dbc32c9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:47.476027 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-08b73598-4fbc-4e11-b02d-b71dbc32c9fd None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:25:47.477276 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-08b73598-4fbc-4e11-b02d-b71dbc32c9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:47.507408 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:47.580584 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 699/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 16:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:25:47.742245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873f4f8-de48-47f5-9a2c-c6f3f78de84b None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:25:47.743687 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-7873f4f8-de48-47f5-9a2c-c6f3f78de84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:47.915905 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873f4f8-de48-47f5-9a2c-c6f3f78de84b None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:25:47.966863 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:48.052343 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75035c5b-b507-4c83-9ada-ae562d36f304 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:25:48.052844 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75035c5b-b507-4c83-9ada-ae562d36f304 service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:48.053125 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75035c5b-b507-4c83-9ada-ae562d36f304 service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:48.053390 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75035c5b-b507-4c83-9ada-ae562d36f304 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:48.055074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-75035c5b-b507-4c83-9ada-ae562d36f304 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:48.160015 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75035c5b-b507-4c83-9ada-ae562d36f304 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:25:48.162543 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75035c5b-b507-4c83-9ada-ae562d36f304 service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:25:48.187120 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 720/1419] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:25:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:25:49.359330 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0449729-a1f1-45cd-bf9e-fef62b123fbb None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:49.359871 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0449729-a1f1-45cd-bf9e-fef62b123fbb None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:49.359871 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0449729-a1f1-45cd-bf9e-fef62b123fbb None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:49.361154 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 700/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 16:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:25:49.367903 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa7521-37ec-471c-86d8-d83d6e3b1e83 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:49.368445 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa7521-37ec-471c-86d8-d83d6e3b1e83 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:49.368445 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa7521-37ec-471c-86d8-d83d6e3b1e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:49.427784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:49.451222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-efaa7521-37ec-471c-86d8-d83d6e3b1e83 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:25:49.452485 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-efaa7521-37ec-471c-86d8-d83d6e3b1e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:49.549883 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 721/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 16:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:25:49.700411 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0449729-a1f1-45cd-bf9e-fef62b123fbb None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:25:49.701862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a0449729-a1f1-45cd-bf9e-fef62b123fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:49.862209 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0449729-a1f1-45cd-bf9e-fef62b123fbb None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:25:49.876115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:50.012698 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59f852-183d-4827-b654-3c0d33cb9143 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:25:50.013232 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59f852-183d-4827-b654-3c0d33cb9143 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:50.013507 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59f852-183d-4827-b654-3c0d33cb9143 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:50.013789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59f852-183d-4827-b654-3c0d33cb9143 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:50.015454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-1f59f852-183d-4827-b654-3c0d33cb9143 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:50.265999 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59f852-183d-4827-b654-3c0d33cb9143 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:25:50.267523 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59f852-183d-4827-b654-3c0d33cb9143 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:25:50.290948 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 701/1422] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:25:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:25:51.409947 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604800b-7535-4967-b3c0-41e23290f078 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:51.410425 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604800b-7535-4967-b3c0-41e23290f078 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:51.410571 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604800b-7535-4967-b3c0-41e23290f078 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:51.412870 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 722/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 16:25:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:25:51.420122 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d21a20-6606-4963-b96d-96f12b9e85d4 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:51.421525 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d21a20-6606-4963-b96d-96f12b9e85d4 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:51.421525 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d21a20-6606-4963-b96d-96f12b9e85d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:51.443775 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:51.508145 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-b5d21a20-6606-4963-b96d-96f12b9e85d4 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:25:51.509447 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-b5d21a20-6606-4963-b96d-96f12b9e85d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:51.629604 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 702/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 16:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:25:51.782654 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604800b-7535-4967-b3c0-41e23290f078 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:25:51.784924 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-7604800b-7535-4967-b3c0-41e23290f078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:51.933880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:51.974625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604800b-7535-4967-b3c0-41e23290f078 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:25:52.099639 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1524677-dc18-4d66-ae84-21cac122f627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:25:52.100153 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1524677-dc18-4d66-ae84-21cac122f627 service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:52.100444 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1524677-dc18-4d66-ae84-21cac122f627 service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:52.100714 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1524677-dc18-4d66-ae84-21cac122f627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:52.102334 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b1524677-dc18-4d66-ae84-21cac122f627 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:52.183477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:52.198313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1524677-dc18-4d66-ae84-21cac122f627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:25:52.199927 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1524677-dc18-4d66-ae84-21cac122f627 service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:25:52.218419 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 723/1425] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:25:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:25:53.349055 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6eb4ed-2ef8-4ad6-8589-422aabfd9383 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:53.349658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6eb4ed-2ef8-4ad6-8589-422aabfd9383 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:53.349658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6eb4ed-2ef8-4ad6-8589-422aabfd9383 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:53.351014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 703/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 16:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:25:53.359018 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab0ab8-d040-4c26-97af-c4da6c129887 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:53.359579 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab0ab8-d040-4c26-97af-c4da6c129887 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:53.359579 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab0ab8-d040-4c26-97af-c4da6c129887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:53.442859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-81ab0ab8-d040-4c26-97af-c4da6c129887 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:25:53.444140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-81ab0ab8-d040-4c26-97af-c4da6c129887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:53.556872 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 724/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 16:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:25:53.716181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6eb4ed-2ef8-4ad6-8589-422aabfd9383 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:25:53.717621 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-3a6eb4ed-2ef8-4ad6-8589-422aabfd9383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:53.814212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:53.878807 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6eb4ed-2ef8-4ad6-8589-422aabfd9383 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:25:54.000943 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d9512-0242-4ffc-98ae-67b01be8998f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:25:54.001472 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d9512-0242-4ffc-98ae-67b01be8998f service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:54.001748 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d9512-0242-4ffc-98ae-67b01be8998f service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:54.002018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d9512-0242-4ffc-98ae-67b01be8998f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:54.003786 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-846d9512-0242-4ffc-98ae-67b01be8998f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:54.056185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:54.108667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d9512-0242-4ffc-98ae-67b01be8998f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:25:54.110284 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d9512-0242-4ffc-98ae-67b01be8998f service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:25:54.128827 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 704/1428] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:25:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:25:55.197341 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b3152-fb4e-4111-b8a6-7b1e6b1ddfc2 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:55.197939 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b3152-fb4e-4111-b8a6-7b1e6b1ddfc2 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:55.197939 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b3152-fb4e-4111-b8a6-7b1e6b1ddfc2 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:55.199283 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 725/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 16:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:25:55.206332 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340b0b3-f75a-4de6-bb48-63451d3b81ae None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:55.206890 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340b0b3-f75a-4de6-bb48-63451d3b81ae None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:55.206890 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340b0b3-f75a-4de6-bb48-63451d3b81ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:55.291685 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-e340b0b3-f75a-4de6-bb48-63451d3b81ae None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:25:55.292917 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-e340b0b3-f75a-4de6-bb48-63451d3b81ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:55.397059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 705/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 16:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:25:55.552345 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b3152-fb4e-4111-b8a6-7b1e6b1ddfc2 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:25:55.554011 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-4c4b3152-fb4e-4111-b8a6-7b1e6b1ddfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:55.608383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:55.711413 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b3152-fb4e-4111-b8a6-7b1e6b1ddfc2 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:25:55.838440 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b3302-7127-4e3c-b18f-d5eae71d3ff9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:25:55.839081 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b3302-7127-4e3c-b18f-d5eae71d3ff9 service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:55.839368 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b3302-7127-4e3c-b18f-d5eae71d3ff9 service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:55.839642 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b3302-7127-4e3c-b18f-d5eae71d3ff9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:55.841262 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-029b3302-7127-4e3c-b18f-d5eae71d3ff9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:55.849476 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:55.944352 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b3302-7127-4e3c-b18f-d5eae71d3ff9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:25:55.946028 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b3302-7127-4e3c-b18f-d5eae71d3ff9 service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:25:55.964752 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 726/1431] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:25:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:25:57.023080 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441176e-f2a4-4817-80c7-efa26ac30ec8 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:57.023650 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441176e-f2a4-4817-80c7-efa26ac30ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:57.023650 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441176e-f2a4-4817-80c7-efa26ac30ec8 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:57.024886 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 706/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 16:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:25:57.031610 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06925e53-9ef9-48f1-b4b9-94d531e8d54c None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:57.032091 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06925e53-9ef9-48f1-b4b9-94d531e8d54c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:57.032205 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06925e53-9ef9-48f1-b4b9-94d531e8d54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:57.111584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-06925e53-9ef9-48f1-b4b9-94d531e8d54c None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:25:57.112899 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-06925e53-9ef9-48f1-b4b9-94d531e8d54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:57.190260 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:57.220199 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 727/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 16:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:25:57.370502 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441176e-f2a4-4817-80c7-efa26ac30ec8 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:25:57.372130 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c441176e-f2a4-4817-80c7-efa26ac30ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:57.391045 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:57.527042 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441176e-f2a4-4817-80c7-efa26ac30ec8 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:25:57.633103 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:57.660885 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd086161-ecb7-4613-9cb9-633a4f3839c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:25:57.661564 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd086161-ecb7-4613-9cb9-633a4f3839c7 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:57.661820 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd086161-ecb7-4613-9cb9-633a4f3839c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:57.662088 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd086161-ecb7-4613-9cb9-633a4f3839c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:57.663796 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-bd086161-ecb7-4613-9cb9-633a4f3839c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:57.767544 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd086161-ecb7-4613-9cb9-633a4f3839c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:25:57.769183 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd086161-ecb7-4613-9cb9-633a4f3839c7 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:25:57.790842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 707/1434] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:25:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:25:58.862898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae599d75-4467-4842-9981-225feb5e9ed7 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:58.863484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae599d75-4467-4842-9981-225feb5e9ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:58.863484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae599d75-4467-4842-9981-225feb5e9ed7 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:58.864729 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 728/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 16:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:25:58.871411 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291a18c-e55c-4c6f-bff5-5b5eaaca383c None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:58.871879 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291a18c-e55c-4c6f-bff5-5b5eaaca383c None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:58.871983 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291a18c-e55c-4c6f-bff5-5b5eaaca383c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:58.955250 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-a291a18c-e55c-4c6f-bff5-5b5eaaca383c None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:25:58.956482 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a291a18c-e55c-4c6f-bff5-5b5eaaca383c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:59.001965 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:59.060300 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 708/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 16:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:25:59.215119 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae599d75-4467-4842-9981-225feb5e9ed7 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:25:59.216580 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ae599d75-4467-4842-9981-225feb5e9ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:59.386671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae599d75-4467-4842-9981-225feb5e9ed7 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:25:59.568745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:25:59.636881 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27169aa2-0a3a-419f-9dbb-2f15afd210bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:25:59.637538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27169aa2-0a3a-419f-9dbb-2f15afd210bc service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:25:59.637810 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27169aa2-0a3a-419f-9dbb-2f15afd210bc service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:25:59.638091 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27169aa2-0a3a-419f-9dbb-2f15afd210bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:25:59.639777 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-27169aa2-0a3a-419f-9dbb-2f15afd210bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:25:59.734690 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27169aa2-0a3a-419f-9dbb-2f15afd210bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:25:59.736359 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27169aa2-0a3a-419f-9dbb-2f15afd210bc service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:25:59.754737 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 729/1437] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:25:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:26:00.819336 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d4ecd-09c4-49a6-813f-5e4d47bc6133 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:00.820262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d4ecd-09c4-49a6-813f-5e4d47bc6133 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:00.820262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d4ecd-09c4-49a6-813f-5e4d47bc6133 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:00.821678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 709/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 16:26:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:26:00.829392 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a2d4f-cb2f-4aa9-9702-842ff2fdaf63 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:00.832016 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a2d4f-cb2f-4aa9-9702-842ff2fdaf63 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:00.832252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a2d4f-cb2f-4aa9-9702-842ff2fdaf63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:00.914619 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-bc0a2d4f-cb2f-4aa9-9702-842ff2fdaf63 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:26:00.915867 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-bc0a2d4f-cb2f-4aa9-9702-842ff2fdaf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:00.917893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:01.016127 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 730/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 16:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:26:01.170318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d4ecd-09c4-49a6-813f-5e4d47bc6133 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:26:01.171879 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f54d4ecd-09c4-49a6-813f-5e4d47bc6133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:01.329132 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d4ecd-09c4-49a6-813f-5e4d47bc6133 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:26:01.358156 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:01.449698 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8dcaa3-cbbe-4f65-bd1b-8c3e5b0e728b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:26:01.450318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dcaa3-cbbe-4f65-bd1b-8c3e5b0e728b service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:01.450590 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dcaa3-cbbe-4f65-bd1b-8c3e5b0e728b service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:01.450855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dcaa3-cbbe-4f65-bd1b-8c3e5b0e728b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:01.452495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-1b8dcaa3-cbbe-4f65-bd1b-8c3e5b0e728b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:01.548078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8dcaa3-cbbe-4f65-bd1b-8c3e5b0e728b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:26:01.549798 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8dcaa3-cbbe-4f65-bd1b-8c3e5b0e728b service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:26:01.568286 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 710/1440] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:26:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:26:03.645229 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdf992-0e9c-4e56-8f5b-ff2b6db633e2 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:03.645833 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdf992-0e9c-4e56-8f5b-ff2b6db633e2 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:03.645833 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdf992-0e9c-4e56-8f5b-ff2b6db633e2 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:03.647200 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 731/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 16:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:26:03.653270 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba866e-e44b-42d3-9c22-0a995d5aebf6 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:03.653956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba866e-e44b-42d3-9c22-0a995d5aebf6 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:03.653956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba866e-e44b-42d3-9c22-0a995d5aebf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:03.697329 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:03.725255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-31ba866e-e44b-42d3-9c22-0a995d5aebf6 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:26:03.726491 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-31ba866e-e44b-42d3-9c22-0a995d5aebf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:03.826951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 711/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 16:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:26:04.110788 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdf992-0e9c-4e56-8f5b-ff2b6db633e2 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:26:04.112421 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-f6bdf992-0e9c-4e56-8f5b-ff2b6db633e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:04.221085 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdf992-0e9c-4e56-8f5b-ff2b6db633e2 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:26:04.254784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:04.299830 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745138f-9dfc-41f6-b2cd-cc11ed5a6089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:26:04.300446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745138f-9dfc-41f6-b2cd-cc11ed5a6089 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:04.300730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745138f-9dfc-41f6-b2cd-cc11ed5a6089 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:04.301007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745138f-9dfc-41f6-b2cd-cc11ed5a6089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:04.302608 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-5745138f-9dfc-41f6-b2cd-cc11ed5a6089 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:04.411793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745138f-9dfc-41f6-b2cd-cc11ed5a6089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:26:04.413164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745138f-9dfc-41f6-b2cd-cc11ed5a6089 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:26:04.431941 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 732/1443] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:26:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:26:06.733663 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05e3df-cf69-400e-aba0-43c3de8985a5 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:06.734288 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05e3df-cf69-400e-aba0-43c3de8985a5 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:06.734288 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05e3df-cf69-400e-aba0-43c3de8985a5 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:06.736274 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 712/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 16:26:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:26:06.744914 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75165cbf-bf8f-4abe-b2e2-ad2a02567b42 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:06.745571 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75165cbf-bf8f-4abe-b2e2-ad2a02567b42 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:06.745699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75165cbf-bf8f-4abe-b2e2-ad2a02567b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:06.821730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-75165cbf-bf8f-4abe-b2e2-ad2a02567b42 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:26:06.822946 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-75165cbf-bf8f-4abe-b2e2-ad2a02567b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:06.837177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:06.935323 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 733/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 16:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:26:07.221157 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05e3df-cf69-400e-aba0-43c3de8985a5 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:26:07.222707 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-fd05e3df-cf69-400e-aba0-43c3de8985a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:07.328702 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05e3df-cf69-400e-aba0-43c3de8985a5 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:26:07.341603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:07.403685 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0436d9f-f29a-42e3-bb9b-c75b782837ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:26:07.404205 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0436d9f-f29a-42e3-bb9b-c75b782837ac service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:07.404479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0436d9f-f29a-42e3-bb9b-c75b782837ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:07.404744 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0436d9f-f29a-42e3-bb9b-c75b782837ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:07.406447 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f0436d9f-f29a-42e3-bb9b-c75b782837ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:07.520749 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0436d9f-f29a-42e3-bb9b-c75b782837ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:26:07.522573 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0436d9f-f29a-42e3-bb9b-c75b782837ac service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:26:07.540333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 713/1446] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:26:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:26:10.041008 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444100b-b7b5-4d82-bf7f-e704fce74649 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:10.041555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444100b-b7b5-4d82-bf7f-e704fce74649 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:10.041555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444100b-b7b5-4d82-bf7f-e704fce74649 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:10.042835 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 734/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 16:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:26:10.048498 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd913c81-1f9c-44cb-b670-dd11ac60decf None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:10.049042 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd913c81-1f9c-44cb-b670-dd11ac60decf None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:10.049151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd913c81-1f9c-44cb-b670-dd11ac60decf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:10.101069 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:10.123064 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-cd913c81-1f9c-44cb-b670-dd11ac60decf None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:26:10.124304 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-cd913c81-1f9c-44cb-b670-dd11ac60decf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:10.227790 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 714/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 16:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:26:10.520061 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444100b-b7b5-4d82-bf7f-e704fce74649 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:26:10.522500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-9444100b-b7b5-4d82-bf7f-e704fce74649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:10.640332 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444100b-b7b5-4d82-bf7f-e704fce74649 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:26:10.694918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:10.738402 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8aeece-00d7-47bb-b280-6a3890ce0bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:26:10.739040 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8aeece-00d7-47bb-b280-6a3890ce0bda service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:10.739376 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8aeece-00d7-47bb-b280-6a3890ce0bda service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:10.739751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8aeece-00d7-47bb-b280-6a3890ce0bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:10.742345 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-af8aeece-00d7-47bb-b280-6a3890ce0bda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:10.879375 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8aeece-00d7-47bb-b280-6a3890ce0bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:26:10.880849 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8aeece-00d7-47bb-b280-6a3890ce0bda service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:26:10.901304 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 735/1449] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:26:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:26:13.217928 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158c822-fcee-483d-ad0f-57f5165f9a8a None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:13.218477 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158c822-fcee-483d-ad0f-57f5165f9a8a None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:13.218477 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158c822-fcee-483d-ad0f-57f5165f9a8a None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:13.220188 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 715/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 16:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:26:13.225840 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049366f-edac-48f6-9692-34047841851f None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:13.226605 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049366f-edac-48f6-9692-34047841851f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:13.227160 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049366f-edac-48f6-9692-34047841851f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:13.298241 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-4049366f-edac-48f6-9692-34047841851f None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:26:13.299514 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-4049366f-edac-48f6-9692-34047841851f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:13.322304 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:13.406599 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 736/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 16:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:26:13.688675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158c822-fcee-483d-ad0f-57f5165f9a8a None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:26:13.690259 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-3158c822-fcee-483d-ad0f-57f5165f9a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:13.803702 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158c822-fcee-483d-ad0f-57f5165f9a8a None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:26:13.827715 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:13.896598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c98a0-450c-4e90-98c0-adcea24d856c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:26:13.897220 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c98a0-450c-4e90-98c0-adcea24d856c service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:13.897501 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c98a0-450c-4e90-98c0-adcea24d856c service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:13.897770 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c98a0-450c-4e90-98c0-adcea24d856c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:13.899449 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-4c6c98a0-450c-4e90-98c0-adcea24d856c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:14.034152 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c98a0-450c-4e90-98c0-adcea24d856c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:26:14.039340 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c98a0-450c-4e90-98c0-adcea24d856c service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:26:14.060012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 716/1452] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:26:16.364039 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c92b37-cafe-4dda-afd5-375ebb997154 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:16.364635 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c92b37-cafe-4dda-afd5-375ebb997154 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:16.364635 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c92b37-cafe-4dda-afd5-375ebb997154 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:16.365961 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 737/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 16:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:26:16.372050 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db6051-6a55-4d54-9572-e41a38201e7f None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:16.372536 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db6051-6a55-4d54-9572-e41a38201e7f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:16.372536 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db6051-6a55-4d54-9572-e41a38201e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:16.454664 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:16.458674 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-b4db6051-6a55-4d54-9572-e41a38201e7f None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:26:16.460645 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-b4db6051-6a55-4d54-9572-e41a38201e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:16.578860 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 717/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 16:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:26:16.859234 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c92b37-cafe-4dda-afd5-375ebb997154 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:26:16.860982 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-d8c92b37-cafe-4dda-afd5-375ebb997154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:16.981646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c92b37-cafe-4dda-afd5-375ebb997154 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:26:17.037846 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:17.064440 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ca97a-fcc7-492c-860f-22465295136f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:26:17.065065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ca97a-fcc7-492c-860f-22465295136f service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:17.065348 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ca97a-fcc7-492c-860f-22465295136f service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:17.065615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ca97a-fcc7-492c-860f-22465295136f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:17.067247 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-564ca97a-fcc7-492c-860f-22465295136f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:17.181824 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ca97a-fcc7-492c-860f-22465295136f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:26:17.183302 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ca97a-fcc7-492c-860f-22465295136f service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:26:17.202754 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 738/1455] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:26:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:26:19.466126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fc817-3c2c-487e-9fb6-6bdd0a7cf25e None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:19.466948 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fc817-3c2c-487e-9fb6-6bdd0a7cf25e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:19.466948 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fc817-3c2c-487e-9fb6-6bdd0a7cf25e None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:19.469091 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 718/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 16:26:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:26:19.474645 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821e287-e04d-4663-83ec-86ca1d828c81 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:19.475092 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821e287-e04d-4663-83ec-86ca1d828c81 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:19.475204 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821e287-e04d-4663-83ec-86ca1d828c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:19.553784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-9821e287-e04d-4663-83ec-86ca1d828c81 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:26:19.555123 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-9821e287-e04d-4663-83ec-86ca1d828c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:19.593849 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:19.675525 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 739/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 16:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:26:19.956360 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fc817-3c2c-487e-9fb6-6bdd0a7cf25e None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:26:19.958837 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-8d5fc817-3c2c-487e-9fb6-6bdd0a7cf25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:20.083395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fc817-3c2c-487e-9fb6-6bdd0a7cf25e None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:26:20.115508 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:20.164740 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b285a-e513-4986-97df-def9d1a6636c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:26:20.165365 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b285a-e513-4986-97df-def9d1a6636c service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:20.165639 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b285a-e513-4986-97df-def9d1a6636c service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:20.165906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b285a-e513-4986-97df-def9d1a6636c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:20.167571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-d72b285a-e513-4986-97df-def9d1a6636c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:20.287465 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b285a-e513-4986-97df-def9d1a6636c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:26:20.288833 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b285a-e513-4986-97df-def9d1a6636c service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:26:20.309125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 719/1458] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:26:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:26:22.570545 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae72b9-3795-4564-94b5-c6385de56c37 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:22.571198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae72b9-3795-4564-94b5-c6385de56c37 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:22.571198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae72b9-3795-4564-94b5-c6385de56c37 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:22.572531 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 740/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 16:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:26:22.578261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dd050-967a-45f9-b111-ee55f61bb6b7 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:22.578769 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dd050-967a-45f9-b111-ee55f61bb6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:22.578769 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dd050-967a-45f9-b111-ee55f61bb6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:22.651839 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-ff0dd050-967a-45f9-b111-ee55f61bb6b7 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:26:22.653101 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ff0dd050-967a-45f9-b111-ee55f61bb6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:22.662908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:22.760747 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 720/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 16:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:26:23.039707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae72b9-3795-4564-94b5-c6385de56c37 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:26:23.041254 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-58ae72b9-3795-4564-94b5-c6385de56c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:23.165299 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae72b9-3795-4564-94b5-c6385de56c37 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:26:23.230738 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:23.252116 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bd353-31ff-42bd-9727-bceb283ac2de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:26:23.252731 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bd353-31ff-42bd-9727-bceb283ac2de service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:23.253004 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bd353-31ff-42bd-9727-bceb283ac2de service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:23.253269 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bd353-31ff-42bd-9727-bceb283ac2de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:23.254864 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-084bd353-31ff-42bd-9727-bceb283ac2de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:23.375364 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084bd353-31ff-42bd-9727-bceb283ac2de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:26:23.377086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084bd353-31ff-42bd-9727-bceb283ac2de service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:26:23.403137 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 741/1461] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:26:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:26:25.626354 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d0ec3-3600-405d-a371-f33673b10208 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:25.626930 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d0ec3-3600-405d-a371-f33673b10208 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:25.626930 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d0ec3-3600-405d-a371-f33673b10208 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:25.628313 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 721/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 16:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:26:25.634942 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135f56d-04a6-4327-91d5-b18946b6a51a None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:25.635827 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135f56d-04a6-4327-91d5-b18946b6a51a None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:25.635827 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135f56d-04a6-4327-91d5-b18946b6a51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:25.708168 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-0135f56d-04a6-4327-91d5-b18946b6a51a None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:26:25.709384 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-0135f56d-04a6-4327-91d5-b18946b6a51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:25.750110 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:25.813306 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 742/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 16:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:26:26.102527 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d0ec3-3600-405d-a371-f33673b10208 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:26:26.104106 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-da4d0ec3-3600-405d-a371-f33673b10208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:26.223301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d0ec3-3600-405d-a371-f33673b10208 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:26:26.274878 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:26.314876 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b77288-1f07-464e-96d4-4ac076efa4f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:26:26.315522 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b77288-1f07-464e-96d4-4ac076efa4f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:26.315797 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b77288-1f07-464e-96d4-4ac076efa4f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:26.316066 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b77288-1f07-464e-96d4-4ac076efa4f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:26.317656 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c4b77288-1f07-464e-96d4-4ac076efa4f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:26.430668 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b77288-1f07-464e-96d4-4ac076efa4f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:26:26.432096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b77288-1f07-464e-96d4-4ac076efa4f8 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:26:26.452693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 722/1464] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:26:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:26:28.655360 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43862ab1-a7b7-45b0-a7dd-860828523999 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:28.655929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43862ab1-a7b7-45b0-a7dd-860828523999 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:28.655929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43862ab1-a7b7-45b0-a7dd-860828523999 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:28.657797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 743/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 16:26:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:26:28.664410 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0249d0b-d4aa-4719-a6ac-3d62888f9bbd None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:28.665170 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0249d0b-d4aa-4719-a6ac-3d62888f9bbd None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:28.665277 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0249d0b-d4aa-4719-a6ac-3d62888f9bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:28.738217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-b0249d0b-d4aa-4719-a6ac-3d62888f9bbd None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:26:28.739467 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-b0249d0b-d4aa-4719-a6ac-3d62888f9bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:28.758805 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:28.850314 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 723/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 16:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:26:29.130917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43862ab1-a7b7-45b0-a7dd-860828523999 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:26:29.132496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-43862ab1-a7b7-45b0-a7dd-860828523999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:29.237732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43862ab1-a7b7-45b0-a7dd-860828523999 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:26:29.308670 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:29.316706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48ceea-73e2-47f3-8ff3-970e7c305e8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:26:29.317328 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48ceea-73e2-47f3-8ff3-970e7c305e8a service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:29.317617 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48ceea-73e2-47f3-8ff3-970e7c305e8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:29.317892 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48ceea-73e2-47f3-8ff3-970e7c305e8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:29.319538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-3f48ceea-73e2-47f3-8ff3-970e7c305e8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:29.434698 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48ceea-73e2-47f3-8ff3-970e7c305e8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:26:29.436110 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48ceea-73e2-47f3-8ff3-970e7c305e8a service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:26:29.455016 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 744/1467] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:26:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:26:31.637179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef7fa4-98df-48b2-af70-6087ef552995 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:31.637734 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef7fa4-98df-48b2-af70-6087ef552995 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:31.637734 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef7fa4-98df-48b2-af70-6087ef552995 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:31.639886 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 724/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 16:26:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:26:31.646323 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c01ed-abb2-4dfd-a733-86485d20f01e None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:31.646743 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c01ed-abb2-4dfd-a733-86485d20f01e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:31.646867 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c01ed-abb2-4dfd-a733-86485d20f01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:31.716609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-028c01ed-abb2-4dfd-a733-86485d20f01e None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:26:31.717770 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-028c01ed-abb2-4dfd-a733-86485d20f01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:31.770755 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:31.822044 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 745/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 16:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:26:32.105611 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef7fa4-98df-48b2-af70-6087ef552995 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:26:32.108258 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-e3ef7fa4-98df-48b2-af70-6087ef552995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:32.221491 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef7fa4-98df-48b2-af70-6087ef552995 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:26:32.281337 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:32.311187 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a7f55-99c8-4b21-ad6f-c2076690d949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:26:32.311798 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a7f55-99c8-4b21-ad6f-c2076690d949 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:32.312095 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a7f55-99c8-4b21-ad6f-c2076690d949 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:32.312360 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a7f55-99c8-4b21-ad6f-c2076690d949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:32.313975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-591a7f55-99c8-4b21-ad6f-c2076690d949 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:32.427354 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a7f55-99c8-4b21-ad6f-c2076690d949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:26:32.428708 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a7f55-99c8-4b21-ad6f-c2076690d949 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:26:32.446752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 725/1470] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:26:41.820454 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=22 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:42.444464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=66 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:52.488011 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680ee5f-141e-4a15-808f-8c6aa1f3be8d None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:52.488950 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680ee5f-141e-4a15-808f-8c6aa1f3be8d None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:52.488950 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680ee5f-141e-4a15-808f-8c6aa1f3be8d None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:52.491189 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 746/1471] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:26:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:26:52.496721 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adaef10-fbc0-458f-9160-a464c56b1732 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:52.497187 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adaef10-fbc0-458f-9160-a464c56b1732 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:52.497290 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adaef10-fbc0-458f-9160-a464c56b1732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:52.566466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-5adaef10-fbc0-458f-9160-a464c56b1732 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:26:52.567704 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-5adaef10-fbc0-458f-9160-a464c56b1732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:52.673848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 726/1472] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:26:52.974050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319b482-d0c6-4b01-9f77-613124114c8b None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:52.974332 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319b482-d0c6-4b01-9f77-613124114c8b None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:52.974618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319b482-d0c6-4b01-9f77-613124114c8b None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:52.976078 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 747/1473] 10.222.0.55 () {54 vars in 962 bytes} [Tue Oct 4 16:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:26:52.983180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b611f8-0eaa-4249-b12a-6f68af67c976 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:52.983463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b611f8-0eaa-4249-b12a-6f68af67c976 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:52.983735 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b611f8-0eaa-4249-b12a-6f68af67c976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:53.064226 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-a7b611f8-0eaa-4249-b12a-6f68af67c976 None None] MFA Rules not processed for user `74b3e45a14bd4b539974e9e5e278ee62`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:26:53.065430 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a7b611f8-0eaa-4249-b12a-6f68af67c976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:53.097741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:53.156393 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 727/1474] 10.222.0.55 () {58 vars in 1059 bytes} [Tue Oct 4 16:26:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:26:53.164651 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319b482-d0c6-4b01-9f77-613124114c8b None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:26:53.166176 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-0319b482-d0c6-4b01-9f77-613124114c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:53.283173 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319b482-d0c6-4b01-9f77-613124114c8b None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:26:53.362674 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b04c1c-b350-4cc1-ab32-9a72a911a947 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74b3e45a14bd4b539974e9e5e278ee62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:26:53.363296 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b04c1c-b350-4cc1-ab32-9a72a911a947 service glance] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:53.363598 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b04c1c-b350-4cc1-ab32-9a72a911a947 service glance] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:53.363874 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b04c1c-b350-4cc1-ab32-9a72a911a947 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:53.365475 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-f3b04c1c-b350-4cc1-ab32-9a72a911a947 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:53.421807 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:53.478905 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b04c1c-b350-4cc1-ab32-9a72a911a947 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:26:53.480304 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b04c1c-b350-4cc1-ab32-9a72a911a947 service glance] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:26:53.499665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 748/1475] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:26:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:26:55.732529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40868241-56ad-435d-ad8c-05d4feb1da4f None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:55.733422 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40868241-56ad-435d-ad8c-05d4feb1da4f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:55.733422 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40868241-56ad-435d-ad8c-05d4feb1da4f None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:55.735650 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 728/1476] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:26:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:26:55.742189 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe712b-0f43-4869-b364-7fdb6a7fafd6 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:55.742646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe712b-0f43-4869-b364-7fdb6a7fafd6 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:55.742751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe712b-0f43-4869-b364-7fdb6a7fafd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:55.814144 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-fefe712b-0f43-4869-b364-7fdb6a7fafd6 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:26:55.815422 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-fefe712b-0f43-4869-b364-7fdb6a7fafd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:55.924996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 749/1477] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:26:56.200899 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40868241-56ad-435d-ad8c-05d4feb1da4f None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:26:56.202372 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-40868241-56ad-435d-ad8c-05d4feb1da4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:56.337055 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40868241-56ad-435d-ad8c-05d4feb1da4f None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:26:56.386436 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:56.432754 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc977071-be9a-4d06-8abe-cbb9d11974f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:26:56.433359 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc977071-be9a-4d06-8abe-cbb9d11974f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:56.433632 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc977071-be9a-4d06-8abe-cbb9d11974f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:56.433897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc977071-be9a-4d06-8abe-cbb9d11974f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:56.434534 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc977071-be9a-4d06-8abe-cbb9d11974f5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:26:56.436316 dv-cinder-749155-14-smb devstack@keystone.service[81561]: WARNING py.warnings [None req-dc977071-be9a-4d06-8abe-cbb9d11974f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 16:26:56.436316 dv-cinder-749155-14-smb devstack@keystone.service[81561]: warnings.warn(msg) Oct 04 16:26:56.436316 dv-cinder-749155-14-smb devstack@keystone.service[81561]: Oct 04 16:26:56.437490 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc977071-be9a-4d06-8abe-cbb9d11974f5 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:26:56.457314 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 729/1478] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Oct 4 16:26:56 2022] GET /identity/v3/projects => generated 2553 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:26:58.634664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d0fa9-bf51-4bef-a504-221f3b9c437e None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:58.635268 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d0fa9-bf51-4bef-a504-221f3b9c437e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:58.635268 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d0fa9-bf51-4bef-a504-221f3b9c437e None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:58.636654 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 750/1479] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:26:58.642154 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc027db-1129-4727-9bf4-547953cd6407 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:58.642587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc027db-1129-4727-9bf4-547953cd6407 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:58.642681 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc027db-1129-4727-9bf4-547953cd6407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:58.714185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-7bc027db-1129-4727-9bf4-547953cd6407 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:26:58.715468 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-7bc027db-1129-4727-9bf4-547953cd6407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:58.816602 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 730/1480] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:26:59.118637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d0fa9-bf51-4bef-a504-221f3b9c437e None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:26:59.120792 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-6b8d0fa9-bf51-4bef-a504-221f3b9c437e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:59.134555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:59.274820 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d0fa9-bf51-4bef-a504-221f3b9c437e None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:26:59.362834 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:26:59.410998 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d30f7-7ec3-4326-ac3c-72a7e68e8223 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:26:59.411631 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d30f7-7ec3-4326-ac3c-72a7e68e8223 service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:26:59.411912 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d30f7-7ec3-4326-ac3c-72a7e68e8223 service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:26:59.412183 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d30f7-7ec3-4326-ac3c-72a7e68e8223 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:26:59.413803 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-4f5d30f7-7ec3-4326-ac3c-72a7e68e8223 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:26:59.510632 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d30f7-7ec3-4326-ac3c-72a7e68e8223 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:26:59.512255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d30f7-7ec3-4326-ac3c-72a7e68e8223 service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:26:59.530096 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 751/1481] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:27:01.853520 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbee9e-95dc-4373-a7ce-4fb7737451c3 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:27:01.854419 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbee9e-95dc-4373-a7ce-4fb7737451c3 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:27:01.854419 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbee9e-95dc-4373-a7ce-4fb7737451c3 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:27:01.856620 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 731/1482] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:27:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:27:01.865728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2037e3-6330-4605-a581-87865d26f131 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:27:01.866165 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2037e3-6330-4605-a581-87865d26f131 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:27:01.866387 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2037e3-6330-4605-a581-87865d26f131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:27:01.939885 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-cb2037e3-6330-4605-a581-87865d26f131 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:27:01.941144 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-cb2037e3-6330-4605-a581-87865d26f131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:27:01.993046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:27:02.044339 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 752/1483] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:27:02.335714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbee9e-95dc-4373-a7ce-4fb7737451c3 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:27:02.338134 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-48cbee9e-95dc-4373-a7ce-4fb7737451c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:27:02.365837 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:27:02.462875 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbee9e-95dc-4373-a7ce-4fb7737451c3 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:27:02.554162 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1701641-6b9f-44b7-983f-6a931bb5abdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:27:02.554770 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1701641-6b9f-44b7-983f-6a931bb5abdb service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:27:02.555064 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1701641-6b9f-44b7-983f-6a931bb5abdb service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:27:02.555299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1701641-6b9f-44b7-983f-6a931bb5abdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:27:02.556939 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a1701641-6b9f-44b7-983f-6a931bb5abdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:27:02.632764 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:27:02.669866 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1701641-6b9f-44b7-983f-6a931bb5abdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:27:02.671355 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1701641-6b9f-44b7-983f-6a931bb5abdb service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:27:02.689404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 732/1484] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:27:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:27:04.888623 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0cdb9-509f-447d-9855-639f6935a6f8 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:27:04.889458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0cdb9-509f-447d-9855-639f6935a6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:27:04.889458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0cdb9-509f-447d-9855-639f6935a6f8 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:27:04.891602 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 753/1485] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:27:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:27:04.898077 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6adb4-c30d-4b3c-8474-1b2762e0c999 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:27:04.898506 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6adb4-c30d-4b3c-8474-1b2762e0c999 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:27:04.898625 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6adb4-c30d-4b3c-8474-1b2762e0c999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:27:04.979882 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-b8f6adb4-c30d-4b3c-8474-1b2762e0c999 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:27:04.981096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-b8f6adb4-c30d-4b3c-8474-1b2762e0c999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:27:05.083462 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 733/1486] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:27:05.373464 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0cdb9-509f-447d-9855-639f6935a6f8 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:27:05.375430 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-c2a0cdb9-509f-447d-9855-639f6935a6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:27:05.482512 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0cdb9-509f-447d-9855-639f6935a6f8 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:27:05.567184 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:27:05.568740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee0bec-ccc3-47e0-bdae-3367aef675a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:27:05.569374 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee0bec-ccc3-47e0-bdae-3367aef675a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:27:05.569676 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee0bec-ccc3-47e0-bdae-3367aef675a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:27:05.569924 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee0bec-ccc3-47e0-bdae-3367aef675a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:27:05.572694 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-36ee0bec-ccc3-47e0-bdae-3367aef675a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:27:05.692394 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee0bec-ccc3-47e0-bdae-3367aef675a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:27:05.693753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee0bec-ccc3-47e0-bdae-3367aef675a8 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:27:05.712354 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 754/1487] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:27:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:27:08.063039 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a47ac3-cbbe-43f3-ab72-0cda70b7e6d6 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:27:08.063614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a47ac3-cbbe-43f3-ab72-0cda70b7e6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:27:08.063614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a47ac3-cbbe-43f3-ab72-0cda70b7e6d6 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:27:08.065033 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 734/1488] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:27:08.070722 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4aa87-b787-4bb7-a70c-5e53eb3884c0 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:27:08.071194 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4aa87-b787-4bb7-a70c-5e53eb3884c0 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:27:08.071305 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4aa87-b787-4bb7-a70c-5e53eb3884c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:27:08.139794 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-eaf4aa87-b787-4bb7-a70c-5e53eb3884c0 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:27:08.141015 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-eaf4aa87-b787-4bb7-a70c-5e53eb3884c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:27:08.196205 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:27:08.241358 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 755/1489] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:27:08.532672 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a47ac3-cbbe-43f3-ab72-0cda70b7e6d6 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:27:08.534223 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-11a47ac3-cbbe-43f3-ab72-0cda70b7e6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:27:08.581899 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:27:08.659693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a47ac3-cbbe-43f3-ab72-0cda70b7e6d6 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:27:08.739010 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dc9a9-46ae-42b4-93f0-1009c68f6e5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:27:08.739614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dc9a9-46ae-42b4-93f0-1009c68f6e5b service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:27:08.739886 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dc9a9-46ae-42b4-93f0-1009c68f6e5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:27:08.740150 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dc9a9-46ae-42b4-93f0-1009c68f6e5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:27:08.741733 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-849dc9a9-46ae-42b4-93f0-1009c68f6e5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:27:08.822458 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:27:08.853443 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849dc9a9-46ae-42b4-93f0-1009c68f6e5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:27:08.854890 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849dc9a9-46ae-42b4-93f0-1009c68f6e5b service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:27:08.873645 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 735/1490] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:27:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:27:11.296814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13c717-f8cc-4d75-b88b-5459020c1a86 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:27:11.297646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13c717-f8cc-4d75-b88b-5459020c1a86 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:27:11.297646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13c717-f8cc-4d75-b88b-5459020c1a86 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:27:11.300196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 756/1491] 10.222.0.55 () {54 vars in 927 bytes} [Tue Oct 4 16:27:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:27:11.308270 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43604640-ba72-4852-98bd-3d6471c24e7c None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:27:11.308714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43604640-ba72-4852-98bd-3d6471c24e7c None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:27:11.308810 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43604640-ba72-4852-98bd-3d6471c24e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:27:11.376502 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-43604640-ba72-4852-98bd-3d6471c24e7c None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:27:11.377726 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-43604640-ba72-4852-98bd-3d6471c24e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:27:11.480474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 736/1492] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Oct 4 16:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:27:11.770353 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13c717-f8cc-4d75-b88b-5459020c1a86 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:27:11.771957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-6d13c717-f8cc-4d75-b88b-5459020c1a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:27:11.887711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13c717-f8cc-4d75-b88b-5459020c1a86 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:27:11.973238 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831d28d-918d-4e3e-b3f8-892673d0ad86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:27:11.973927 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831d28d-918d-4e3e-b3f8-892673d0ad86 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:27:11.974226 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831d28d-918d-4e3e-b3f8-892673d0ad86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:27:11.974668 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831d28d-918d-4e3e-b3f8-892673d0ad86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:27:11.976336 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-e831d28d-918d-4e3e-b3f8-892673d0ad86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:27:11.986146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:27:12.092268 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831d28d-918d-4e3e-b3f8-892673d0ad86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:27:12.093712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831d28d-918d-4e3e-b3f8-892673d0ad86 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:27:12.122354 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 757/1493] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:27:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:27:21.478828 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=82 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:27:22.117935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=50 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:28:25.465242 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b3c57-dba8-47f7-bb28-7c983407af0f None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:28:25.465828 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b3c57-dba8-47f7-bb28-7c983407af0f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:28:25.465828 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b3c57-dba8-47f7-bb28-7c983407af0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:28:25.544548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-d14b3c57-dba8-47f7-bb28-7c983407af0f None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:28:25.545752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-d14b3c57-dba8-47f7-bb28-7c983407af0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:28:25.656704 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 737/1494] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:28:25.664822 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756b1d8-11b1-4b42-8cd2-f80c34385969 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:28:25.665350 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756b1d8-11b1-4b42-8cd2-f80c34385969 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:28:25.665350 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756b1d8-11b1-4b42-8cd2-f80c34385969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:28:25.745154 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-3756b1d8-11b1-4b42-8cd2-f80c34385969 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:28:25.746324 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-3756b1d8-11b1-4b42-8cd2-f80c34385969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:28:25.846458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 758/1495] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:28:25.852705 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b3c57-dba8-47f7-bb28-7c983407af0f None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:28:25.853928 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-d14b3c57-dba8-47f7-bb28-7c983407af0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:28:25.865937 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b3c57-dba8-47f7-bb28-7c983407af0f None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:28:25.932760 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:28:25.975787 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0555d-cf05-4b86-8cee-57caea06f065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:28:25.976665 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0555d-cf05-4b86-8cee-57caea06f065 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:28:25.977046 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0555d-cf05-4b86-8cee-57caea06f065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:28:25.977391 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0555d-cf05-4b86-8cee-57caea06f065 admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:28:25.978390 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0555d-cf05-4b86-8cee-57caea06f065 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:28:25.978791 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0555d-cf05-4b86-8cee-57caea06f065 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:28:25.980333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: WARNING py.warnings [None req-b6a0555d-cf05-4b86-8cee-57caea06f065 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 16:28:25.980333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: warnings.warn(msg) Oct 04 16:28:25.980333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: Oct 04 16:28:25.981248 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0555d-cf05-4b86-8cee-57caea06f065 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:28:25.996097 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 738/1496] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:28:26.004942 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756b1d8-11b1-4b42-8cd2-f80c34385969 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:28:26.015381 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756b1d8-11b1-4b42-8cd2-f80c34385969 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:28:26.085177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:28:26.128882 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e780d2-6b24-4bd8-afcf-adcb3ed572f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:28:26.129497 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e780d2-6b24-4bd8-afcf-adcb3ed572f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:28:26.129769 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e780d2-6b24-4bd8-afcf-adcb3ed572f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:28:26.130037 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e780d2-6b24-4bd8-afcf-adcb3ed572f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:28:26.130669 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e780d2-6b24-4bd8-afcf-adcb3ed572f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:28:26.132461 dv-cinder-749155-14-smb devstack@keystone.service[81562]: WARNING py.warnings [None req-24e780d2-6b24-4bd8-afcf-adcb3ed572f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 16:28:26.132461 dv-cinder-749155-14-smb devstack@keystone.service[81562]: warnings.warn(msg) Oct 04 16:28:26.132461 dv-cinder-749155-14-smb devstack@keystone.service[81562]: Oct 04 16:28:26.133657 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e780d2-6b24-4bd8-afcf-adcb3ed572f9 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:28:26.199322 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 759/1497] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:28:26 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:28:26.203983 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0555d-cf05-4b86-8cee-57caea06f065 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:28:26.205488 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-b6a0555d-cf05-4b86-8cee-57caea06f065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:28:26.240607 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0555d-cf05-4b86-8cee-57caea06f065 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:28:26.342649 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae4aaa-b591-4304-b261-1554eb6a5779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:28:26.343429 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae4aaa-b591-4304-b261-1554eb6a5779 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:28:26.343814 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae4aaa-b591-4304-b261-1554eb6a5779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:28:26.344083 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae4aaa-b591-4304-b261-1554eb6a5779 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:28:26.344707 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae4aaa-b591-4304-b261-1554eb6a5779 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:28:26.345719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: WARNING py.warnings [None req-f9ae4aaa-b591-4304-b261-1554eb6a5779 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 16:28:26.345719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: warnings.warn(msg) Oct 04 16:28:26.345719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: Oct 04 16:28:26.346923 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae4aaa-b591-4304-b261-1554eb6a5779 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:28:26.392636 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 739/1498] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:28:26 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:28:26.397011 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e780d2-6b24-4bd8-afcf-adcb3ed572f9 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:28:26.398555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-24e780d2-6b24-4bd8-afcf-adcb3ed572f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:28:26.461619 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e780d2-6b24-4bd8-afcf-adcb3ed572f9 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:28:26.551018 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:28:26.562628 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01b663-8edd-4858-a6e7-4087cb5d8b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:28:26.563290 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01b663-8edd-4858-a6e7-4087cb5d8b68 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:28:26.563567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01b663-8edd-4858-a6e7-4087cb5d8b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:28:26.563841 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01b663-8edd-4858-a6e7-4087cb5d8b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:28:26.564480 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01b663-8edd-4858-a6e7-4087cb5d8b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:28:26.565533 dv-cinder-749155-14-smb devstack@keystone.service[81562]: WARNING py.warnings [None req-bd01b663-8edd-4858-a6e7-4087cb5d8b68 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 16:28:26.565533 dv-cinder-749155-14-smb devstack@keystone.service[81562]: warnings.warn(msg) Oct 04 16:28:26.565533 dv-cinder-749155-14-smb devstack@keystone.service[81562]: Oct 04 16:28:26.566423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01b663-8edd-4858-a6e7-4087cb5d8b68 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:28:26.579438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 760/1499] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:28:26.584177 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae4aaa-b591-4304-b261-1554eb6a5779 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:28:26.586135 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f9ae4aaa-b591-4304-b261-1554eb6a5779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:28:26.601340 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae4aaa-b591-4304-b261-1554eb6a5779 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:28:26.632346 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:28:26.709152 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bc73b-4345-43f7-8398-c0a0d0ee7b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:28:26.709767 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bc73b-4345-43f7-8398-c0a0d0ee7b3d admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:28:26.710045 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bc73b-4345-43f7-8398-c0a0d0ee7b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:28:26.710309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bc73b-4345-43f7-8398-c0a0d0ee7b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:28:26.710957 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8bc73b-4345-43f7-8398-c0a0d0ee7b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:28:26.712043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: WARNING py.warnings [None req-1e8bc73b-4345-43f7-8398-c0a0d0ee7b3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 16:28:26.712043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: warnings.warn(msg) Oct 04 16:28:26.712043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: Oct 04 16:28:26.712940 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8bc73b-4345-43f7-8398-c0a0d0ee7b3d admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:28:26.725953 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 740/1500] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:28:26.730419 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01b663-8edd-4858-a6e7-4087cb5d8b68 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:28:26.732003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-bd01b663-8edd-4858-a6e7-4087cb5d8b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:28:26.766722 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01b663-8edd-4858-a6e7-4087cb5d8b68 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:28:26.870114 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdd7f0-f4f8-46c0-9167-4d8be021f802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:28:26.870687 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdd7f0-f4f8-46c0-9167-4d8be021f802 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:28:26.870962 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdd7f0-f4f8-46c0-9167-4d8be021f802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:28:26.871226 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdd7f0-f4f8-46c0-9167-4d8be021f802 admin admin] PATH_INFO: `/v3/projects/21f5ca32842b46c2963faf02cb2e5a6c/users/9310277c4fd6413784972ff00200cb96/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:28:26.896503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fdd7f0-f4f8-46c0-9167-4d8be021f802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21f5ca32842b46c2963faf02cb2e5a6c, user_id=9310277c4fd6413784972ff00200cb96, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:28:26.897518 dv-cinder-749155-14-smb devstack@keystone.service[81562]: WARNING py.warnings [None req-a1fdd7f0-f4f8-46c0-9167-4d8be021f802 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 16:28:26.897518 dv-cinder-749155-14-smb devstack@keystone.service[81562]: warnings.warn(msg) Oct 04 16:28:26.897518 dv-cinder-749155-14-smb devstack@keystone.service[81562]: Oct 04 16:28:26.899535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fdd7f0-f4f8-46c0-9167-4d8be021f802 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:28:26.928877 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 761/1501] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:28:26 2022] PUT /identity/v3/projects/21f5ca32842b46c2963faf02cb2e5a6c/users/9310277c4fd6413784972ff00200cb96/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:28:26.942088 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8a09f-0ed4-4855-9c97-1b02d644f188 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:28:26.942690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8a09f-0ed4-4855-9c97-1b02d644f188 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:28:26.942944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8a09f-0ed4-4855-9c97-1b02d644f188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:28:27.004393 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-42e8a09f-0ed4-4855-9c97-1b02d644f188 None None] MFA Rules not processed for user `9310277c4fd6413784972ff00200cb96`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:28:27.005614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-42e8a09f-0ed4-4855-9c97-1b02d644f188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:28:27.085194 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 741/1502] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:28:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:28:27.099218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd4b48-1341-4864-a177-04365de01f06 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:28:27.099503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd4b48-1341-4864-a177-04365de01f06 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:28:27.099764 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd4b48-1341-4864-a177-04365de01f06 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:28:27.101109 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 762/1503] 10.222.0.55 () {54 vars in 963 bytes} [Tue Oct 4 16:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:28:27.106179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248bc95-71a3-4117-bbee-9639a87d09c1 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:28:27.106467 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248bc95-71a3-4117-bbee-9639a87d09c1 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:28:27.106742 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248bc95-71a3-4117-bbee-9639a87d09c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:28:27.138639 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:28:27.189626 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-4248bc95-71a3-4117-bbee-9639a87d09c1 None None] MFA Rules not processed for user `7d717575c1d8415fbd09d61d1cbef2d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:28:27.190919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-4248bc95-71a3-4117-bbee-9639a87d09c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:28:27.269589 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 742/1504] 10.222.0.55 () {58 vars in 1060 bytes} [Tue Oct 4 16:28:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:28:27.283864 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd4b48-1341-4864-a177-04365de01f06 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:28:27.285389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-a0dd4b48-1341-4864-a177-04365de01f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:28:27.337242 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:28:27.393630 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd4b48-1341-4864-a177-04365de01f06 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:28:27.469757 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84bdee-b165-4744-ad30-3bf54ad5b351 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:28:27.470370 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84bdee-b165-4744-ad30-3bf54ad5b351 service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:28:27.470639 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84bdee-b165-4744-ad30-3bf54ad5b351 service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:28:27.470906 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84bdee-b165-4744-ad30-3bf54ad5b351 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:28:27.472569 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-da84bdee-b165-4744-ad30-3bf54ad5b351 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:28:27.581052 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da84bdee-b165-4744-ad30-3bf54ad5b351 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:28:27.582539 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da84bdee-b165-4744-ad30-3bf54ad5b351 service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:28:27.586141 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:28:27.601910 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 763/1505] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:28:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:28:27.651710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57a4b2-2602-45bb-963d-1e2e10292e6b None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:28:27.652169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57a4b2-2602-45bb-963d-1e2e10292e6b None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:28:27.652285 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57a4b2-2602-45bb-963d-1e2e10292e6b None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:28:27.654432 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 743/1506] 10.222.0.55 () {52 vars in 830 bytes} [Tue Oct 4 16:28:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:28:27.658468 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84bdee-b165-4744-ad30-3bf54ad5b351 service cinder] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:28:27.659718 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-da84bdee-b165-4744-ad30-3bf54ad5b351 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:28:27.764780 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84bdee-b165-4744-ad30-3bf54ad5b351 service cinder] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:28:27.859348 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be875d98-a5c6-44dd-bc91-266aa7a90ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:28:27.859976 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be875d98-a5c6-44dd-bc91-266aa7a90ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:28:27.860253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be875d98-a5c6-44dd-bc91-266aa7a90ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:28:27.860514 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be875d98-a5c6-44dd-bc91-266aa7a90ace admin admin] PATH_INFO: `/v3/users/9310277c4fd6413784972ff00200cb96` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:28:27.873483 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be875d98-a5c6-44dd-bc91-266aa7a90ace admin admin] RBAC: Authorizing `identity:delete_user(user_id=9310277c4fd6413784972ff00200cb96)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:28:27.874559 dv-cinder-749155-14-smb devstack@keystone.service[81562]: WARNING py.warnings [None req-be875d98-a5c6-44dd-bc91-266aa7a90ace admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 16:28:27.874559 dv-cinder-749155-14-smb devstack@keystone.service[81562]: warnings.warn(msg) Oct 04 16:28:27.874559 dv-cinder-749155-14-smb devstack@keystone.service[81562]: Oct 04 16:28:27.875936 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be875d98-a5c6-44dd-bc91-266aa7a90ace admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:28:27.886492 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:28:27.946469 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-be875d98-a5c6-44dd-bc91-266aa7a90ace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9310277c4fd6413784972ff00200cb96'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:28:27.946935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-be875d98-a5c6-44dd-bc91-266aa7a90ace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9310277c4fd6413784972ff00200cb96'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:28:27.961711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-be875d98-a5c6-44dd-bc91-266aa7a90ace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9310277c4fd6413784972ff00200cb96'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:28:27.974225 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-be875d98-a5c6-44dd-bc91-266aa7a90ace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9310277c4fd6413784972ff00200cb96'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:28:27.974662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-be875d98-a5c6-44dd-bc91-266aa7a90ace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9310277c4fd6413784972ff00200cb96'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:28:28.005015 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 764/1507] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:28:27 2022] DELETE /identity/v3/users/9310277c4fd6413784972ff00200cb96 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:28:28.010358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282134d2-b1a4-4098-9d2b-1b973a164e1f None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:28:28.010815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282134d2-b1a4-4098-9d2b-1b973a164e1f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:28:28.011290 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282134d2-b1a4-4098-9d2b-1b973a164e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:28:28.076746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-282134d2-b1a4-4098-9d2b-1b973a164e1f None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:28:28.077975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-282134d2-b1a4-4098-9d2b-1b973a164e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:28:28.166789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:28:28.180962 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 744/1508] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:28:28.193540 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be875d98-a5c6-44dd-bc91-266aa7a90ace admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:28:28.194777 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-be875d98-a5c6-44dd-bc91-266aa7a90ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:28:28.306493 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be875d98-a5c6-44dd-bc91-266aa7a90ace admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:28:28.367293 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:28:28.387326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab7e56-d4f9-4ff7-ad95-d0c10a09fd31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:28:28.387953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab7e56-d4f9-4ff7-ad95-d0c10a09fd31 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:28:28.388229 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab7e56-d4f9-4ff7-ad95-d0c10a09fd31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:28:28.388500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab7e56-d4f9-4ff7-ad95-d0c10a09fd31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:28:28.390254 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-13ab7e56-d4f9-4ff7-ad95-d0c10a09fd31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:28:28.504218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab7e56-d4f9-4ff7-ad95-d0c10a09fd31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:28:28.505666 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab7e56-d4f9-4ff7-ad95-d0c10a09fd31 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:28:28.523645 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 765/1509] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:28:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:28:28.869965 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282134d2-b1a4-4098-9d2b-1b973a164e1f None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:28:28.871256 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-282134d2-b1a4-4098-9d2b-1b973a164e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:28:28.882830 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282134d2-b1a4-4098-9d2b-1b973a164e1f None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:28:28.993970 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93568b29-0556-4ad1-baae-77b123005756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:28:28.994615 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93568b29-0556-4ad1-baae-77b123005756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:28:28.994893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93568b29-0556-4ad1-baae-77b123005756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:28:28.995200 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93568b29-0556-4ad1-baae-77b123005756 admin admin] PATH_INFO: `/v3/projects/21f5ca32842b46c2963faf02cb2e5a6c` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:28:29.006520 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93568b29-0556-4ad1-baae-77b123005756 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21f5ca32842b46c2963faf02cb2e5a6c)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:28:29.007609 dv-cinder-749155-14-smb devstack@keystone.service[81561]: WARNING py.warnings [None req-93568b29-0556-4ad1-baae-77b123005756 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 16:28:29.007609 dv-cinder-749155-14-smb devstack@keystone.service[81561]: warnings.warn(msg) Oct 04 16:28:29.007609 dv-cinder-749155-14-smb devstack@keystone.service[81561]: Oct 04 16:28:29.008833 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93568b29-0556-4ad1-baae-77b123005756 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:28:29.082072 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-93568b29-0556-4ad1-baae-77b123005756 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21f5ca32842b46c2963faf02cb2e5a6c', 'request_id': 'req-93568b29-0556-4ad1-baae-77b123005756'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:28:29.093836 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-93568b29-0556-4ad1-baae-77b123005756 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21f5ca32842b46c2963faf02cb2e5a6c', 'request_id': 'req-93568b29-0556-4ad1-baae-77b123005756'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:28:29.107735 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-93568b29-0556-4ad1-baae-77b123005756 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21f5ca32842b46c2963faf02cb2e5a6c', 'request_id': 'req-93568b29-0556-4ad1-baae-77b123005756'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:28:29.132669 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-93568b29-0556-4ad1-baae-77b123005756 admin admin] The token cache is being invalidate because project 21f5ca32842b46c2963faf02cb2e5a6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:28:29.132880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-93568b29-0556-4ad1-baae-77b123005756 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:28:29.133395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-93568b29-0556-4ad1-baae-77b123005756 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:28:29.134770 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 745/1510] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:28:28 2022] DELETE /identity/v3/projects/21f5ca32842b46c2963faf02cb2e5a6c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:28:38.521372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=62 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:28:39.129979 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:30:03.770387 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579ba10-5ae3-4ce9-96b5-062a6bb70512 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:03.771280 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579ba10-5ae3-4ce9-96b5-062a6bb70512 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:03.771280 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579ba10-5ae3-4ce9-96b5-062a6bb70512 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:03.773521 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 766/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 16:30:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:30:03.781426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295618b-b89d-4395-9070-0cc20fe2f519 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:03.781906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295618b-b89d-4395-9070-0cc20fe2f519 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:03.781906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295618b-b89d-4395-9070-0cc20fe2f519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:03.879752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-d295618b-b89d-4395-9070-0cc20fe2f519 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:30:03.881181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-d295618b-b89d-4395-9070-0cc20fe2f519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:30:03.996612 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 746/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 16:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:30:04.151692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579ba10-5ae3-4ce9-96b5-062a6bb70512 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:30:04.154022 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b579ba10-5ae3-4ce9-96b5-062a6bb70512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:30:04.277576 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579ba10-5ae3-4ce9-96b5-062a6bb70512 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:30:04.283803 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8f3df-cfc0-4fa8-a28a-aa8d5b2c4a8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:30:04.284409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8f3df-cfc0-4fa8-a28a-aa8d5b2c4a8a service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:04.284683 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8f3df-cfc0-4fa8-a28a-aa8d5b2c4a8a service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:04.284961 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8f3df-cfc0-4fa8-a28a-aa8d5b2c4a8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:04.295426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8f3df-cfc0-4fa8-a28a-aa8d5b2c4a8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:30:04.297140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8f3df-cfc0-4fa8-a28a-aa8d5b2c4a8a service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:30:04.307060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 767/1513] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:30:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:30:05.262565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652e211-0e5d-4d08-8e9e-e113a6570d46 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:05.263028 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652e211-0e5d-4d08-8e9e-e113a6570d46 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:05.263221 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652e211-0e5d-4d08-8e9e-e113a6570d46 None None] PATH_INFO: `/v3` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:05.264579 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 747/1514] 10.222.0.42 () {54 vars in 925 bytes} [Tue Oct 4 16:30:05 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:30:05.271518 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332398bd-b788-4433-9a81-408e67fa3105 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:05.271936 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332398bd-b788-4433-9a81-408e67fa3105 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:05.272091 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332398bd-b788-4433-9a81-408e67fa3105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:05.344313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-332398bd-b788-4433-9a81-408e67fa3105 None None] MFA Rules not processed for user `8cd59eac06e347ee9432185b24fdf773`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:30:05.345538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-332398bd-b788-4433-9a81-408e67fa3105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:30:05.416660 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:30:05.419707 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f38084-2d98-4e22-8717-0c34c722cd64 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:05.420015 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f38084-2d98-4e22-8717-0c34c722cd64 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:05.420294 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f38084-2d98-4e22-8717-0c34c722cd64 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:05.421681 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 748/1515] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 16:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:30:05.422916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 768/1516] 10.222.0.42 () {58 vars in 1015 bytes} [Tue Oct 4 16:30:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:30:05.428076 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49de3bf-5a78-44dc-aa14-5fa9c8aae181 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:05.428349 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49de3bf-5a78-44dc-aa14-5fa9c8aae181 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:05.428656 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49de3bf-5a78-44dc-aa14-5fa9c8aae181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:05.449398 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-c49de3bf-5a78-44dc-aa14-5fa9c8aae181 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:30:05.450616 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c49de3bf-5a78-44dc-aa14-5fa9c8aae181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:30:05.459337 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 749/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 16:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:30:05.610553 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332398bd-b788-4433-9a81-408e67fa3105 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:30:05.625108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332398bd-b788-4433-9a81-408e67fa3105 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:30:05.631516 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92492d-13ec-4dc9-ada4-2af5ffbfedc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:30:05.632124 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92492d-13ec-4dc9-ada4-2af5ffbfedc2 service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:05.632399 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92492d-13ec-4dc9-ada4-2af5ffbfedc2 service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:05.632666 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92492d-13ec-4dc9-ada4-2af5ffbfedc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:05.641743 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92492d-13ec-4dc9-ada4-2af5ffbfedc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:30:05.643382 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92492d-13ec-4dc9-ada4-2af5ffbfedc2 service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:30:05.653728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 769/1518] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:30:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:30:14.053382 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b93db8-b303-4c94-9ce3-80087b76dfcb None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:14.053850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b93db8-b303-4c94-9ce3-80087b76dfcb None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:14.054024 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b93db8-b303-4c94-9ce3-80087b76dfcb None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:14.056354 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 750/1519] 10.222.0.55 () {54 vars in 961 bytes} [Tue Oct 4 16:30:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:30:14.061641 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ef453-6152-49b2-963d-de8c7771d610 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:14.062077 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ef453-6152-49b2-963d-de8c7771d610 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:14.062313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ef453-6152-49b2-963d-de8c7771d610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:14.082526 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-292ef453-6152-49b2-963d-de8c7771d610 None None] MFA Rules not processed for user `8cd59eac06e347ee9432185b24fdf773`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:30:14.083780 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-292ef453-6152-49b2-963d-de8c7771d610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:30:14.093528 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 770/1520] 10.222.0.55 () {58 vars in 1058 bytes} [Tue Oct 4 16:30:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:30:14.102384 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b93db8-b303-4c94-9ce3-80087b76dfcb None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:30:14.117191 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b93db8-b303-4c94-9ce3-80087b76dfcb None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:30:14.122060 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa56682-3f6f-490a-abdf-6d5aa13a3a60 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd59eac06e347ee9432185b24fdf773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:30:14.122659 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa56682-3f6f-490a-abdf-6d5aa13a3a60 service placement] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:14.122966 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa56682-3f6f-490a-abdf-6d5aa13a3a60 service placement] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:14.123267 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa56682-3f6f-490a-abdf-6d5aa13a3a60 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:14.131683 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa56682-3f6f-490a-abdf-6d5aa13a3a60 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:30:14.133279 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa56682-3f6f-490a-abdf-6d5aa13a3a60 service placement] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:30:14.142901 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 751/1521] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:30:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:30:17.180925 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43fbb6-b157-49b6-bc21-ef353bbf31d2 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:17.181503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43fbb6-b157-49b6-bc21-ef353bbf31d2 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:17.181503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43fbb6-b157-49b6-bc21-ef353bbf31d2 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:17.183385 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 771/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 16:30:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:30:17.192635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916dd31d-5fc4-4d9e-a4a2-ee65aeebd560 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:17.193204 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916dd31d-5fc4-4d9e-a4a2-ee65aeebd560 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:17.193204 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916dd31d-5fc4-4d9e-a4a2-ee65aeebd560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:17.216889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-916dd31d-5fc4-4d9e-a4a2-ee65aeebd560 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:30:17.218120 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-916dd31d-5fc4-4d9e-a4a2-ee65aeebd560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:30:17.227083 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 752/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 16:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:30:17.390679 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43fbb6-b157-49b6-bc21-ef353bbf31d2 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:30:17.409749 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43fbb6-b157-49b6-bc21-ef353bbf31d2 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:30:17.415836 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25caa69-b960-47f0-afb9-d930aff65873 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:30:17.416444 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25caa69-b960-47f0-afb9-d930aff65873 service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:17.416725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25caa69-b960-47f0-afb9-d930aff65873 service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:17.417005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25caa69-b960-47f0-afb9-d930aff65873 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:17.425758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25caa69-b960-47f0-afb9-d930aff65873 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:30:17.427399 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25caa69-b960-47f0-afb9-d930aff65873 service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:30:17.439655 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 772/1524] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:30:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:30:18.535845 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b30117-604f-49ed-8bb9-44600e540bdb None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:18.536400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b30117-604f-49ed-8bb9-44600e540bdb None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:18.536400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b30117-604f-49ed-8bb9-44600e540bdb None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:18.537922 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 753/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 16:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:30:18.544759 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba7658-68b5-4f9e-9d86-03ab7230f133 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:18.545263 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba7658-68b5-4f9e-9d86-03ab7230f133 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:18.545263 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba7658-68b5-4f9e-9d86-03ab7230f133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:18.565469 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-f3ba7658-68b5-4f9e-9d86-03ab7230f133 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:30:18.566731 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-f3ba7658-68b5-4f9e-9d86-03ab7230f133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:30:18.581704 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 773/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 16:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:30:18.798844 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b30117-604f-49ed-8bb9-44600e540bdb None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:30:18.815288 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b30117-604f-49ed-8bb9-44600e540bdb None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:30:18.823096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026adf0-13fb-4f82-87df-692faf0c0f23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:30:18.823763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026adf0-13fb-4f82-87df-692faf0c0f23 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:18.824028 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026adf0-13fb-4f82-87df-692faf0c0f23 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:18.824285 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026adf0-13fb-4f82-87df-692faf0c0f23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:18.833448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026adf0-13fb-4f82-87df-692faf0c0f23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:30:18.835113 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026adf0-13fb-4f82-87df-692faf0c0f23 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:30:18.844858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 754/1527] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:30:22.951904 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270fbb1-eaa0-4f92-9f5a-6eb065a354e3 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:22.952426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270fbb1-eaa0-4f92-9f5a-6eb065a354e3 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:22.952426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270fbb1-eaa0-4f92-9f5a-6eb065a354e3 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:22.954394 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 774/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 16:30:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:30:22.960632 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0229b-2f84-473d-9d6a-8992cbeab559 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:22.961051 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0229b-2f84-473d-9d6a-8992cbeab559 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:22.961157 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0229b-2f84-473d-9d6a-8992cbeab559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:22.983816 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-fef0229b-2f84-473d-9d6a-8992cbeab559 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:30:22.985018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-fef0229b-2f84-473d-9d6a-8992cbeab559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:30:22.994188 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 755/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:30:23.285872 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270fbb1-eaa0-4f92-9f5a-6eb065a354e3 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:30:23.287878 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8270fbb1-eaa0-4f92-9f5a-6eb065a354e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:30:23.370810 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270fbb1-eaa0-4f92-9f5a-6eb065a354e3 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:30:23.375426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0997e-d420-4bd9-8c7b-8fe81e2909bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:30:23.376046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0997e-d420-4bd9-8c7b-8fe81e2909bd service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:23.376321 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0997e-d420-4bd9-8c7b-8fe81e2909bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:23.376585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0997e-d420-4bd9-8c7b-8fe81e2909bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:23.386021 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0997e-d420-4bd9-8c7b-8fe81e2909bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:30:23.387517 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0997e-d420-4bd9-8c7b-8fe81e2909bd service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:30:23.397215 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 775/1530] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:30:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:30:25.547341 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38fa91-7c63-4c3a-b6be-944f09230ac7 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:25.548313 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38fa91-7c63-4c3a-b6be-944f09230ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:25.548313 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38fa91-7c63-4c3a-b6be-944f09230ac7 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:25.550428 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 756/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 16:30:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:30:25.559440 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52c7fc-6cab-4e58-b0a2-bcd53de1d4f7 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:25.560145 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52c7fc-6cab-4e58-b0a2-bcd53de1d4f7 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:25.560427 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52c7fc-6cab-4e58-b0a2-bcd53de1d4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:25.584884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-7c52c7fc-6cab-4e58-b0a2-bcd53de1d4f7 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:30:25.586098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-7c52c7fc-6cab-4e58-b0a2-bcd53de1d4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:30:25.595654 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 776/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 16:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:30:25.891042 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38fa91-7c63-4c3a-b6be-944f09230ac7 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:30:25.894154 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ce38fa91-7c63-4c3a-b6be-944f09230ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:30:25.910116 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38fa91-7c63-4c3a-b6be-944f09230ac7 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:30:25.913955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ee4aa-32c0-4b3e-b3f2-638b316bbca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:30:25.914586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ee4aa-32c0-4b3e-b3f2-638b316bbca3 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:25.914837 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ee4aa-32c0-4b3e-b3f2-638b316bbca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:25.915133 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ee4aa-32c0-4b3e-b3f2-638b316bbca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:25.924603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ee4aa-32c0-4b3e-b3f2-638b316bbca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:30:25.926061 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ee4aa-32c0-4b3e-b3f2-638b316bbca3 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:30:25.935743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 757/1533] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:30:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:30:29.850622 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987da7e-6563-4ae7-a4df-9f1bd4e99265 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:29.851305 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987da7e-6563-4ae7-a4df-9f1bd4e99265 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:29.851305 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987da7e-6563-4ae7-a4df-9f1bd4e99265 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:29.852581 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 777/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 16:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:30:29.858193 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a968d-fe26-4c09-9e91-e6c194f075fd None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:29.858677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a968d-fe26-4c09-9e91-e6c194f075fd None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:29.858677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a968d-fe26-4c09-9e91-e6c194f075fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:29.867956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:30:29.881715 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-bb0a968d-fe26-4c09-9e91-e6c194f075fd None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:30:29.882926 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-bb0a968d-fe26-4c09-9e91-e6c194f075fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:30:29.892284 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 758/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 16:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:30:30.190305 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987da7e-6563-4ae7-a4df-9f1bd4e99265 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:30:30.192153 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8987da7e-6563-4ae7-a4df-9f1bd4e99265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:30:30.273709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987da7e-6563-4ae7-a4df-9f1bd4e99265 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:30:30.277964 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc48e44-23df-43a8-9bd1-d2000264dbe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:30:30.278700 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc48e44-23df-43a8-9bd1-d2000264dbe6 service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:30.278900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc48e44-23df-43a8-9bd1-d2000264dbe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:30.279179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc48e44-23df-43a8-9bd1-d2000264dbe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:30.288883 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc48e44-23df-43a8-9bd1-d2000264dbe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:30:30.290325 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc48e44-23df-43a8-9bd1-d2000264dbe6 service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:30:30.300242 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 778/1536] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:30:32.458795 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf134c15-6071-4bb1-8fcc-34f5d91ba629 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:32.459446 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf134c15-6071-4bb1-8fcc-34f5d91ba629 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:32.459446 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf134c15-6071-4bb1-8fcc-34f5d91ba629 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:32.460817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 759/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 16:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:30:32.466183 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b882b-6203-447c-af69-d48f3de6e896 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:32.466628 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b882b-6203-447c-af69-d48f3de6e896 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:32.466732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b882b-6203-447c-af69-d48f3de6e896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:32.487075 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-3f4b882b-6203-447c-af69-d48f3de6e896 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:30:32.488290 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-3f4b882b-6203-447c-af69-d48f3de6e896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:30:32.496816 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 779/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 16:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:30:32.796189 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf134c15-6071-4bb1-8fcc-34f5d91ba629 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:30:32.797976 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-cf134c15-6071-4bb1-8fcc-34f5d91ba629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:30:32.811824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf134c15-6071-4bb1-8fcc-34f5d91ba629 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:30:32.815414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d62baa-49bd-45c0-8524-64a83c510ec5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:30:32.816021 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d62baa-49bd-45c0-8524-64a83c510ec5 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:30:32.816288 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d62baa-49bd-45c0-8524-64a83c510ec5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:30:32.816575 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d62baa-49bd-45c0-8524-64a83c510ec5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:30:32.826134 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d62baa-49bd-45c0-8524-64a83c510ec5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:30:32.827645 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d62baa-49bd-45c0-8524-64a83c510ec5 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:30:32.839677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 760/1539] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:30:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:30:42.482148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=95 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:30:42.835348 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=8 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:31:59.288564 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e8a6f-0e01-492c-9f45-e54bf59712f2 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:31:59.289237 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e8a6f-0e01-492c-9f45-e54bf59712f2 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:31:59.289237 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e8a6f-0e01-492c-9f45-e54bf59712f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:31:59.318523 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-c55e8a6f-0e01-492c-9f45-e54bf59712f2 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:31:59.319812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-c55e8a6f-0e01-492c-9f45-e54bf59712f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:31:59.330834 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 780/1540] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:31:59.340947 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4223c-8115-42ce-86e1-ec2abd95c71c None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:31:59.341595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4223c-8115-42ce-86e1-ec2abd95c71c None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:31:59.341595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4223c-8115-42ce-86e1-ec2abd95c71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:31:59.374414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-4eb4223c-8115-42ce-86e1-ec2abd95c71c None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:31:59.375807 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-4eb4223c-8115-42ce-86e1-ec2abd95c71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:31:59.381476 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb067a-bfe8-4693-82c2-c1dd05b750a6 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:31:59.381735 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb067a-bfe8-4693-82c2-c1dd05b750a6 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:31:59.382020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb067a-bfe8-4693-82c2-c1dd05b750a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:31:59.393681 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 761/1541] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:31:59.412140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-ffeb067a-bfe8-4693-82c2-c1dd05b750a6 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:31:59.413385 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ffeb067a-bfe8-4693-82c2-c1dd05b750a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:31:59.421023 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4223c-8115-42ce-86e1-ec2abd95c71c None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:31:59.426718 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 781/1542] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:31:59.436725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c75b7-cf31-497b-a22f-c53b60ddfc19 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:31:59.437093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c75b7-cf31-497b-a22f-c53b60ddfc19 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:31:59.437282 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c75b7-cf31-497b-a22f-c53b60ddfc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:31:59.441671 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4223c-8115-42ce-86e1-ec2abd95c71c None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:31:59.457382 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca03aba-3b1c-4c96-829f-710c420d6f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:31:59.458022 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca03aba-3b1c-4c96-829f-710c420d6f45 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:31:59.458319 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca03aba-3b1c-4c96-829f-710c420d6f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:31:59.458545 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca03aba-3b1c-4c96-829f-710c420d6f45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:31:59.459233 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca03aba-3b1c-4c96-829f-710c420d6f45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:31:59.459533 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca03aba-3b1c-4c96-829f-710c420d6f45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:31:59.461164 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca03aba-3b1c-4c96-829f-710c420d6f45 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:31:59.479892 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-8b6c75b7-cf31-497b-a22f-c53b60ddfc19 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:31:59.481123 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8b6c75b7-cf31-497b-a22f-c53b60ddfc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:31:59.495158 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 762/1543] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:31:59.499483 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 782/1544] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:31:59.503928 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca03aba-3b1c-4c96-829f-710c420d6f45 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:31:59.510674 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2bf9d-4b76-40fd-9d9e-9c2ff5a35c7e None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:31:59.511021 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2bf9d-4b76-40fd-9d9e-9c2ff5a35c7e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:31:59.511307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2bf9d-4b76-40fd-9d9e-9c2ff5a35c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:31:59.520014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca03aba-3b1c-4c96-829f-710c420d6f45 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:31:59.532715 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d0187-85b6-49b5-b833-f28b656557cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:31:59.533345 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d0187-85b6-49b5-b833-f28b656557cf admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:31:59.534673 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d0187-85b6-49b5-b833-f28b656557cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:31:59.534952 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d0187-85b6-49b5-b833-f28b656557cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:31:59.535633 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d0187-85b6-49b5-b833-f28b656557cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:31:59.535936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d0187-85b6-49b5-b833-f28b656557cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:31:59.541390 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d0187-85b6-49b5-b833-f28b656557cf admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:31:59.554747 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-78d2bf9d-4b76-40fd-9d9e-9c2ff5a35c7e None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:31:59.556143 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-78d2bf9d-4b76-40fd-9d9e-9c2ff5a35c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:31:59.567531 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 763/1545] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:31:59.570169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d0187-85b6-49b5-b833-f28b656557cf admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:31:59.573089 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 783/1546] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:31:59.583950 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2bf9d-4b76-40fd-9d9e-9c2ff5a35c7e None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:31:59.585507 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d0187-85b6-49b5-b833-f28b656557cf admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:31:59.595951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31ad5a-7ee5-407e-ac0d-eee5c164aeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:31:59.596912 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31ad5a-7ee5-407e-ac0d-eee5c164aeee admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:31:59.597436 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31ad5a-7ee5-407e-ac0d-eee5c164aeee admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:31:59.597929 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31ad5a-7ee5-407e-ac0d-eee5c164aeee admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:31:59.598782 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31ad5a-7ee5-407e-ac0d-eee5c164aeee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:31:59.600073 dv-cinder-749155-14-smb devstack@keystone.service[81561]: WARNING py.warnings [None req-9d31ad5a-7ee5-407e-ac0d-eee5c164aeee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 16:31:59.600073 dv-cinder-749155-14-smb devstack@keystone.service[81561]: warnings.warn(msg) Oct 04 16:31:59.600073 dv-cinder-749155-14-smb devstack@keystone.service[81561]: Oct 04 16:31:59.600717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2bf9d-4b76-40fd-9d9e-9c2ff5a35c7e None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:31:59.602095 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31ad5a-7ee5-407e-ac0d-eee5c164aeee admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:31:59.610692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8467313-049e-402b-b1d4-00bfa8f63919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:31:59.610692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8467313-049e-402b-b1d4-00bfa8f63919 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:31:59.610692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8467313-049e-402b-b1d4-00bfa8f63919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:31:59.610692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8467313-049e-402b-b1d4-00bfa8f63919 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:31:59.611139 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8467313-049e-402b-b1d4-00bfa8f63919 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:31:59.611139 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8467313-049e-402b-b1d4-00bfa8f63919 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:31:59.682704 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 764/1547] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:31:59 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:31:59.684677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2a84f-3af5-46ba-ad9a-f36038bad28a None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:31:59.685015 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2a84f-3af5-46ba-ad9a-f36038bad28a None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:31:59.685145 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 784/1548] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:31:59 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:31:59.685555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2a84f-3af5-46ba-ad9a-f36038bad28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:31:59.686674 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a481b0-b1fe-45c1-8ecd-7bcd07e17904 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:31:59.686960 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a481b0-b1fe-45c1-8ecd-7bcd07e17904 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:31:59.687266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a481b0-b1fe-45c1-8ecd-7bcd07e17904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:31:59.709704 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-64f2a84f-3af5-46ba-ad9a-f36038bad28a None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:31:59.711304 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-64f2a84f-3af5-46ba-ad9a-f36038bad28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:31:59.714696 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-e9a481b0-b1fe-45c1-8ecd-7bcd07e17904 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:31:59.715963 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-e9a481b0-b1fe-45c1-8ecd-7bcd07e17904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:31:59.782947 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 765/1549] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:31:59.784389 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faccc9e-521a-4e22-9f7b-37f9b62b903e None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:31:59.784679 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faccc9e-521a-4e22-9f7b-37f9b62b903e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:31:59.784949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faccc9e-521a-4e22-9f7b-37f9b62b903e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:31:59.786178 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 785/1550] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:31:59.787801 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9323d4-9ba2-451c-bb9d-df39a248c782 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:31:59.788088 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9323d4-9ba2-451c-bb9d-df39a248c782 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:31:59.788360 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9323d4-9ba2-451c-bb9d-df39a248c782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:31:59.804607 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-2faccc9e-521a-4e22-9f7b-37f9b62b903e None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:31:59.805818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-2faccc9e-521a-4e22-9f7b-37f9b62b903e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:31:59.809226 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-fd9323d4-9ba2-451c-bb9d-df39a248c782 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:31:59.810397 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-fd9323d4-9ba2-451c-bb9d-df39a248c782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:31:59.813801 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 766/1551] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:31:59.815242 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faccc9e-521a-4e22-9f7b-37f9b62b903e None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:31:59.825473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 786/1552] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:31:59.825473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9323d4-9ba2-451c-bb9d-df39a248c782 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:31:59.825802 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faccc9e-521a-4e22-9f7b-37f9b62b903e None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:31:59.830587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfaa757-553d-4d13-aafe-97bf7c7da919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:31:59.831435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaa757-553d-4d13-aafe-97bf7c7da919 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:31:59.831712 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaa757-553d-4d13-aafe-97bf7c7da919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:31:59.831978 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaa757-553d-4d13-aafe-97bf7c7da919 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:31:59.833183 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfaa757-553d-4d13-aafe-97bf7c7da919 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:31:59.835210 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfaa757-553d-4d13-aafe-97bf7c7da919 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:31:59.836126 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9323d4-9ba2-451c-bb9d-df39a248c782 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:31:59.841017 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a701d-90a9-45eb-bae2-0c5c7c6bacf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:31:59.841513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a701d-90a9-45eb-bae2-0c5c7c6bacf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:31:59.841792 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a701d-90a9-45eb-bae2-0c5c7c6bacf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:31:59.842057 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a701d-90a9-45eb-bae2-0c5c7c6bacf0 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:31:59.842718 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a701d-90a9-45eb-bae2-0c5c7c6bacf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:31:59.843972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: WARNING py.warnings [None req-5e0a701d-90a9-45eb-bae2-0c5c7c6bacf0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 16:31:59.843972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: warnings.warn(msg) Oct 04 16:31:59.843972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: Oct 04 16:31:59.846298 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a701d-90a9-45eb-bae2-0c5c7c6bacf0 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:31:59.862342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 767/1553] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:31:59 2022] POST /identity/v3/users => generated 287 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:31:59.863774 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45887e-b1f7-4be1-b32c-e996a2773637 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:31:59.864086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45887e-b1f7-4be1-b32c-e996a2773637 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:31:59.864366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45887e-b1f7-4be1-b32c-e996a2773637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:31:59.870084 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 787/1554] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:31:59 2022] POST /identity/v3/users => generated 290 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:31:59.871411 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33d8c4-c756-4ef6-9274-0f5d33550b94 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:31:59.871689 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33d8c4-c756-4ef6-9274-0f5d33550b94 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:31:59.871982 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33d8c4-c756-4ef6-9274-0f5d33550b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:31:59.888835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-ac45887e-b1f7-4be1-b32c-e996a2773637 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:31:59.890076 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ac45887e-b1f7-4be1-b32c-e996a2773637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:31:59.891837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-0b33d8c4-c756-4ef6-9274-0f5d33550b94 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:31:59.893003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-0b33d8c4-c756-4ef6-9274-0f5d33550b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:31:59.898297 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 768/1555] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:31:59.899204 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45887e-b1f7-4be1-b32c-e996a2773637 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:31:59.908783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 788/1556] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:31:59.908783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c4a0c-8743-45ba-8561-76d2e64d9bf3 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:31:59.908783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c4a0c-8743-45ba-8561-76d2e64d9bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:31:59.908783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c4a0c-8743-45ba-8561-76d2e64d9bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:31:59.909257 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45887e-b1f7-4be1-b32c-e996a2773637 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:31:59.913775 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ebc54-fd4b-43ce-b10d-94599beb4573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:31:59.914382 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ebc54-fd4b-43ce-b10d-94599beb4573 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:31:59.914655 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ebc54-fd4b-43ce-b10d-94599beb4573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:31:59.914920 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ebc54-fd4b-43ce-b10d-94599beb4573 admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:31:59.915607 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ebc54-fd4b-43ce-b10d-94599beb4573 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:31:59.915905 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ebc54-fd4b-43ce-b10d-94599beb4573 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:31:59.917600 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ebc54-fd4b-43ce-b10d-94599beb4573 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:31:59.927312 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-d96c4a0c-8743-45ba-8561-76d2e64d9bf3 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:31:59.928506 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-d96c4a0c-8743-45ba-8561-76d2e64d9bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:31:59.929596 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 769/1557] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:31:59.930913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc67762-4bc8-4575-86aa-998d85353202 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:31:59.931238 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc67762-4bc8-4575-86aa-998d85353202 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:31:59.931508 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc67762-4bc8-4575-86aa-998d85353202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:31:59.941788 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 789/1558] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:31:59.943444 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eb376-3778-41a6-99b7-564bfc5e77ff None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:31:59.943731 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eb376-3778-41a6-99b7-564bfc5e77ff None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:31:59.944007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eb376-3778-41a6-99b7-564bfc5e77ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:31:59.955803 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-3cc67762-4bc8-4575-86aa-998d85353202 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:31:59.956999 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-3cc67762-4bc8-4575-86aa-998d85353202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:31:59.963403 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-fd6eb376-3778-41a6-99b7-564bfc5e77ff None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:31:59.964616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-fd6eb376-3778-41a6-99b7-564bfc5e77ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:31:59.965034 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 770/1559] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:31:59.965814 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc67762-4bc8-4575-86aa-998d85353202 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:31:59.976244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 790/1560] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:31:59.976244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6eb376-3778-41a6-99b7-564bfc5e77ff None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:31:59.978051 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc67762-4bc8-4575-86aa-998d85353202 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:31:59.982741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87877ec6-5267-49b4-8e6d-d3f9db36d49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:31:59.983365 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87877ec6-5267-49b4-8e6d-d3f9db36d49c admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:31:59.983635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87877ec6-5267-49b4-8e6d-d3f9db36d49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:31:59.983896 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87877ec6-5267-49b4-8e6d-d3f9db36d49c admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:31:59.984464 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6eb376-3778-41a6-99b7-564bfc5e77ff None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:31:59.984586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87877ec6-5267-49b4-8e6d-d3f9db36d49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:31:59.986123 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87877ec6-5267-49b4-8e6d-d3f9db36d49c admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:31:59.990214 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99eb18-4056-4114-bb1b-82afaae7d0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:31:59.990828 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99eb18-4056-4114-bb1b-82afaae7d0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:31:59.991141 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99eb18-4056-4114-bb1b-82afaae7d0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:31:59.991412 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99eb18-4056-4114-bb1b-82afaae7d0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:31:59.992046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99eb18-4056-4114-bb1b-82afaae7d0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:31:59.993630 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99eb18-4056-4114-bb1b-82afaae7d0e9 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:31:59.996331 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 771/1561] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:31:59.997493 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef047f57-2a73-4ad1-a4e1-719d27fac812 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:31:59.997774 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef047f57-2a73-4ad1-a4e1-719d27fac812 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:31:59.998044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef047f57-2a73-4ad1-a4e1-719d27fac812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.004738 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 791/1562] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:00.005945 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad40f1-f072-4635-876c-f094d47b2b11 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.006234 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad40f1-f072-4635-876c-f094d47b2b11 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.006505 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad40f1-f072-4635-876c-f094d47b2b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.020295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-ef047f57-2a73-4ad1-a4e1-719d27fac812 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:00.021509 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ef047f57-2a73-4ad1-a4e1-719d27fac812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:00.026921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-baad40f1-f072-4635-876c-f094d47b2b11 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:00.028126 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-baad40f1-f072-4635-876c-f094d47b2b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:00.029848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 772/1563] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:00.030566 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef047f57-2a73-4ad1-a4e1-719d27fac812 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.039864 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 792/1564] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:00.040049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef047f57-2a73-4ad1-a4e1-719d27fac812 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.040861 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad40f1-f072-4635-876c-f094d47b2b11 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.047148 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d1fe2-2d3e-42de-aa9d-f4aefe42b5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.047758 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d1fe2-2d3e-42de-aa9d-f4aefe42b5b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.048023 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d1fe2-2d3e-42de-aa9d-f4aefe42b5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.048288 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d1fe2-2d3e-42de-aa9d-f4aefe42b5b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.048910 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d1fe2-2d3e-42de-aa9d-f4aefe42b5b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.050608 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad40f1-f072-4635-876c-f094d47b2b11 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.050823 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d1fe2-2d3e-42de-aa9d-f4aefe42b5b0 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.055774 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb9fb7-23a8-41be-b147-1e99b365c4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.056320 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb9fb7-23a8-41be-b147-1e99b365c4dc admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.056599 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb9fb7-23a8-41be-b147-1e99b365c4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.056869 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb9fb7-23a8-41be-b147-1e99b365c4dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.057514 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb9fb7-23a8-41be-b147-1e99b365c4dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:32:00.057818 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb9fb7-23a8-41be-b147-1e99b365c4dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.058905 dv-cinder-749155-14-smb devstack@keystone.service[81562]: WARNING py.warnings [None req-71fb9fb7-23a8-41be-b147-1e99b365c4dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 16:32:00.058905 dv-cinder-749155-14-smb devstack@keystone.service[81562]: warnings.warn(msg) Oct 04 16:32:00.058905 dv-cinder-749155-14-smb devstack@keystone.service[81562]: Oct 04 16:32:00.059821 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb9fb7-23a8-41be-b147-1e99b365c4dc admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.072744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 793/1565] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:32:00.073706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb9fb7-23a8-41be-b147-1e99b365c4dc admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.083194 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb9fb7-23a8-41be-b147-1e99b365c4dc admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.085807 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 773/1566] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:00 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:00.086767 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d1fe2-2d3e-42de-aa9d-f4aefe42b5b0 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.088141 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0f824-bb43-4523-abab-59e6bbe7503f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.088742 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0f824-bb43-4523-abab-59e6bbe7503f admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.089159 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0f824-bb43-4523-abab-59e6bbe7503f admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.089423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0f824-bb43-4523-abab-59e6bbe7503f admin admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.090062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0f824-bb43-4523-abab-59e6bbe7503f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:32:00.090358 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0f824-bb43-4523-abab-59e6bbe7503f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.092054 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0f824-bb43-4523-abab-59e6bbe7503f admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.096419 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:00.104460 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 794/1567] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:32:00.105322 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0f824-bb43-4523-abab-59e6bbe7503f admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.115243 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0f824-bb43-4523-abab-59e6bbe7503f admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.127133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:00.156091 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d1fe2-2d3e-42de-aa9d-f4aefe42b5b0 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.160790 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0bcdd-b265-4180-8296-267e5f269c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.161602 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0bcdd-b265-4180-8296-267e5f269c1f admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.162310 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0bcdd-b265-4180-8296-267e5f269c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.162700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0bcdd-b265-4180-8296-267e5f269c1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.163464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0bcdd-b265-4180-8296-267e5f269c1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:32:00.163765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0bcdd-b265-4180-8296-267e5f269c1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.165485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0bcdd-b265-4180-8296-267e5f269c1f admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.174292 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c39184-f37a-4933-95e1-22bda7bb7952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.175172 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c39184-f37a-4933-95e1-22bda7bb7952 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.175324 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c39184-f37a-4933-95e1-22bda7bb7952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.175590 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c39184-f37a-4933-95e1-22bda7bb7952 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.176244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c39184-f37a-4933-95e1-22bda7bb7952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.177775 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 774/1568] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:32:00.177915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c39184-f37a-4933-95e1-22bda7bb7952 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.178701 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0bcdd-b265-4180-8296-267e5f269c1f admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.188451 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 795/1569] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:00.189260 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c39184-f37a-4933-95e1-22bda7bb7952 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.192435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0bcdd-b265-4180-8296-267e5f269c1f admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.198233 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3168c4-d5e9-4b54-a875-045153565efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.198880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3168c4-d5e9-4b54-a875-045153565efe admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.199249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3168c4-d5e9-4b54-a875-045153565efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.199516 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3168c4-d5e9-4b54-a875-045153565efe admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.200161 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3168c4-d5e9-4b54-a875-045153565efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.200467 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c39184-f37a-4933-95e1-22bda7bb7952 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.201776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3168c4-d5e9-4b54-a875-045153565efe admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.205968 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d824d-3fe0-4742-9dd2-38c534fa38f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.206704 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d824d-3fe0-4742-9dd2-38c534fa38f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.206971 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d824d-3fe0-4742-9dd2-38c534fa38f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.207749 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d824d-3fe0-4742-9dd2-38c534fa38f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.208029 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d824d-3fe0-4742-9dd2-38c534fa38f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:32:00.208401 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d824d-3fe0-4742-9dd2-38c534fa38f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.210244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d824d-3fe0-4742-9dd2-38c534fa38f2 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.212884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 775/1570] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:00.212884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3168c4-d5e9-4b54-a875-045153565efe admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.223549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3168c4-d5e9-4b54-a875-045153565efe admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.227980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 796/1571] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:32:00.228362 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b986757-4e96-4792-a3ba-1f387eca85df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.228789 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d824d-3fe0-4742-9dd2-38c534fa38f2 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.228995 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b986757-4e96-4792-a3ba-1f387eca85df admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.229239 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b986757-4e96-4792-a3ba-1f387eca85df admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.229513 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b986757-4e96-4792-a3ba-1f387eca85df admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.230185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b986757-4e96-4792-a3ba-1f387eca85df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:32:00.230484 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b986757-4e96-4792-a3ba-1f387eca85df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.232107 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b986757-4e96-4792-a3ba-1f387eca85df admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.243974 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d824d-3fe0-4742-9dd2-38c534fa38f2 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.246046 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 776/1572] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:32:00.246720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b986757-4e96-4792-a3ba-1f387eca85df admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.249054 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a209668-d38a-4697-a9d8-9e47ae51677a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.249659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a209668-d38a-4697-a9d8-9e47ae51677a admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.249935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a209668-d38a-4697-a9d8-9e47ae51677a admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.250204 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a209668-d38a-4697-a9d8-9e47ae51677a admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.250839 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a209668-d38a-4697-a9d8-9e47ae51677a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.252952 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a209668-d38a-4697-a9d8-9e47ae51677a admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.256404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b986757-4e96-4792-a3ba-1f387eca85df admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.261644 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c4adb-a6e1-493e-bd76-b0c6a4eba9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.262272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c4adb-a6e1-493e-bd76-b0c6a4eba9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.262549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c4adb-a6e1-493e-bd76-b0c6a4eba9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.262815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c4adb-a6e1-493e-bd76-b0c6a4eba9e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.263495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c4adb-a6e1-493e-bd76-b0c6a4eba9e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.265449 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c4adb-a6e1-493e-bd76-b0c6a4eba9e2 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.282527 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 797/1573] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:00 2022] POST /identity/v3/projects => generated 391 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:00.283796 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a209668-d38a-4697-a9d8-9e47ae51677a admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.287388 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 777/1574] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:00 2022] POST /identity/v3/users => generated 292 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:00.288510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c4adb-a6e1-493e-bd76-b0c6a4eba9e2 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.298767 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c4adb-a6e1-493e-bd76-b0c6a4eba9e2 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.349312 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a209668-d38a-4697-a9d8-9e47ae51677a admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.354079 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e306c5-1360-4b12-8450-ac0c15133f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.354667 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e306c5-1360-4b12-8450-ac0c15133f6a admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.354817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88076755-140f-4ce0-a505-722a256483c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.355245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e306c5-1360-4b12-8450-ac0c15133f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.355343 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e306c5-1360-4b12-8450-ac0c15133f6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.355434 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88076755-140f-4ce0-a505-722a256483c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.355637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88076755-140f-4ce0-a505-722a256483c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.355908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88076755-140f-4ce0-a505-722a256483c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.356005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e306c5-1360-4b12-8450-ac0c15133f6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.356542 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88076755-140f-4ce0-a505-722a256483c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.357964 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e306c5-1360-4b12-8450-ac0c15133f6a admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.358506 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88076755-140f-4ce0-a505-722a256483c0 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.387940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 798/1575] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:00 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:00.391410 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 778/1576] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:00 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:00.391531 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e306c5-1360-4b12-8450-ac0c15133f6a admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.391624 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88076755-140f-4ce0-a505-722a256483c0 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.436444 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:00.453994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88076755-140f-4ce0-a505-722a256483c0 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.454161 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e306c5-1360-4b12-8450-ac0c15133f6a admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.458743 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8523dd-6657-4f44-84ad-f6dd33d04c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.458876 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56685141-81e3-452d-acf7-c21b724506fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.459443 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8523dd-6657-4f44-84ad-f6dd33d04c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.459561 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56685141-81e3-452d-acf7-c21b724506fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.459728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8523dd-6657-4f44-84ad-f6dd33d04c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.459831 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56685141-81e3-452d-acf7-c21b724506fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.460006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56685141-81e3-452d-acf7-c21b724506fd admin admin] PATH_INFO: `/v3/projects/1d100b2e119a45d58e8eef860e64ff04/users/ca1807ed523647849b30021b0f309fcc/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.460120 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8523dd-6657-4f44-84ad-f6dd33d04c5f admin admin] PATH_INFO: `/v3/projects/c56030bb09a941a78cf3c6688922cdfd/users/9cc389daa96d443f9e0bee68c90bdab9/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.463304 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:00.477662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56685141-81e3-452d-acf7-c21b724506fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d100b2e119a45d58e8eef860e64ff04, user_id=ca1807ed523647849b30021b0f309fcc, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.478745 dv-cinder-749155-14-smb devstack@keystone.service[81561]: WARNING py.warnings [None req-56685141-81e3-452d-acf7-c21b724506fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 16:32:00.478745 dv-cinder-749155-14-smb devstack@keystone.service[81561]: warnings.warn(msg) Oct 04 16:32:00.478745 dv-cinder-749155-14-smb devstack@keystone.service[81561]: Oct 04 16:32:00.479054 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8523dd-6657-4f44-84ad-f6dd33d04c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c56030bb09a941a78cf3c6688922cdfd, user_id=9cc389daa96d443f9e0bee68c90bdab9, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.480856 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56685141-81e3-452d-acf7-c21b724506fd admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.484373 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8523dd-6657-4f44-84ad-f6dd33d04c5f admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.495777 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 779/1577] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:00 2022] PUT /identity/v3/projects/1d100b2e119a45d58e8eef860e64ff04/users/ca1807ed523647849b30021b0f309fcc/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:00.497123 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56685141-81e3-452d-acf7-c21b724506fd admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.502513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 799/1578] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:00 2022] PUT /identity/v3/projects/c56030bb09a941a78cf3c6688922cdfd/users/9cc389daa96d443f9e0bee68c90bdab9/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:00.503369 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8523dd-6657-4f44-84ad-f6dd33d04c5f admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.568858 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8523dd-6657-4f44-84ad-f6dd33d04c5f admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.573593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525295e2-2dfd-4b0b-a07e-aae4a09c4cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.574209 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525295e2-2dfd-4b0b-a07e-aae4a09c4cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.574493 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525295e2-2dfd-4b0b-a07e-aae4a09c4cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.574689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56685141-81e3-452d-acf7-c21b724506fd admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.574811 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525295e2-2dfd-4b0b-a07e-aae4a09c4cf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.575421 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525295e2-2dfd-4b0b-a07e-aae4a09c4cf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.577353 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525295e2-2dfd-4b0b-a07e-aae4a09c4cf7 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.581540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf36f6-babe-4563-9716-91b79dbf37ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.582285 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf36f6-babe-4563-9716-91b79dbf37ea admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.582568 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf36f6-babe-4563-9716-91b79dbf37ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.582839 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf36f6-babe-4563-9716-91b79dbf37ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.583563 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf36f6-babe-4563-9716-91b79dbf37ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.585489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf36f6-babe-4563-9716-91b79dbf37ea admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.604938 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 800/1579] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:00 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:00.606011 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525295e2-2dfd-4b0b-a07e-aae4a09c4cf7 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.616651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 780/1580] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:00 2022] POST /identity/v3/projects => generated 399 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:00.616651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf36f6-babe-4563-9716-91b79dbf37ea admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.672022 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525295e2-2dfd-4b0b-a07e-aae4a09c4cf7 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.677124 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f0c6f-315d-4383-8c24-c3a06096a604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.677740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f0c6f-315d-4383-8c24-c3a06096a604 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.678125 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f0c6f-315d-4383-8c24-c3a06096a604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.678399 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f0c6f-315d-4383-8c24-c3a06096a604 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.678729 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf36f6-babe-4563-9716-91b79dbf37ea admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.679068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f0c6f-315d-4383-8c24-c3a06096a604 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.680994 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f0c6f-315d-4383-8c24-c3a06096a604 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.683412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab20e2f-a962-4e56-b62a-cb2a90fa3f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.684033 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab20e2f-a962-4e56-b62a-cb2a90fa3f21 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.684313 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab20e2f-a962-4e56-b62a-cb2a90fa3f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.684585 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab20e2f-a962-4e56-b62a-cb2a90fa3f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.685228 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab20e2f-a962-4e56-b62a-cb2a90fa3f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.686831 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab20e2f-a962-4e56-b62a-cb2a90fa3f21 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.697504 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 781/1581] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:00.698886 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab20e2f-a962-4e56-b62a-cb2a90fa3f21 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.706297 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 801/1582] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:00 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:00.706297 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f0c6f-315d-4383-8c24-c3a06096a604 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.709039 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab20e2f-a962-4e56-b62a-cb2a90fa3f21 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.713770 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f0c6f-315d-4383-8c24-c3a06096a604 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.714035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b1c4f-51bd-4725-9fd5-b637b954c260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.714671 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b1c4f-51bd-4725-9fd5-b637b954c260 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.714957 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b1c4f-51bd-4725-9fd5-b637b954c260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.715262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b1c4f-51bd-4725-9fd5-b637b954c260 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.715889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b1c4f-51bd-4725-9fd5-b637b954c260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.717815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b1c4f-51bd-4725-9fd5-b637b954c260 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.718555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d3676-977f-4554-8389-fe9f50f4aaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.719181 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d3676-977f-4554-8389-fe9f50f4aaf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.719460 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d3676-977f-4554-8389-fe9f50f4aaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.719742 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d3676-977f-4554-8389-fe9f50f4aaf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.720378 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d3676-977f-4554-8389-fe9f50f4aaf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.722278 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d3676-977f-4554-8389-fe9f50f4aaf3 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.739849 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 782/1583] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:00 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:00.741093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44d973-6490-4eb9-8358-cfb879f5a5b2 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.741393 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44d973-6490-4eb9-8358-cfb879f5a5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.741627 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44d973-6490-4eb9-8358-cfb879f5a5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.747818 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 802/1584] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:00 2022] POST /identity/v3/users => generated 293 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:00.747818 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87408e48-c799-4b92-bb36-75840e4f275f None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.747818 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87408e48-c799-4b92-bb36-75840e4f275f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.747818 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87408e48-c799-4b92-bb36-75840e4f275f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.762947 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-7a44d973-6490-4eb9-8358-cfb879f5a5b2 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:00.764194 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-7a44d973-6490-4eb9-8358-cfb879f5a5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:00.771741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 783/1585] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:00.772893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44d973-6490-4eb9-8358-cfb879f5a5b2 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.776267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-87408e48-c799-4b92-bb36-75840e4f275f None None] MFA Rules not processed for user `9cc389daa96d443f9e0bee68c90bdab9`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:00.777359 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-87408e48-c799-4b92-bb36-75840e4f275f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:00.782356 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44d973-6490-4eb9-8358-cfb879f5a5b2 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.787533 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94491590-4674-4ed7-b33e-967e880a6312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.788236 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94491590-4674-4ed7-b33e-967e880a6312 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.788514 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94491590-4674-4ed7-b33e-967e880a6312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.788786 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94491590-4674-4ed7-b33e-967e880a6312 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.789424 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94491590-4674-4ed7-b33e-967e880a6312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.791445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94491590-4674-4ed7-b33e-967e880a6312 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.808397 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:00.815149 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 784/1586] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:00 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:00.816753 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94491590-4674-4ed7-b33e-967e880a6312 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.827112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94491590-4674-4ed7-b33e-967e880a6312 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.833125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c35c6e-5c1b-48f4-8669-3f8df2e8dcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.833743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c35c6e-5c1b-48f4-8669-3f8df2e8dcac admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.834018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c35c6e-5c1b-48f4-8669-3f8df2e8dcac admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.834283 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c35c6e-5c1b-48f4-8669-3f8df2e8dcac admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.835009 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c35c6e-5c1b-48f4-8669-3f8df2e8dcac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.836954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c35c6e-5c1b-48f4-8669-3f8df2e8dcac admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.845182 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:00.852334 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 803/1587] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:00.853194 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87408e48-c799-4b92-bb36-75840e4f275f None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.867160 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 785/1588] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:00 2022] POST /identity/v3/users => generated 300 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:00.867160 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c35c6e-5c1b-48f4-8669-3f8df2e8dcac admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.870126 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87408e48-c799-4b92-bb36-75840e4f275f None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.876218 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c35c6e-5c1b-48f4-8669-3f8df2e8dcac admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.877250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ddd77-ab7b-4435-9aa8-c3d31b33794f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.877881 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ddd77-ab7b-4435-9aa8-c3d31b33794f admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.878154 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ddd77-ab7b-4435-9aa8-c3d31b33794f admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.878416 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ddd77-ab7b-4435-9aa8-c3d31b33794f admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.879103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ddd77-ab7b-4435-9aa8-c3d31b33794f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.881031 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ddd77-ab7b-4435-9aa8-c3d31b33794f admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.883173 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff1640-803a-46fa-807e-97bec913344e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.883974 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff1640-803a-46fa-807e-97bec913344e admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.884230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff1640-803a-46fa-807e-97bec913344e admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.884506 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff1640-803a-46fa-807e-97bec913344e admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.885170 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff1640-803a-46fa-807e-97bec913344e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.886853 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff1640-803a-46fa-807e-97bec913344e admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.894463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 804/1589] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:00.895849 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ddd77-ab7b-4435-9aa8-c3d31b33794f admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.900587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 786/1590] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:00.901743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff1640-803a-46fa-807e-97bec913344e admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.911627 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ddd77-ab7b-4435-9aa8-c3d31b33794f admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.913457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff1640-803a-46fa-807e-97bec913344e admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.916935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607f22d-c4e5-432c-acd1-cdc72afee1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.917581 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607f22d-c4e5-432c-acd1-cdc72afee1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.917856 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607f22d-c4e5-432c-acd1-cdc72afee1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.918123 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607f22d-c4e5-432c-acd1-cdc72afee1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.918624 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d60cb9-600c-4678-b22f-1be93286ce04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.918790 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607f22d-c4e5-432c-acd1-cdc72afee1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.919289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d60cb9-600c-4678-b22f-1be93286ce04 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.919544 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d60cb9-600c-4678-b22f-1be93286ce04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.919808 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d60cb9-600c-4678-b22f-1be93286ce04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.920475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d60cb9-600c-4678-b22f-1be93286ce04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.920596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607f22d-c4e5-432c-acd1-cdc72afee1e8 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.922062 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d60cb9-600c-4678-b22f-1be93286ce04 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.932340 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 805/1591] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:00.932511 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 787/1592] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:00.936080 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607f22d-c4e5-432c-acd1-cdc72afee1e8 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.936205 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d60cb9-600c-4678-b22f-1be93286ce04 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.946286 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d60cb9-600c-4678-b22f-1be93286ce04 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.950848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c6bd4-810a-4141-9029-8a58f110f851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.951467 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c6bd4-810a-4141-9029-8a58f110f851 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.951743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c6bd4-810a-4141-9029-8a58f110f851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.952011 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c6bd4-810a-4141-9029-8a58f110f851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.952641 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c6bd4-810a-4141-9029-8a58f110f851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.954233 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c6bd4-810a-4141-9029-8a58f110f851 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.967232 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 788/1593] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:00.967232 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c6bd4-810a-4141-9029-8a58f110f851 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:00.974064 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c6bd4-810a-4141-9029-8a58f110f851 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.978749 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafc68c-9d20-4107-9d9e-08ab5533deb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.979335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafc68c-9d20-4107-9d9e-08ab5533deb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.979606 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafc68c-9d20-4107-9d9e-08ab5533deb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.979904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafc68c-9d20-4107-9d9e-08ab5533deb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.980527 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbafc68c-9d20-4107-9d9e-08ab5533deb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:00.982133 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbafc68c-9d20-4107-9d9e-08ab5533deb6 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:00.991764 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607f22d-c4e5-432c-acd1-cdc72afee1e8 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:00.993395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 789/1594] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:00.995711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e536b6-9855-487d-9e16-5dbf9f51384f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:00.996372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e536b6-9855-487d-9e16-5dbf9f51384f service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.996590 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e536b6-9855-487d-9e16-5dbf9f51384f service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.996853 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e536b6-9855-487d-9e16-5dbf9f51384f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.997625 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc604f3-cee4-4003-8491-7d04b4af03b1 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:00.997905 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc604f3-cee4-4003-8491-7d04b4af03b1 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:00.998173 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc604f3-cee4-4003-8491-7d04b4af03b1 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:00.999441 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 790/1595] 10.222.0.55 () {54 vars in 961 bytes} [Tue Oct 4 16:32:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:32:01.004263 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc604f3-cee4-4003-8491-7d04b4af03b1 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:01.006095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e536b6-9855-487d-9e16-5dbf9f51384f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:01.007561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e536b6-9855-487d-9e16-5dbf9f51384f service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:01.016200 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc604f3-cee4-4003-8491-7d04b4af03b1 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:01.016963 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 806/1596] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:01.017742 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e536b6-9855-487d-9e16-5dbf9f51384f service neutron] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:01.020762 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad051137-ab43-42b2-873d-8dfd20adada1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:01.021391 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad051137-ab43-42b2-873d-8dfd20adada1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:01.021665 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad051137-ab43-42b2-873d-8dfd20adada1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:01.022299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad051137-ab43-42b2-873d-8dfd20adada1 admin admin] PATH_INFO: `/v3/projects/abc1c3fe146e49b08b04a8ef09d59075/users/fd7782e68436445395dd49bf7d8302e8/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:01.028849 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e536b6-9855-487d-9e16-5dbf9f51384f service neutron] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:01.034953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3ab1b-585f-4043-ae9f-64cdd50eace0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:01.035627 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3ab1b-585f-4043-ae9f-64cdd50eace0 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:01.035876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3ab1b-585f-4043-ae9f-64cdd50eace0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:01.036146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3ab1b-585f-4043-ae9f-64cdd50eace0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:01.036784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3ab1b-585f-4043-ae9f-64cdd50eace0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:01.038381 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3ab1b-585f-4043-ae9f-64cdd50eace0 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:01.042779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad051137-ab43-42b2-873d-8dfd20adada1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc1c3fe146e49b08b04a8ef09d59075, user_id=fd7782e68436445395dd49bf7d8302e8, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:01.046366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad051137-ab43-42b2-873d-8dfd20adada1 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:01.052609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 807/1597] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:01.052609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3ab1b-585f-4043-ae9f-64cdd50eace0 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:01.060746 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3ab1b-585f-4043-ae9f-64cdd50eace0 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:01.064557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 791/1598] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:00 2022] PUT /identity/v3/projects/abc1c3fe146e49b08b04a8ef09d59075/users/fd7782e68436445395dd49bf7d8302e8/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:01.065227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad051137-ab43-42b2-873d-8dfd20adada1 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:01.130415 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a8344-7564-4132-a56d-eae37c1a6ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:01.131240 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a8344-7564-4132-a56d-eae37c1a6ece admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:01.131578 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a8344-7564-4132-a56d-eae37c1a6ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:01.132014 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a8344-7564-4132-a56d-eae37c1a6ece admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:01.132304 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad051137-ab43-42b2-873d-8dfd20adada1 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:01.132831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a8344-7564-4132-a56d-eae37c1a6ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:01.134804 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a8344-7564-4132-a56d-eae37c1a6ece admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:01.137058 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7571775-1ea5-40fc-bcb6-9872559a3779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:01.137675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7571775-1ea5-40fc-bcb6-9872559a3779 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:01.137958 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7571775-1ea5-40fc-bcb6-9872559a3779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:01.138220 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7571775-1ea5-40fc-bcb6-9872559a3779 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:01.139290 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7571775-1ea5-40fc-bcb6-9872559a3779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:01.140488 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7571775-1ea5-40fc-bcb6-9872559a3779 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:01.146729 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 808/1599] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:01.148068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a8344-7564-4132-a56d-eae37c1a6ece admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:01.154351 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 792/1600] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:01.155231 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7571775-1ea5-40fc-bcb6-9872559a3779 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:01.162181 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a8344-7564-4132-a56d-eae37c1a6ece admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:01.166816 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7571775-1ea5-40fc-bcb6-9872559a3779 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:01.167097 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c258d02-bd97-422e-ad37-8206ec353fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:01.167928 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c258d02-bd97-422e-ad37-8206ec353fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:01.168160 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c258d02-bd97-422e-ad37-8206ec353fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:01.168446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c258d02-bd97-422e-ad37-8206ec353fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:01.169061 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c258d02-bd97-422e-ad37-8206ec353fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:01.170855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c258d02-bd97-422e-ad37-8206ec353fb7 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:01.172247 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2682e-12c2-4945-9eb6-958fb5b3b57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:01.172913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2682e-12c2-4945-9eb6-958fb5b3b57a admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:01.173222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2682e-12c2-4945-9eb6-958fb5b3b57a admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:01.173822 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2682e-12c2-4945-9eb6-958fb5b3b57a admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:01.174129 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2682e-12c2-4945-9eb6-958fb5b3b57a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:01.176218 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2682e-12c2-4945-9eb6-958fb5b3b57a admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:01.187561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 809/1601] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:01.187561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a87416-e911-4cf1-9a63-45653610b46d None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:01.187561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a87416-e911-4cf1-9a63-45653610b46d None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:01.187561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a87416-e911-4cf1-9a63-45653610b46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:01.188336 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 793/1602] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:01.188638 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2682e-12c2-4945-9eb6-958fb5b3b57a admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:01.199851 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2682e-12c2-4945-9eb6-958fb5b3b57a admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:01.205888 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec5aa2-5446-4785-8c83-3ac09d52eb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:01.206705 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec5aa2-5446-4785-8c83-3ac09d52eb69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:01.207183 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec5aa2-5446-4785-8c83-3ac09d52eb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:01.207280 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec5aa2-5446-4785-8c83-3ac09d52eb69 admin admin] PATH_INFO: `/v3/projects/781b9a3542c8445c836705198f62594c/users/06aca6bb76ec4290b591d9c7a5a6c5c8/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:01.231674 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-65a87416-e911-4cf1-9a63-45653610b46d None None] MFA Rules not processed for user `6cdee0584fe045028a44c385d032d2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:01.233212 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-65a87416-e911-4cf1-9a63-45653610b46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:01.239251 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec5aa2-5446-4785-8c83-3ac09d52eb69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=781b9a3542c8445c836705198f62594c, user_id=06aca6bb76ec4290b591d9c7a5a6c5c8, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:01.242060 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec5aa2-5446-4785-8c83-3ac09d52eb69 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:01.244603 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:01.256587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 794/1603] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:01 2022] PUT /identity/v3/projects/781b9a3542c8445c836705198f62594c/users/06aca6bb76ec4290b591d9c7a5a6c5c8/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:01.261596 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be77e26-e893-4b19-84b4-aa9dc963aa5a None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:01.261897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be77e26-e893-4b19-84b4-aa9dc963aa5a None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:01.262152 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be77e26-e893-4b19-84b4-aa9dc963aa5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:01.283276 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-7be77e26-e893-4b19-84b4-aa9dc963aa5a None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:01.284562 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-7be77e26-e893-4b19-84b4-aa9dc963aa5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:01.313092 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 810/1604] 10.222.0.55 () {58 vars in 1058 bytes} [Tue Oct 4 16:32:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:01.314359 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a87416-e911-4cf1-9a63-45653610b46d None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:01.326213 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a87416-e911-4cf1-9a63-45653610b46d None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:01.337378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:01.362052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 795/1605] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:01.363165 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be77e26-e893-4b19-84b4-aa9dc963aa5a None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:01.372880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be77e26-e893-4b19-84b4-aa9dc963aa5a None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:01.381001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb230450-6c5e-4269-a0f8-4e3cf0f0393a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:01.381770 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb230450-6c5e-4269-a0f8-4e3cf0f0393a admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:01.382048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb230450-6c5e-4269-a0f8-4e3cf0f0393a admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:01.382313 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb230450-6c5e-4269-a0f8-4e3cf0f0393a admin admin] PATH_INFO: `/v3/projects/070b55dc10444c51a1189153acc03506/users/3d86bf98584743288c09d78f6e0bcebc/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:01.400413 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c49d8-f1cd-498b-ad66-7bec65e8d0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:01.401168 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c49d8-f1cd-498b-ad66-7bec65e8d0b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:01.401545 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c49d8-f1cd-498b-ad66-7bec65e8d0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:01.401871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c49d8-f1cd-498b-ad66-7bec65e8d0b4 admin admin] PATH_INFO: `/v3/projects/a2aebdceb8a248c986e1122b08282506/users/e38a93b37cef47d7af138269bec008cb/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:01.403705 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb230450-6c5e-4269-a0f8-4e3cf0f0393a admin admin] RBAC: Authorizing `identity:create_grant(project_id=070b55dc10444c51a1189153acc03506, user_id=3d86bf98584743288c09d78f6e0bcebc, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:01.406715 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb230450-6c5e-4269-a0f8-4e3cf0f0393a admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:01.424015 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c49d8-f1cd-498b-ad66-7bec65e8d0b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2aebdceb8a248c986e1122b08282506, user_id=e38a93b37cef47d7af138269bec008cb, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:01.427531 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c49d8-f1cd-498b-ad66-7bec65e8d0b4 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:01.430554 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 796/1606] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:01 2022] PUT /identity/v3/projects/070b55dc10444c51a1189153acc03506/users/3d86bf98584743288c09d78f6e0bcebc/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:01.431834 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb230450-6c5e-4269-a0f8-4e3cf0f0393a admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:01.447472 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 811/1607] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:01 2022] PUT /identity/v3/projects/a2aebdceb8a248c986e1122b08282506/users/e38a93b37cef47d7af138269bec008cb/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:01.458285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c49d8-f1cd-498b-ad66-7bec65e8d0b4 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:01.518228 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb230450-6c5e-4269-a0f8-4e3cf0f0393a admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:01.525168 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ed848-9542-4980-b152-98d116ec8645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:01.525866 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ed848-9542-4980-b152-98d116ec8645 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:01.526153 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ed848-9542-4980-b152-98d116ec8645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:01.526403 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ed848-9542-4980-b152-98d116ec8645 admin admin] PATH_INFO: `/v3/projects/e4583dfba57d4ef8a82b71886679a82a/users/b505541b5fe8494fa9ae8777e7add970/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:01.527982 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c49d8-f1cd-498b-ad66-7bec65e8d0b4 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:01.533041 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfbec5-4b72-45f4-b791-d526c7c2752d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:01.533742 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfbec5-4b72-45f4-b791-d526c7c2752d admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:01.534021 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfbec5-4b72-45f4-b791-d526c7c2752d admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:01.534298 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfbec5-4b72-45f4-b791-d526c7c2752d admin admin] PATH_INFO: `/v3/projects/74693854606748efb3cff910f53c9c54/users/e7872cc1213c4d09bf0a8f76f10dbbe8/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:01.544542 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ed848-9542-4980-b152-98d116ec8645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4583dfba57d4ef8a82b71886679a82a, user_id=b505541b5fe8494fa9ae8777e7add970, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:01.547777 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ed848-9542-4980-b152-98d116ec8645 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:01.552031 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfbec5-4b72-45f4-b791-d526c7c2752d admin admin] RBAC: Authorizing `identity:create_grant(project_id=74693854606748efb3cff910f53c9c54, user_id=e7872cc1213c4d09bf0a8f76f10dbbe8, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:01.555549 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfbec5-4b72-45f4-b791-d526c7c2752d admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:01.566217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 797/1608] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:01 2022] PUT /identity/v3/projects/e4583dfba57d4ef8a82b71886679a82a/users/b505541b5fe8494fa9ae8777e7add970/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:01.567655 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8343ac-f13d-4263-850e-5adfb77aab3d None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:01.568011 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8343ac-f13d-4263-850e-5adfb77aab3d None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:01.568384 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8343ac-f13d-4263-850e-5adfb77aab3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:01.580912 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 812/1609] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:01 2022] PUT /identity/v3/projects/74693854606748efb3cff910f53c9c54/users/e7872cc1213c4d09bf0a8f76f10dbbe8/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:01.582053 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfbec5-4b72-45f4-b791-d526c7c2752d admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:01.596637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:01.600097 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-da8343ac-f13d-4263-850e-5adfb77aab3d None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:01.601321 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-da8343ac-f13d-4263-850e-5adfb77aab3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:01.666183 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfbec5-4b72-45f4-b791-d526c7c2752d admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:01.669065 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 798/1610] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:01.669893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8343ac-f13d-4263-850e-5adfb77aab3d None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:01.672703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90726895-455b-47fa-a93e-4ebb24d403c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:01.673432 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90726895-455b-47fa-a93e-4ebb24d403c7 service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:01.673802 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90726895-455b-47fa-a93e-4ebb24d403c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:01.674790 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90726895-455b-47fa-a93e-4ebb24d403c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:01.726810 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:01.739235 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90726895-455b-47fa-a93e-4ebb24d403c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:01.740826 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8343ac-f13d-4263-850e-5adfb77aab3d None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:01.741072 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90726895-455b-47fa-a93e-4ebb24d403c7 service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:01.744938 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7d453-f9fe-4d3e-82ec-af77421c4c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:01.745635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7d453-f9fe-4d3e-82ec-af77421c4c6c service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:01.745911 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7d453-f9fe-4d3e-82ec-af77421c4c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:01.746189 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7d453-f9fe-4d3e-82ec-af77421c4c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:01.754726 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 813/1611] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:01.756101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed287f49-680e-4bc8-8bb9-12fabef6ea9c None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:01.756491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed287f49-680e-4bc8-8bb9-12fabef6ea9c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:01.756709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed287f49-680e-4bc8-8bb9-12fabef6ea9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:01.757907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7d453-f9fe-4d3e-82ec-af77421c4c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:01.760519 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7d453-f9fe-4d3e-82ec-af77421c4c6c service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:01.777099 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 799/1612] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:01.779042 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06e1e8-b08c-4b6a-beab-4222fb5eadee None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:01.779454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06e1e8-b08c-4b6a-beab-4222fb5eadee None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:01.779951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06e1e8-b08c-4b6a-beab-4222fb5eadee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:01.799857 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-ed287f49-680e-4bc8-8bb9-12fabef6ea9c None None] MFA Rules not processed for user `3d86bf98584743288c09d78f6e0bcebc`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:01.801212 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ed287f49-680e-4bc8-8bb9-12fabef6ea9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:01.825778 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-1c06e1e8-b08c-4b6a-beab-4222fb5eadee None None] MFA Rules not processed for user `e38a93b37cef47d7af138269bec008cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:01.827558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-1c06e1e8-b08c-4b6a-beab-4222fb5eadee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:01.933714 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 814/1613] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:01.941032 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0e480-3103-4bef-a068-4ad5e2c4d660 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:01.941321 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0e480-3103-4bef-a068-4ad5e2c4d660 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:01.941594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0e480-3103-4bef-a068-4ad5e2c4d660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:01.963786 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 800/1614] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:01.965318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efd2ea-750f-44b8-89ff-3530a88a91a0 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:01.967682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efd2ea-750f-44b8-89ff-3530a88a91a0 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:01.968042 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efd2ea-750f-44b8-89ff-3530a88a91a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:01.986708 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-76a0e480-3103-4bef-a068-4ad5e2c4d660 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:01.987974 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-76a0e480-3103-4bef-a068-4ad5e2c4d660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:02.012713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 815/1615] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:02.016009 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0e480-3103-4bef-a068-4ad5e2c4d660 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:02.043929 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-14efd2ea-750f-44b8-89ff-3530a88a91a0 None None] MFA Rules not processed for user `e7872cc1213c4d09bf0a8f76f10dbbe8`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:02.044397 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0e480-3103-4bef-a068-4ad5e2c4d660 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:02.045238 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-14efd2ea-750f-44b8-89ff-3530a88a91a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:02.050797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7cd7a-81e6-412b-a286-0e2f81578496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:02.052827 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7cd7a-81e6-412b-a286-0e2f81578496 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:02.053117 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7cd7a-81e6-412b-a286-0e2f81578496 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:02.053642 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7cd7a-81e6-412b-a286-0e2f81578496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:02.066831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7cd7a-81e6-412b-a286-0e2f81578496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:02.069300 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7cd7a-81e6-412b-a286-0e2f81578496 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:02.085087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 816/1616] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:02.086528 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7cd7a-81e6-412b-a286-0e2f81578496 service neutron] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:02.102299 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7cd7a-81e6-412b-a286-0e2f81578496 service neutron] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:02.113272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef8856-c9b8-4627-b9e1-c3069552db37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:02.113635 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef8856-c9b8-4627-b9e1-c3069552db37 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:02.113967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef8856-c9b8-4627-b9e1-c3069552db37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:02.114352 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef8856-c9b8-4627-b9e1-c3069552db37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:02.115037 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef8856-c9b8-4627-b9e1-c3069552db37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:02.118535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef8856-c9b8-4627-b9e1-c3069552db37 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:02.150100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:02.175532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 817/1617] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:02 2022] POST /identity/v3/projects => generated 387 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:02.175532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef8856-c9b8-4627-b9e1-c3069552db37 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:02.198511 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 801/1618] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:01 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:02.199476 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efd2ea-750f-44b8-89ff-3530a88a91a0 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:02.222169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efd2ea-750f-44b8-89ff-3530a88a91a0 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:02.306083 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2fab0-5f54-429a-8173-01b09e633d7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:02.307190 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2fab0-5f54-429a-8173-01b09e633d7a service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:02.308311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2fab0-5f54-429a-8173-01b09e633d7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:02.308686 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2fab0-5f54-429a-8173-01b09e633d7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:02.315725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef8856-c9b8-4627-b9e1-c3069552db37 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:02.326044 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d562ff-76f1-48d6-a07c-d85507be4c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:02.329617 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d562ff-76f1-48d6-a07c-d85507be4c47 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:02.330249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d562ff-76f1-48d6-a07c-d85507be4c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:02.330536 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d562ff-76f1-48d6-a07c-d85507be4c47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:02.332681 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2fab0-5f54-429a-8173-01b09e633d7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:02.333122 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d562ff-76f1-48d6-a07c-d85507be4c47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:02.337309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2fab0-5f54-429a-8173-01b09e633d7a service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:02.337627 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d562ff-76f1-48d6-a07c-d85507be4c47 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:02.365358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 802/1619] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:02.366024 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2fab0-5f54-429a-8173-01b09e633d7a service neutron] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:02.387018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2fab0-5f54-429a-8173-01b09e633d7a service neutron] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:02.399727 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e843d8-71d7-4f7d-b871-ebd22ef26f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:02.401051 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e843d8-71d7-4f7d-b871-ebd22ef26f54 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:02.403422 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e843d8-71d7-4f7d-b871-ebd22ef26f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:02.403711 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e843d8-71d7-4f7d-b871-ebd22ef26f54 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:02.403831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 818/1620] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:02 2022] POST /identity/v3/projects => generated 373 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:02.404721 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d562ff-76f1-48d6-a07c-d85507be4c47 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:02.409989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e843d8-71d7-4f7d-b871-ebd22ef26f54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:02.414842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e843d8-71d7-4f7d-b871-ebd22ef26f54 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:02.434969 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:02.467710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 803/1621] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:02 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:02.469930 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e843d8-71d7-4f7d-b871-ebd22ef26f54 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:02.495894 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e843d8-71d7-4f7d-b871-ebd22ef26f54 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:02.548130 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d562ff-76f1-48d6-a07c-d85507be4c47 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:02.561686 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c9c66-8801-4434-a0bb-6a3f0eab3b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:02.562459 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c9c66-8801-4434-a0bb-6a3f0eab3b64 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:02.564028 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c9c66-8801-4434-a0bb-6a3f0eab3b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:02.564328 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c9c66-8801-4434-a0bb-6a3f0eab3b64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:02.567244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c9c66-8801-4434-a0bb-6a3f0eab3b64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:02.572154 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c9c66-8801-4434-a0bb-6a3f0eab3b64 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:02.625117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127127ac-ff62-48d1-985a-80ff361221da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:02.639496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127127ac-ff62-48d1-985a-80ff361221da admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:02.639923 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127127ac-ff62-48d1-985a-80ff361221da admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:02.640160 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127127ac-ff62-48d1-985a-80ff361221da admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:02.642622 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 819/1622] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:02 2022] POST /identity/v3/projects => generated 399 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:02.643898 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127127ac-ff62-48d1-985a-80ff361221da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:02.647446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c9c66-8801-4434-a0bb-6a3f0eab3b64 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:02.651887 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127127ac-ff62-48d1-985a-80ff361221da admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:02.721299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 804/1623] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:02 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:02.729382 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcac2e8-0dc5-43cd-8cf4-54b235bd122f None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:02.731079 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcac2e8-0dc5-43cd-8cf4-54b235bd122f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:02.731875 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcac2e8-0dc5-43cd-8cf4-54b235bd122f None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:02.734815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 805/1624] 10.222.0.55 () {54 vars in 961 bytes} [Tue Oct 4 16:32:02 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:32:02.736007 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcac2e8-0dc5-43cd-8cf4-54b235bd122f None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:02.744038 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c9c66-8801-4434-a0bb-6a3f0eab3b64 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:02.748580 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea549b-1ba9-4aac-9070-a2e9b10b5014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:02.749340 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea549b-1ba9-4aac-9070-a2e9b10b5014 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:02.749626 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea549b-1ba9-4aac-9070-a2e9b10b5014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:02.750077 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea549b-1ba9-4aac-9070-a2e9b10b5014 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:02.750588 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea549b-1ba9-4aac-9070-a2e9b10b5014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:02.753194 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea549b-1ba9-4aac-9070-a2e9b10b5014 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:02.763180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcac2e8-0dc5-43cd-8cf4-54b235bd122f None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:02.768770 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de77c16-89d6-4bbc-9f85-4db9e663e7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:02.769827 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de77c16-89d6-4bbc-9f85-4db9e663e7dd admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:02.770270 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de77c16-89d6-4bbc-9f85-4db9e663e7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:02.771377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de77c16-89d6-4bbc-9f85-4db9e663e7dd admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:02.772912 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de77c16-89d6-4bbc-9f85-4db9e663e7dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:02.773983 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 820/1625] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:02.775045 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea549b-1ba9-4aac-9070-a2e9b10b5014 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:02.778002 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de77c16-89d6-4bbc-9f85-4db9e663e7dd admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:02.789274 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:02.806834 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea549b-1ba9-4aac-9070-a2e9b10b5014 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:02.820748 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85aea8a-a0f0-4e75-a561-90f7faf8bcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:02.821379 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85aea8a-a0f0-4e75-a561-90f7faf8bcff admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:02.822366 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85aea8a-a0f0-4e75-a561-90f7faf8bcff admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:02.822663 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85aea8a-a0f0-4e75-a561-90f7faf8bcff admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:02.825078 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85aea8a-a0f0-4e75-a561-90f7faf8bcff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:02.826387 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 806/1626] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:02 2022] POST /identity/v3/users => generated 306 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:02.828429 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85aea8a-a0f0-4e75-a561-90f7faf8bcff admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:02.829118 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02af4c-35cf-4f5d-8020-56d8ee8ba6f0 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:02.829668 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02af4c-35cf-4f5d-8020-56d8ee8ba6f0 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:02.830191 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02af4c-35cf-4f5d-8020-56d8ee8ba6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:02.852886 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 821/1627] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:02.852886 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85aea8a-a0f0-4e75-a561-90f7faf8bcff admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:02.866430 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-5f02af4c-35cf-4f5d-8020-56d8ee8ba6f0 None None] MFA Rules not processed for user `6cdee0584fe045028a44c385d032d2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:02.867853 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85aea8a-a0f0-4e75-a561-90f7faf8bcff admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:02.868840 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-5f02af4c-35cf-4f5d-8020-56d8ee8ba6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:02.874618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f349311-1cd7-4cc6-afb5-bb7328eda834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:02.875449 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f349311-1cd7-4cc6-afb5-bb7328eda834 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:02.875730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f349311-1cd7-4cc6-afb5-bb7328eda834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:02.876238 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f349311-1cd7-4cc6-afb5-bb7328eda834 admin admin] PATH_INFO: `/v3/projects/3e46a7808e4146b88440e822bcbd2d4a/users/7030e257591a40a1938eee1f060fa47b/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:02.895330 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f349311-1cd7-4cc6-afb5-bb7328eda834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e46a7808e4146b88440e822bcbd2d4a, user_id=7030e257591a40a1938eee1f060fa47b, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:02.900580 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f349311-1cd7-4cc6-afb5-bb7328eda834 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:02.919929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 822/1628] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:02 2022] PUT /identity/v3/projects/3e46a7808e4146b88440e822bcbd2d4a/users/7030e257591a40a1938eee1f060fa47b/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:02.921056 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f349311-1cd7-4cc6-afb5-bb7328eda834 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:03.012061 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f349311-1cd7-4cc6-afb5-bb7328eda834 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:03.018151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f33d4-2b20-4e47-9724-b75deb37bed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:03.019005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f33d4-2b20-4e47-9724-b75deb37bed2 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:03.019310 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f33d4-2b20-4e47-9724-b75deb37bed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:03.019582 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f33d4-2b20-4e47-9724-b75deb37bed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:03.020439 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f33d4-2b20-4e47-9724-b75deb37bed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:03.022542 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f33d4-2b20-4e47-9724-b75deb37bed2 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:03.043552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 823/1629] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:03.043552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f33d4-2b20-4e47-9724-b75deb37bed2 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:03.045412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 807/1630] 10.222.0.55 () {58 vars in 1058 bytes} [Tue Oct 4 16:32:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:03.049103 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02af4c-35cf-4f5d-8020-56d8ee8ba6f0 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:03.061672 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f33d4-2b20-4e47-9724-b75deb37bed2 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:03.066963 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1ccc4-6045-41ad-8c80-de572b422362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:03.068527 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1ccc4-6045-41ad-8c80-de572b422362 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:03.068963 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1ccc4-6045-41ad-8c80-de572b422362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:03.069248 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1ccc4-6045-41ad-8c80-de572b422362 admin admin] PATH_INFO: `/v3/projects/558e08bf824e46729d917376bb8c7a28/users/7abd1772b8674027ae3d0d2f048dc20e/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:03.080701 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02af4c-35cf-4f5d-8020-56d8ee8ba6f0 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:03.088348 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8826bb-b59f-4629-aa9a-8b1badf78299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:03.089372 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8826bb-b59f-4629-aa9a-8b1badf78299 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:03.089936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8826bb-b59f-4629-aa9a-8b1badf78299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:03.089936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8826bb-b59f-4629-aa9a-8b1badf78299 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:03.090569 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8826bb-b59f-4629-aa9a-8b1badf78299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:03.094430 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8826bb-b59f-4629-aa9a-8b1badf78299 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:03.095275 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1ccc4-6045-41ad-8c80-de572b422362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=558e08bf824e46729d917376bb8c7a28, user_id=7abd1772b8674027ae3d0d2f048dc20e, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:03.099024 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1ccc4-6045-41ad-8c80-de572b422362 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:03.118503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 808/1631] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:03.125466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8826bb-b59f-4629-aa9a-8b1badf78299 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:03.132097 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 824/1632] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:03 2022] PUT /identity/v3/projects/558e08bf824e46729d917376bb8c7a28/users/7abd1772b8674027ae3d0d2f048dc20e/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:03.134048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b531a1-afa7-44a1-946f-21c18dbfd415 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:03.134488 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b531a1-afa7-44a1-946f-21c18dbfd415 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:03.135304 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b531a1-afa7-44a1-946f-21c18dbfd415 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:03.144148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 825/1633] 10.222.0.55 () {54 vars in 912 bytes} [Tue Oct 4 16:32:03 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:32:03.144587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8826bb-b59f-4629-aa9a-8b1badf78299 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:03.145509 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b531a1-afa7-44a1-946f-21c18dbfd415 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:03.262073 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:INSERT=9,keystone:SELECT=91 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:03.291042 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b531a1-afa7-44a1-946f-21c18dbfd415 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:03.314389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdbb16-2282-49dc-b1e2-308d5cfcc58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:03.315438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdbb16-2282-49dc-b1e2-308d5cfcc58a admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:03.315709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdbb16-2282-49dc-b1e2-308d5cfcc58a admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:03.316178 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdbb16-2282-49dc-b1e2-308d5cfcc58a admin admin] PATH_INFO: `/v3/projects/3e46a7808e4146b88440e822bcbd2d4a/users/7030e257591a40a1938eee1f060fa47b/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:03.321242 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44753a-1de8-4bb7-9696-f40cd7470255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:03.325224 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44753a-1de8-4bb7-9696-f40cd7470255 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:03.325613 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44753a-1de8-4bb7-9696-f40cd7470255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:03.327105 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44753a-1de8-4bb7-9696-f40cd7470255 admin admin] PATH_INFO: `/v3/projects/2591afa3a80f44a4a79e98f5a249f0fd/users/45baacc2c1d24bbdafc9b5f4ed3604dc/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:03.329871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bdbb16-2282-49dc-b1e2-308d5cfcc58a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e46a7808e4146b88440e822bcbd2d4a, user_id=7030e257591a40a1938eee1f060fa47b, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:03.340831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bdbb16-2282-49dc-b1e2-308d5cfcc58a admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:03.365122 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44753a-1de8-4bb7-9696-f40cd7470255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2591afa3a80f44a4a79e98f5a249f0fd, user_id=45baacc2c1d24bbdafc9b5f4ed3604dc, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:03.368871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 826/1634] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:03 2022] PUT /identity/v3/projects/3e46a7808e4146b88440e822bcbd2d4a/users/7030e257591a40a1938eee1f060fa47b/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:03.371253 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44753a-1de8-4bb7-9696-f40cd7470255 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:03.372535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdbb16-2282-49dc-b1e2-308d5cfcc58a admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:03.405156 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 809/1635] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:03 2022] PUT /identity/v3/projects/2591afa3a80f44a4a79e98f5a249f0fd/users/45baacc2c1d24bbdafc9b5f4ed3604dc/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:03.407696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cce4c2-eef3-42eb-86ca-c02a6fcf4c1e None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:03.408436 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cce4c2-eef3-42eb-86ca-c02a6fcf4c1e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:03.408579 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cce4c2-eef3-42eb-86ca-c02a6fcf4c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:03.454861 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-a7cce4c2-eef3-42eb-86ca-c02a6fcf4c1e None None] MFA Rules not processed for user `6cdee0584fe045028a44c385d032d2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:03.458490 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a7cce4c2-eef3-42eb-86ca-c02a6fcf4c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:03.529103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:03.588201 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdbb16-2282-49dc-b1e2-308d5cfcc58a admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:03.643411 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 810/1636] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Oct 4 16:32:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:03.651748 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a53bd-044c-434a-96ce-c7d545d75238 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:03.652761 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a53bd-044c-434a-96ce-c7d545d75238 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:03.652761 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a53bd-044c-434a-96ce-c7d545d75238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:03.692501 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-024a53bd-044c-434a-96ce-c7d545d75238 None None] MFA Rules not processed for user `7030e257591a40a1938eee1f060fa47b`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:03.694440 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-024a53bd-044c-434a-96ce-c7d545d75238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:03.695783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e15da2-ccbc-40e9-8616-13d843696289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:03.697012 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e15da2-ccbc-40e9-8616-13d843696289 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:03.697356 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e15da2-ccbc-40e9-8616-13d843696289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:03.697662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e15da2-ccbc-40e9-8616-13d843696289 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:03.699034 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e15da2-ccbc-40e9-8616-13d843696289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:03.700657 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e15da2-ccbc-40e9-8616-13d843696289 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:03.720721 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 827/1637] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:03.721701 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e15da2-ccbc-40e9-8616-13d843696289 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:03.742246 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e15da2-ccbc-40e9-8616-13d843696289 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:03.747418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63da9f0-136e-4d04-83ef-13ba4375ff66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:03.748039 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63da9f0-136e-4d04-83ef-13ba4375ff66 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:03.748317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63da9f0-136e-4d04-83ef-13ba4375ff66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:03.748587 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63da9f0-136e-4d04-83ef-13ba4375ff66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:03.749236 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63da9f0-136e-4d04-83ef-13ba4375ff66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:03.750851 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63da9f0-136e-4d04-83ef-13ba4375ff66 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:03.763091 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 828/1638] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:03.764709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63da9f0-136e-4d04-83ef-13ba4375ff66 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:03.833301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 811/1639] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:03 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:03.835066 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a53bd-044c-434a-96ce-c7d545d75238 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:03.839468 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63da9f0-136e-4d04-83ef-13ba4375ff66 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:03.844657 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8a96e-ab63-4596-908e-98614790aced service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:03.845321 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8a96e-ab63-4596-908e-98614790aced service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:03.845597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8a96e-ab63-4596-908e-98614790aced service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:03.845868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8a96e-ab63-4596-908e-98614790aced service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:03.860095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad8a96e-ab63-4596-908e-98614790aced service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:03.862183 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad8a96e-ab63-4596-908e-98614790aced service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:03.876650 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a53bd-044c-434a-96ce-c7d545d75238 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:03.888559 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d33895-1f84-4bb9-a53e-e641b133dcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:03.891780 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d33895-1f84-4bb9-a53e-e641b133dcb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:03.892172 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d33895-1f84-4bb9-a53e-e641b133dcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:03.892628 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d33895-1f84-4bb9-a53e-e641b133dcb0 admin admin] PATH_INFO: `/v3/projects/558e08bf824e46729d917376bb8c7a28/users/7abd1772b8674027ae3d0d2f048dc20e/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:03.894465 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 829/1640] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:03.895264 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d33895-1f84-4bb9-a53e-e641b133dcb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=558e08bf824e46729d917376bb8c7a28, user_id=7abd1772b8674027ae3d0d2f048dc20e, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:03.897252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8a96e-ab63-4596-908e-98614790aced service cinder] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:03.903465 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d33895-1f84-4bb9-a53e-e641b133dcb0 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:03.919589 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 812/1641] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:03 2022] PUT /identity/v3/projects/558e08bf824e46729d917376bb8c7a28/users/7abd1772b8674027ae3d0d2f048dc20e/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:03.920656 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d33895-1f84-4bb9-a53e-e641b133dcb0 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:03.921892 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8a96e-ab63-4596-908e-98614790aced service cinder] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:03.986435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:04.036398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ad6b0-5ad1-431c-9539-b2fcaa89d6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:04.036545 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ad6b0-5ad1-431c-9539-b2fcaa89d6ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:04.036776 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ad6b0-5ad1-431c-9539-b2fcaa89d6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:04.037051 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ad6b0-5ad1-431c-9539-b2fcaa89d6ef admin admin] PATH_INFO: `/v3/projects/2591afa3a80f44a4a79e98f5a249f0fd/users/45baacc2c1d24bbdafc9b5f4ed3604dc/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:04.039106 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ad6b0-5ad1-431c-9539-b2fcaa89d6ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=2591afa3a80f44a4a79e98f5a249f0fd, user_id=45baacc2c1d24bbdafc9b5f4ed3604dc, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:04.042006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ad6b0-5ad1-431c-9539-b2fcaa89d6ef admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:04.055709 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d33895-1f84-4bb9-a53e-e641b133dcb0 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:04.064264 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 830/1642] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:03 2022] PUT /identity/v3/projects/2591afa3a80f44a4a79e98f5a249f0fd/users/45baacc2c1d24bbdafc9b5f4ed3604dc/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:04.070326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfbbc5-9ac9-4171-bb28-25fbc962751f None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:04.071246 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfbbc5-9ac9-4171-bb28-25fbc962751f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:04.071595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfbbc5-9ac9-4171-bb28-25fbc962751f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:04.096544 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:04.153420 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-c4dfbbc5-9ac9-4171-bb28-25fbc962751f None None] MFA Rules not processed for user `7abd1772b8674027ae3d0d2f048dc20e`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:04.155226 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-c4dfbbc5-9ac9-4171-bb28-25fbc962751f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:04.159946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca468fd2-f3e4-46c4-a17f-e0e22c3c9217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:04.160624 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca468fd2-f3e4-46c4-a17f-e0e22c3c9217 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:04.160903 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca468fd2-f3e4-46c4-a17f-e0e22c3c9217 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:04.161170 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca468fd2-f3e4-46c4-a17f-e0e22c3c9217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:04.299896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 831/1643] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:04.301540 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10724b-2397-406a-8bd7-7ae9d2acde7c None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:04.303496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10724b-2397-406a-8bd7-7ae9d2acde7c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:04.303905 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10724b-2397-406a-8bd7-7ae9d2acde7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:04.305088 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca468fd2-f3e4-46c4-a17f-e0e22c3c9217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:04.309888 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca468fd2-f3e4-46c4-a17f-e0e22c3c9217 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:04.329525 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 813/1644] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:03 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:04.333146 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacec03-3345-42dc-899d-a8ebb8238ad5 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:04.335484 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacec03-3345-42dc-899d-a8ebb8238ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:04.335984 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacec03-3345-42dc-899d-a8ebb8238ad5 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:04.339069 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 814/1645] 10.222.0.55 () {54 vars in 912 bytes} [Tue Oct 4 16:32:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:32:04.341914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacec03-3345-42dc-899d-a8ebb8238ad5 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:04.365109 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacec03-3345-42dc-899d-a8ebb8238ad5 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:04.367123 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-fc10724b-2397-406a-8bd7-7ae9d2acde7c None None] MFA Rules not processed for user `45baacc2c1d24bbdafc9b5f4ed3604dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:04.376331 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-fc10724b-2397-406a-8bd7-7ae9d2acde7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:04.376435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b319327-3971-477c-abee-257ca5b81cea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:04.376435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b319327-3971-477c-abee-257ca5b81cea service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:04.376435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b319327-3971-477c-abee-257ca5b81cea service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:04.377986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b319327-3971-477c-abee-257ca5b81cea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:04.395631 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b319327-3971-477c-abee-257ca5b81cea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:04.399265 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b319327-3971-477c-abee-257ca5b81cea service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:04.419237 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 815/1646] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:04.423941 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b77cb-e612-42cb-a170-2931e5ea055a None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:04.427266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b77cb-e612-42cb-a170-2931e5ea055a None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:04.427266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b77cb-e612-42cb-a170-2931e5ea055a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:04.479689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-642b77cb-e612-42cb-a170-2931e5ea055a None None] MFA Rules not processed for user `6cdee0584fe045028a44c385d032d2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:04.484029 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-642b77cb-e612-42cb-a170-2931e5ea055a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:04.552721 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 832/1647] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:04 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:04.553683 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10724b-2397-406a-8bd7-7ae9d2acde7c None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:04.665254 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 816/1648] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Oct 4 16:32:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:04.666334 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b77cb-e612-42cb-a170-2931e5ea055a None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:04.689143 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b77cb-e612-42cb-a170-2931e5ea055a None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:04.701201 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c63ce5-7027-470e-a521-9989fd3d3057 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:04.701991 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c63ce5-7027-470e-a521-9989fd3d3057 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:04.702381 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c63ce5-7027-470e-a521-9989fd3d3057 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:04.702771 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c63ce5-7027-470e-a521-9989fd3d3057 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:04.726446 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c63ce5-7027-470e-a521-9989fd3d3057 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:04.730384 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c63ce5-7027-470e-a521-9989fd3d3057 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:04.773244 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:04.794542 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 817/1649] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:04 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:04.796435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c63ce5-7027-470e-a521-9989fd3d3057 service cinder] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:04.803544 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10724b-2397-406a-8bd7-7ae9d2acde7c None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:04.821724 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c63ce5-7027-470e-a521-9989fd3d3057 service cinder] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:04.822773 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9e733-e12b-40ab-aadd-dff372fd50b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:04.823608 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9e733-e12b-40ab-aadd-dff372fd50b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:04.823877 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9e733-e12b-40ab-aadd-dff372fd50b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:04.826782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9e733-e12b-40ab-aadd-dff372fd50b7 admin admin] PATH_INFO: `/v3/users/3d86bf98584743288c09d78f6e0bcebc` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:04.829494 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9e733-e12b-40ab-aadd-dff372fd50b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d86bf98584743288c09d78f6e0bcebc)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:04.836946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b04f22-1822-4605-9067-2b7abed2f905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:04.838541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9e733-e12b-40ab-aadd-dff372fd50b7 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:04.838689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b04f22-1822-4605-9067-2b7abed2f905 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:04.838689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b04f22-1822-4605-9067-2b7abed2f905 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:04.838689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b04f22-1822-4605-9067-2b7abed2f905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:04.864774 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b04f22-1822-4605-9067-2b7abed2f905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:04.866921 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b04f22-1822-4605-9067-2b7abed2f905 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:04.888129 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:04.888486 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 818/1650] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:04.913053 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b04f22-1822-4605-9067-2b7abed2f905 service cinder] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:04.928640 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b04f22-1822-4605-9067-2b7abed2f905 service cinder] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:04.950001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a235c59-3b33-4362-8579-d469dee4f9d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:04.952210 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a235c59-3b33-4362-8579-d469dee4f9d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:04.955500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a235c59-3b33-4362-8579-d469dee4f9d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:04.956106 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a235c59-3b33-4362-8579-d469dee4f9d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:04.971303 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-2ae9e733-e12b-40ab-aadd-dff372fd50b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d86bf98584743288c09d78f6e0bcebc'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:04.974560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-2ae9e733-e12b-40ab-aadd-dff372fd50b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d86bf98584743288c09d78f6e0bcebc'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:04.995807 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-2ae9e733-e12b-40ab-aadd-dff372fd50b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d86bf98584743288c09d78f6e0bcebc'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:05.018912 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-2ae9e733-e12b-40ab-aadd-dff372fd50b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d86bf98584743288c09d78f6e0bcebc'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:05.019742 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-2ae9e733-e12b-40ab-aadd-dff372fd50b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d86bf98584743288c09d78f6e0bcebc'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:05.097231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 833/1651] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:32:04 2022] DELETE /identity/v3/users/3d86bf98584743288c09d78f6e0bcebc => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:05.099275 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23518624-0c62-49e7-b635-f5ee4d10f386 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:05.099939 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23518624-0c62-49e7-b635-f5ee4d10f386 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:05.100907 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23518624-0c62-49e7-b635-f5ee4d10f386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:05.119581 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a235c59-3b33-4362-8579-d469dee4f9d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:05.126684 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a235c59-3b33-4362-8579-d469dee4f9d4 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:05.153141 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 819/1652] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:05.154366 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-23518624-0c62-49e7-b635-f5ee4d10f386 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:05.174152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-23518624-0c62-49e7-b635-f5ee4d10f386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:05.177045 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a235c59-3b33-4362-8579-d469dee4f9d4 service cinder] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:05.192375 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a235c59-3b33-4362-8579-d469dee4f9d4 service cinder] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:05.313110 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 834/1653] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:05.314151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23518624-0c62-49e7-b635-f5ee4d10f386 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:05.316597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-23518624-0c62-49e7-b635-f5ee4d10f386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:05.342021 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61380d-93df-441c-a3da-f917bf22ee5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:05.344216 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61380d-93df-441c-a3da-f917bf22ee5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:05.344762 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61380d-93df-441c-a3da-f917bf22ee5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:05.346746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61380d-93df-441c-a3da-f917bf22ee5e admin admin] PATH_INFO: `/v3/users/9cc389daa96d443f9e0bee68c90bdab9` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:05.349332 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61380d-93df-441c-a3da-f917bf22ee5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cc389daa96d443f9e0bee68c90bdab9)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:05.350469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: WARNING py.warnings [None req-5a61380d-93df-441c-a3da-f917bf22ee5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 16:32:05.350469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: warnings.warn(msg) Oct 04 16:32:05.350469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: Oct 04 16:32:05.354865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61380d-93df-441c-a3da-f917bf22ee5e admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:05.492200 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23518624-0c62-49e7-b635-f5ee4d10f386 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:05.503550 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd826e08-6c98-41f1-9788-bb9ee53bc6bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:05.504349 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd826e08-6c98-41f1-9788-bb9ee53bc6bc service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:05.504781 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd826e08-6c98-41f1-9788-bb9ee53bc6bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:05.505147 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd826e08-6c98-41f1-9788-bb9ee53bc6bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:05.507098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-bd826e08-6c98-41f1-9788-bb9ee53bc6bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:05.549431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-5a61380d-93df-441c-a3da-f917bf22ee5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cc389daa96d443f9e0bee68c90bdab9'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:05.550376 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-5a61380d-93df-441c-a3da-f917bf22ee5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cc389daa96d443f9e0bee68c90bdab9'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:05.583642 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-5a61380d-93df-441c-a3da-f917bf22ee5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cc389daa96d443f9e0bee68c90bdab9'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:05.586241 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-5a61380d-93df-441c-a3da-f917bf22ee5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cc389daa96d443f9e0bee68c90bdab9'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:05.605890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:05.608250 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-5a61380d-93df-441c-a3da-f917bf22ee5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cc389daa96d443f9e0bee68c90bdab9'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:05.633229 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd826e08-6c98-41f1-9788-bb9ee53bc6bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:05.635222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd826e08-6c98-41f1-9788-bb9ee53bc6bc service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:05.663886 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 835/1654] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:05 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:05.664898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd826e08-6c98-41f1-9788-bb9ee53bc6bc service cinder] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:05.666541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-bd826e08-6c98-41f1-9788-bb9ee53bc6bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:05.683002 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 820/1655] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:32:05 2022] DELETE /identity/v3/users/9cc389daa96d443f9e0bee68c90bdab9 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:32:05.688881 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0334ce-88bf-4ccf-a92e-51ff912bc5e9 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:05.692456 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0334ce-88bf-4ccf-a92e-51ff912bc5e9 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:05.692456 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0334ce-88bf-4ccf-a92e-51ff912bc5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:05.722795 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:05.785098 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-fe0334ce-88bf-4ccf-a92e-51ff912bc5e9 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:05.790055 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-fe0334ce-88bf-4ccf-a92e-51ff912bc5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:05.889458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd826e08-6c98-41f1-9788-bb9ee53bc6bc service cinder] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:05.972630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 821/1656] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:06.019799 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e390e-90ce-4954-b933-0b3131ee6151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:06.020637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e390e-90ce-4954-b933-0b3131ee6151 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:06.021014 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e390e-90ce-4954-b933-0b3131ee6151 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:06.021500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e390e-90ce-4954-b933-0b3131ee6151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:06.026133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-261e390e-90ce-4954-b933-0b3131ee6151 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:06.058677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e390e-90ce-4954-b933-0b3131ee6151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:06.061444 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e390e-90ce-4954-b933-0b3131ee6151 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:06.095882 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 836/1657] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:06.108633 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0334ce-88bf-4ccf-a92e-51ff912bc5e9 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:06.111144 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-fe0334ce-88bf-4ccf-a92e-51ff912bc5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:06.130409 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0334ce-88bf-4ccf-a92e-51ff912bc5e9 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:06.140092 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95295a24-3327-4762-91af-c17b122271e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:06.141237 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95295a24-3327-4762-91af-c17b122271e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:06.141621 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95295a24-3327-4762-91af-c17b122271e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:06.141989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95295a24-3327-4762-91af-c17b122271e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:06.166915 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95295a24-3327-4762-91af-c17b122271e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:06.168700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95295a24-3327-4762-91af-c17b122271e1 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:06.192133 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 822/1658] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:07.228733 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e390e-90ce-4954-b933-0b3131ee6151 service neutron] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:07.230346 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-261e390e-90ce-4954-b933-0b3131ee6151 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:07.249969 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e390e-90ce-4954-b933-0b3131ee6151 service neutron] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:07.270408 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aafbba-0112-4566-ae8e-17c742d96b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:07.271504 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aafbba-0112-4566-ae8e-17c742d96b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:07.272333 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aafbba-0112-4566-ae8e-17c742d96b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:07.272613 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aafbba-0112-4566-ae8e-17c742d96b0c admin admin] PATH_INFO: `/v3/projects/070b55dc10444c51a1189153acc03506` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:07.273964 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aafbba-0112-4566-ae8e-17c742d96b0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=070b55dc10444c51a1189153acc03506)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:07.275524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: WARNING py.warnings [None req-e9aafbba-0112-4566-ae8e-17c742d96b0c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 16:32:07.275524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: warnings.warn(msg) Oct 04 16:32:07.275524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: Oct 04 16:32:07.277270 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aafbba-0112-4566-ae8e-17c742d96b0c admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:07.375284 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e9aafbba-0112-4566-ae8e-17c742d96b0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '070b55dc10444c51a1189153acc03506', 'request_id': 'req-e9aafbba-0112-4566-ae8e-17c742d96b0c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:07.395803 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e9aafbba-0112-4566-ae8e-17c742d96b0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '070b55dc10444c51a1189153acc03506', 'request_id': 'req-e9aafbba-0112-4566-ae8e-17c742d96b0c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:07.420493 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e9aafbba-0112-4566-ae8e-17c742d96b0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '070b55dc10444c51a1189153acc03506', 'request_id': 'req-e9aafbba-0112-4566-ae8e-17c742d96b0c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:07.439597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e9aafbba-0112-4566-ae8e-17c742d96b0c admin admin] The token cache is being invalidate because project 070b55dc10444c51a1189153acc03506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:32:07.439937 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e9aafbba-0112-4566-ae8e-17c742d96b0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:07.441435 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e9aafbba-0112-4566-ae8e-17c742d96b0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:07.447941 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95295a24-3327-4762-91af-c17b122271e1 service neutron] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:07.448673 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 837/1659] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:32:07 2022] DELETE /identity/v3/projects/070b55dc10444c51a1189153acc03506 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:07.466499 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95295a24-3327-4762-91af-c17b122271e1 service neutron] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:07.599394 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cc6ea-054e-4c60-b723-ecab0b0edb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:07.600401 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cc6ea-054e-4c60-b723-ecab0b0edb2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:07.600835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cc6ea-054e-4c60-b723-ecab0b0edb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:07.601341 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cc6ea-054e-4c60-b723-ecab0b0edb2f admin admin] PATH_INFO: `/v3/users/7030e257591a40a1938eee1f060fa47b` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:07.603869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cc6ea-054e-4c60-b723-ecab0b0edb2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7030e257591a40a1938eee1f060fa47b)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:07.606412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cc6ea-054e-4c60-b723-ecab0b0edb2f admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:07.755735 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-1b8cc6ea-054e-4c60-b723-ecab0b0edb2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7030e257591a40a1938eee1f060fa47b'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:07.757908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-1b8cc6ea-054e-4c60-b723-ecab0b0edb2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7030e257591a40a1938eee1f060fa47b'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:07.778001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-1b8cc6ea-054e-4c60-b723-ecab0b0edb2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7030e257591a40a1938eee1f060fa47b'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:07.779037 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-1b8cc6ea-054e-4c60-b723-ecab0b0edb2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7030e257591a40a1938eee1f060fa47b'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:07.796377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-1b8cc6ea-054e-4c60-b723-ecab0b0edb2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7030e257591a40a1938eee1f060fa47b'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:07.856828 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 823/1660] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:32:07 2022] DELETE /identity/v3/users/7030e257591a40a1938eee1f060fa47b => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:07.915551 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aafbba-0112-4566-ae8e-17c742d96b0c admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:07.918100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-e9aafbba-0112-4566-ae8e-17c742d96b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:07.946836 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aafbba-0112-4566-ae8e-17c742d96b0c admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:07.986267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:08.044638 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a466a-e05d-404d-9407-8b87562213d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:08.046040 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a466a-e05d-404d-9407-8b87562213d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:08.049508 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a466a-e05d-404d-9407-8b87562213d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:08.049979 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a466a-e05d-404d-9407-8b87562213d1 admin admin] PATH_INFO: `/v3/projects/c56030bb09a941a78cf3c6688922cdfd` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:08.054773 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a466a-e05d-404d-9407-8b87562213d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c56030bb09a941a78cf3c6688922cdfd)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:08.065732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a466a-e05d-404d-9407-8b87562213d1 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:08.189803 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5c3a466a-e05d-404d-9407-8b87562213d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c56030bb09a941a78cf3c6688922cdfd', 'request_id': 'req-5c3a466a-e05d-404d-9407-8b87562213d1'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:08.213488 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5c3a466a-e05d-404d-9407-8b87562213d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c56030bb09a941a78cf3c6688922cdfd', 'request_id': 'req-5c3a466a-e05d-404d-9407-8b87562213d1'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:08.226742 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5c3a466a-e05d-404d-9407-8b87562213d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c56030bb09a941a78cf3c6688922cdfd', 'request_id': 'req-5c3a466a-e05d-404d-9407-8b87562213d1'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:08.251496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5c3a466a-e05d-404d-9407-8b87562213d1 admin admin] The token cache is being invalidate because project c56030bb09a941a78cf3c6688922cdfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:32:08.252154 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5c3a466a-e05d-404d-9407-8b87562213d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:08.252382 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5c3a466a-e05d-404d-9407-8b87562213d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:08.255806 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 838/1661] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:32:07 2022] DELETE /identity/v3/projects/c56030bb09a941a78cf3c6688922cdfd => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:08.260011 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b25e9c-e8c6-432b-81e9-50d3686b7c83 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:08.260463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b25e9c-e8c6-432b-81e9-50d3686b7c83 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:08.260925 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b25e9c-e8c6-432b-81e9-50d3686b7c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:08.303773 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-37b25e9c-e8c6-432b-81e9-50d3686b7c83 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:08.306440 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-37b25e9c-e8c6-432b-81e9-50d3686b7c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:08.319512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:08.407662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 824/1662] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:08.416112 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a776a-52c1-454e-a78d-b44e742b799a None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:08.416763 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a776a-52c1-454e-a78d-b44e742b799a None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:08.417272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a776a-52c1-454e-a78d-b44e742b799a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:08.460396 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-ff0a776a-52c1-454e-a78d-b44e742b799a None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:08.462682 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ff0a776a-52c1-454e-a78d-b44e742b799a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:08.489409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 839/1663] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:08.495521 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b25e9c-e8c6-432b-81e9-50d3686b7c83 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:08.528541 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b25e9c-e8c6-432b-81e9-50d3686b7c83 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:08.543585 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82b5f5-6008-44d6-808b-e1dd0168bec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:08.544587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82b5f5-6008-44d6-808b-e1dd0168bec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:08.545956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82b5f5-6008-44d6-808b-e1dd0168bec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:08.546301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82b5f5-6008-44d6-808b-e1dd0168bec4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:08.548273 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82b5f5-6008-44d6-808b-e1dd0168bec4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:32:08.549913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82b5f5-6008-44d6-808b-e1dd0168bec4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:08.558720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82b5f5-6008-44d6-808b-e1dd0168bec4 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:08.597264 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 825/1664] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:32:08.602010 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a776a-52c1-454e-a78d-b44e742b799a None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:08.624226 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a776a-52c1-454e-a78d-b44e742b799a None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:08.633442 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e49b99-89f4-485d-a2a8-21857038e62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:08.634190 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e49b99-89f4-485d-a2a8-21857038e62a admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:08.634467 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e49b99-89f4-485d-a2a8-21857038e62a admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:08.634788 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e49b99-89f4-485d-a2a8-21857038e62a admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:08.635534 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e49b99-89f4-485d-a2a8-21857038e62a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:08.638315 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e49b99-89f4-485d-a2a8-21857038e62a admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:08.702886 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 840/1665] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:08 2022] POST /identity/v3/projects => generated 403 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:08.705668 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82b5f5-6008-44d6-808b-e1dd0168bec4 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:08.733364 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82b5f5-6008-44d6-808b-e1dd0168bec4 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:08.837988 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ee7d4-e3b2-4227-b928-a76f54139a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:08.838625 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ee7d4-e3b2-4227-b928-a76f54139a75 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:08.839948 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ee7d4-e3b2-4227-b928-a76f54139a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:08.840243 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ee7d4-e3b2-4227-b928-a76f54139a75 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:08.840956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ee7d4-e3b2-4227-b928-a76f54139a75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:08.843174 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ee7d4-e3b2-4227-b928-a76f54139a75 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:08.881749 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 826/1666] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:08 2022] POST /identity/v3/users => generated 302 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:32:08.889546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e49b99-89f4-485d-a2a8-21857038e62a admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:08.902847 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e49b99-89f4-485d-a2a8-21857038e62a admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:08.909590 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9758cf-49c4-4737-aed1-8ef53e8af053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:08.910234 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9758cf-49c4-4737-aed1-8ef53e8af053 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:08.910583 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9758cf-49c4-4737-aed1-8ef53e8af053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:08.911076 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9758cf-49c4-4737-aed1-8ef53e8af053 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:08.911843 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9758cf-49c4-4737-aed1-8ef53e8af053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:08.913869 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9758cf-49c4-4737-aed1-8ef53e8af053 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:08.929810 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 841/1667] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:08.934593 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ee7d4-e3b2-4227-b928-a76f54139a75 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:08.976087 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ee7d4-e3b2-4227-b928-a76f54139a75 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:09.009549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10185b9-7115-4ce5-ab76-05a899fcd4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:09.010357 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10185b9-7115-4ce5-ab76-05a899fcd4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:09.015654 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10185b9-7115-4ce5-ab76-05a899fcd4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:09.016064 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10185b9-7115-4ce5-ab76-05a899fcd4e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:09.016872 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10185b9-7115-4ce5-ab76-05a899fcd4e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:09.024275 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10185b9-7115-4ce5-ab76-05a899fcd4e5 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:09.091661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9758cf-49c4-4737-aed1-8ef53e8af053 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:09.115117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 827/1668] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:09.123530 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9758cf-49c4-4737-aed1-8ef53e8af053 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:09.160161 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb98708-f2c8-4f11-819e-604ca007cb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:09.160868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb98708-f2c8-4f11-819e-604ca007cb12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:09.161124 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb98708-f2c8-4f11-819e-604ca007cb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:09.161412 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb98708-f2c8-4f11-819e-604ca007cb12 admin admin] PATH_INFO: `/v3/projects/d2bfdace3f6d42a5b2dd07483e1f2c2d/users/ad9de3cb9dbc491592862cf589f1fd0d/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:09.203943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb98708-f2c8-4f11-819e-604ca007cb12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2bfdace3f6d42a5b2dd07483e1f2c2d, user_id=ad9de3cb9dbc491592862cf589f1fd0d, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:09.207320 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb98708-f2c8-4f11-819e-604ca007cb12 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:09.279350 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 842/1669] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:09 2022] PUT /identity/v3/projects/d2bfdace3f6d42a5b2dd07483e1f2c2d/users/ad9de3cb9dbc491592862cf589f1fd0d/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:32:09.297291 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cf6f9-b973-4b4f-856e-e23535d38522 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:09.297622 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cf6f9-b973-4b4f-856e-e23535d38522 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:09.298701 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cf6f9-b973-4b4f-856e-e23535d38522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:09.403514 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-c88cf6f9-b973-4b4f-856e-e23535d38522 None None] MFA Rules not processed for user `ad9de3cb9dbc491592862cf589f1fd0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:09.406926 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c88cf6f9-b973-4b4f-856e-e23535d38522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:09.597308 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 828/1670] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:09 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:09.600533 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb98708-f2c8-4f11-819e-604ca007cb12 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:09.749492 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:09.765566 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb98708-f2c8-4f11-819e-604ca007cb12 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:09.782347 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a631ec-4d39-4f23-81ea-54c70a409c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:09.783014 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a631ec-4d39-4f23-81ea-54c70a409c36 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:09.783768 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a631ec-4d39-4f23-81ea-54c70a409c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:09.783768 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a631ec-4d39-4f23-81ea-54c70a409c36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:09.784212 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a631ec-4d39-4f23-81ea-54c70a409c36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:09.786152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a631ec-4d39-4f23-81ea-54c70a409c36 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:09.865680 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 843/1671] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:09 2022] POST /identity/v3/projects => generated 403 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:09.869986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cf6f9-b973-4b4f-856e-e23535d38522 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:09.886733 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cf6f9-b973-4b4f-856e-e23535d38522 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:09.901500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:10.048544 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a458f5-9a7d-4150-9882-d0fabfbc1148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:10.055061 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a458f5-9a7d-4150-9882-d0fabfbc1148 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:10.055376 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a458f5-9a7d-4150-9882-d0fabfbc1148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:10.055621 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a458f5-9a7d-4150-9882-d0fabfbc1148 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:10.056301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a458f5-9a7d-4150-9882-d0fabfbc1148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:10.058600 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a458f5-9a7d-4150-9882-d0fabfbc1148 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:10.099325 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 829/1672] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:09 2022] POST /identity/v3/users => generated 308 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:10.103043 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a631ec-4d39-4f23-81ea-54c70a409c36 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:10.120510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a631ec-4d39-4f23-81ea-54c70a409c36 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:10.137596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c008a-fbd4-49f9-bc76-eabd5a2df2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:10.139152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c008a-fbd4-49f9-bc76-eabd5a2df2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:10.139465 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c008a-fbd4-49f9-bc76-eabd5a2df2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:10.139744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c008a-fbd4-49f9-bc76-eabd5a2df2e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:10.140537 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c008a-fbd4-49f9-bc76-eabd5a2df2e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:10.142232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c008a-fbd4-49f9-bc76-eabd5a2df2e0 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:10.164557 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 844/1673] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:10.170829 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a458f5-9a7d-4150-9882-d0fabfbc1148 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:10.183181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a458f5-9a7d-4150-9882-d0fabfbc1148 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:10.193850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65338aec-4032-4a79-9ede-1a6c4e98438b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:10.194554 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65338aec-4032-4a79-9ede-1a6c4e98438b admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:10.194856 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65338aec-4032-4a79-9ede-1a6c4e98438b admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:10.195173 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65338aec-4032-4a79-9ede-1a6c4e98438b admin admin] PATH_INFO: `/v3/projects/3c5c0caa7bc54705a76ffb0080862b82/users/f66dcd04a16546b98ce6cb3c1966c7f3/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:10.228247 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65338aec-4032-4a79-9ede-1a6c4e98438b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c5c0caa7bc54705a76ffb0080862b82, user_id=f66dcd04a16546b98ce6cb3c1966c7f3, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:10.231876 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65338aec-4032-4a79-9ede-1a6c4e98438b admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:10.268795 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 830/1674] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:10 2022] PUT /identity/v3/projects/3c5c0caa7bc54705a76ffb0080862b82/users/f66dcd04a16546b98ce6cb3c1966c7f3/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:10.273242 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c008a-fbd4-49f9-bc76-eabd5a2df2e0 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:10.306625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c008a-fbd4-49f9-bc76-eabd5a2df2e0 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:10.460435 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ee2c7-0c8f-4728-badb-42ab63148ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:10.461398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ee2c7-0c8f-4728-badb-42ab63148ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:10.461988 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ee2c7-0c8f-4728-badb-42ab63148ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:10.462479 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ee2c7-0c8f-4728-badb-42ab63148ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:10.463432 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ee2c7-0c8f-4728-badb-42ab63148ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:10.469758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ee2c7-0c8f-4728-badb-42ab63148ac2 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:10.509192 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 845/1675] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:10.510546 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65338aec-4032-4a79-9ede-1a6c4e98438b admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:10.534092 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65338aec-4032-4a79-9ede-1a6c4e98438b admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:10.540007 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04326885-b960-46ae-99d3-27e815e1f587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:10.543690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04326885-b960-46ae-99d3-27e815e1f587 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:10.544051 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04326885-b960-46ae-99d3-27e815e1f587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:10.544399 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04326885-b960-46ae-99d3-27e815e1f587 admin admin] PATH_INFO: `/v3/projects/3c5c0caa7bc54705a76ffb0080862b82/users/f66dcd04a16546b98ce6cb3c1966c7f3/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:10.547368 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04326885-b960-46ae-99d3-27e815e1f587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c5c0caa7bc54705a76ffb0080862b82, user_id=f66dcd04a16546b98ce6cb3c1966c7f3, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:10.562641 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04326885-b960-46ae-99d3-27e815e1f587 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:10.626508 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 831/1676] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:10 2022] PUT /identity/v3/projects/3c5c0caa7bc54705a76ffb0080862b82/users/f66dcd04a16546b98ce6cb3c1966c7f3/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:10.627891 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba5950-896f-4df3-b78e-c3a5e0a874be None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:10.628297 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba5950-896f-4df3-b78e-c3a5e0a874be None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:10.628752 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba5950-896f-4df3-b78e-c3a5e0a874be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:10.733734 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-1dba5950-896f-4df3-b78e-c3a5e0a874be None None] MFA Rules not processed for user `f66dcd04a16546b98ce6cb3c1966c7f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:10.737305 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-1dba5950-896f-4df3-b78e-c3a5e0a874be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:10.926358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04326885-b960-46ae-99d3-27e815e1f587 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:10.928223 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-04326885-b960-46ae-99d3-27e815e1f587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:10.994212 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 846/1677] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:10 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:11.006250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba5950-896f-4df3-b78e-c3a5e0a874be None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:11.008099 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-1dba5950-896f-4df3-b78e-c3a5e0a874be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:11.068651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04326885-b960-46ae-99d3-27e815e1f587 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:11.078873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d11f2-0e1b-432f-b094-21c967eb2e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:11.079759 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d11f2-0e1b-432f-b094-21c967eb2e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:11.080843 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d11f2-0e1b-432f-b094-21c967eb2e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:11.081250 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d11f2-0e1b-432f-b094-21c967eb2e39 admin admin] PATH_INFO: `/v3/projects/3e46a7808e4146b88440e822bcbd2d4a` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:11.082822 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d11f2-0e1b-432f-b094-21c967eb2e39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e46a7808e4146b88440e822bcbd2d4a)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:11.087785 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d11f2-0e1b-432f-b094-21c967eb2e39 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:11.148518 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba5950-896f-4df3-b78e-c3a5e0a874be None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:11.153502 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0054c5-3048-4db9-8db4-67286b241975 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:11.154322 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0054c5-3048-4db9-8db4-67286b241975 service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:11.154673 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0054c5-3048-4db9-8db4-67286b241975 service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:11.155056 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0054c5-3048-4db9-8db4-67286b241975 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:11.189402 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:11.197191 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0054c5-3048-4db9-8db4-67286b241975 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:11.200920 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0054c5-3048-4db9-8db4-67286b241975 service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:11.203556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-2e6d11f2-0e1b-432f-b094-21c967eb2e39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e46a7808e4146b88440e822bcbd2d4a', 'request_id': 'req-2e6d11f2-0e1b-432f-b094-21c967eb2e39'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:11.223523 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 847/1678] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:11 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:11.230219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-2e6d11f2-0e1b-432f-b094-21c967eb2e39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e46a7808e4146b88440e822bcbd2d4a', 'request_id': 'req-2e6d11f2-0e1b-432f-b094-21c967eb2e39'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:11.249462 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-2e6d11f2-0e1b-432f-b094-21c967eb2e39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e46a7808e4146b88440e822bcbd2d4a', 'request_id': 'req-2e6d11f2-0e1b-432f-b094-21c967eb2e39'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:11.254585 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:11.275906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-2e6d11f2-0e1b-432f-b094-21c967eb2e39 admin admin] The token cache is being invalidate because project 3e46a7808e4146b88440e822bcbd2d4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:32:11.276844 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-2e6d11f2-0e1b-432f-b094-21c967eb2e39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:11.278812 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-2e6d11f2-0e1b-432f-b094-21c967eb2e39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:11.303821 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 832/1679] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:32:10 2022] DELETE /identity/v3/projects/3e46a7808e4146b88440e822bcbd2d4a => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:32:11.305663 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c12eb-39a7-4d8f-9e29-434fb452208e None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:11.306369 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c12eb-39a7-4d8f-9e29-434fb452208e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:11.306369 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c12eb-39a7-4d8f-9e29-434fb452208e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:11.354189 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-199c12eb-39a7-4d8f-9e29-434fb452208e None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:11.355868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-199c12eb-39a7-4d8f-9e29-434fb452208e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:11.511260 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d11f2-0e1b-432f-b094-21c967eb2e39 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:11.512738 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-2e6d11f2-0e1b-432f-b094-21c967eb2e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:11.569031 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 848/1680] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:11.581860 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0a3ad-6828-41c9-8f78-d36d0b4f1dbc None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:11.582272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0a3ad-6828-41c9-8f78-d36d0b4f1dbc None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:11.582650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0a3ad-6828-41c9-8f78-d36d0b4f1dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:11.625562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-26d0a3ad-6828-41c9-8f78-d36d0b4f1dbc None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:11.627346 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-26d0a3ad-6828-41c9-8f78-d36d0b4f1dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:11.670859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 849/1681] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:11.672553 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0a3ad-6828-41c9-8f78-d36d0b4f1dbc None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:11.695127 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0a3ad-6828-41c9-8f78-d36d0b4f1dbc None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:11.701989 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97eb6a8-8f38-4ab0-9add-f3c1e536cdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:11.702895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97eb6a8-8f38-4ab0-9add-f3c1e536cdc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:11.703186 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97eb6a8-8f38-4ab0-9add-f3c1e536cdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:11.703795 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97eb6a8-8f38-4ab0-9add-f3c1e536cdc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:11.704576 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97eb6a8-8f38-4ab0-9add-f3c1e536cdc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:32:11.704933 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97eb6a8-8f38-4ab0-9add-f3c1e536cdc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:11.706741 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97eb6a8-8f38-4ab0-9add-f3c1e536cdc8 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:11.724280 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 850/1682] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:32:11.730599 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97eb6a8-8f38-4ab0-9add-f3c1e536cdc8 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:11.759294 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d11f2-0e1b-432f-b094-21c967eb2e39 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:11.766385 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97eb6a8-8f38-4ab0-9add-f3c1e536cdc8 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:11.775607 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad42ca0-6577-4932-8ac7-d71185e09ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:11.776325 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad42ca0-6577-4932-8ac7-d71185e09ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:11.784401 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad42ca0-6577-4932-8ac7-d71185e09ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:11.784401 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad42ca0-6577-4932-8ac7-d71185e09ce0 admin admin] PATH_INFO: `/v3/users/ad9de3cb9dbc491592862cf589f1fd0d` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:11.786308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ced95-b8de-48d1-9120-b96522cc716a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:11.787043 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ced95-b8de-48d1-9120-b96522cc716a admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:11.787374 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ced95-b8de-48d1-9120-b96522cc716a admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:11.787820 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ced95-b8de-48d1-9120-b96522cc716a admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:11.788117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad42ca0-6577-4932-8ac7-d71185e09ce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad9de3cb9dbc491592862cf589f1fd0d)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:11.788527 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ced95-b8de-48d1-9120-b96522cc716a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:11.791303 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ced95-b8de-48d1-9120-b96522cc716a admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:11.792432 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad42ca0-6577-4932-8ac7-d71185e09ce0 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:11.876363 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 851/1683] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:11 2022] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:11.879561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ced95-b8de-48d1-9120-b96522cc716a admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:11.934498 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-1ad42ca0-6577-4932-8ac7-d71185e09ce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad9de3cb9dbc491592862cf589f1fd0d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:11.935216 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-1ad42ca0-6577-4932-8ac7-d71185e09ce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad9de3cb9dbc491592862cf589f1fd0d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:11.954185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-1ad42ca0-6577-4932-8ac7-d71185e09ce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad9de3cb9dbc491592862cf589f1fd0d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:11.956346 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-1ad42ca0-6577-4932-8ac7-d71185e09ce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad9de3cb9dbc491592862cf589f1fd0d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:11.983321 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-1ad42ca0-6577-4932-8ac7-d71185e09ce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad9de3cb9dbc491592862cf589f1fd0d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:12.020673 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 833/1684] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:32:11 2022] DELETE /identity/v3/users/ad9de3cb9dbc491592862cf589f1fd0d => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:12.025629 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cd319-efc8-4fdb-bdfe-7153c9be6bae None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:12.025957 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cd319-efc8-4fdb-bdfe-7153c9be6bae None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:12.026324 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cd319-efc8-4fdb-bdfe-7153c9be6bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:12.085457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-4d2cd319-efc8-4fdb-bdfe-7153c9be6bae None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:12.088781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-4d2cd319-efc8-4fdb-bdfe-7153c9be6bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:12.142037 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ced95-b8de-48d1-9120-b96522cc716a admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:12.304051 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef187d4-3ac3-477a-944a-834d97143f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:12.304818 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef187d4-3ac3-477a-944a-834d97143f66 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:12.305186 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef187d4-3ac3-477a-944a-834d97143f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:12.305463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef187d4-3ac3-477a-944a-834d97143f66 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:12.306406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef187d4-3ac3-477a-944a-834d97143f66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:12.308761 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef187d4-3ac3-477a-944a-834d97143f66 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:12.333358 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:12.334694 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 834/1685] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:32:12.365414 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 852/1686] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:11 2022] POST /identity/v3/users => generated 283 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:12.367327 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cd319-efc8-4fdb-bdfe-7153c9be6bae None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:12.367446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef187d4-3ac3-477a-944a-834d97143f66 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:12.369432 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-4ef187d4-3ac3-477a-944a-834d97143f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:12.370278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-4d2cd319-efc8-4fdb-bdfe-7153c9be6bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:12.385499 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cd319-efc8-4fdb-bdfe-7153c9be6bae None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:12.393589 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8e21a-12f7-4f3b-ae6e-83a30051f249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:12.395456 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8e21a-12f7-4f3b-ae6e-83a30051f249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:12.395910 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef187d4-3ac3-477a-944a-834d97143f66 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:12.396045 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8e21a-12f7-4f3b-ae6e-83a30051f249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:12.396444 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8e21a-12f7-4f3b-ae6e-83a30051f249 admin admin] PATH_INFO: `/v3/users/e7872cc1213c4d09bf0a8f76f10dbbe8` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:12.398911 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8e21a-12f7-4f3b-ae6e-83a30051f249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7872cc1213c4d09bf0a8f76f10dbbe8)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:12.402195 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8e21a-12f7-4f3b-ae6e-83a30051f249 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:12.406511 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:12.407237 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575be3db-d22e-478c-8dc7-6644bd2c0e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:12.408423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575be3db-d22e-478c-8dc7-6644bd2c0e10 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:12.408879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575be3db-d22e-478c-8dc7-6644bd2c0e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:12.409302 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575be3db-d22e-478c-8dc7-6644bd2c0e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:12.410106 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575be3db-d22e-478c-8dc7-6644bd2c0e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:12.420282 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575be3db-d22e-478c-8dc7-6644bd2c0e10 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:12.467208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 853/1687] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:12.470329 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575be3db-d22e-478c-8dc7-6644bd2c0e10 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:12.474127 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-575be3db-d22e-478c-8dc7-6644bd2c0e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:12.599513 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f3c8e21a-12f7-4f3b-ae6e-83a30051f249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7872cc1213c4d09bf0a8f76f10dbbe8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:12.601041 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f3c8e21a-12f7-4f3b-ae6e-83a30051f249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7872cc1213c4d09bf0a8f76f10dbbe8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:12.631780 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f3c8e21a-12f7-4f3b-ae6e-83a30051f249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7872cc1213c4d09bf0a8f76f10dbbe8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:12.633292 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f3c8e21a-12f7-4f3b-ae6e-83a30051f249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7872cc1213c4d09bf0a8f76f10dbbe8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:12.651824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f3c8e21a-12f7-4f3b-ae6e-83a30051f249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7872cc1213c4d09bf0a8f76f10dbbe8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:12.685374 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575be3db-d22e-478c-8dc7-6644bd2c0e10 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:12.703471 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed07e6-9478-4642-ad98-c207ed3adb2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:12.704470 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed07e6-9478-4642-ad98-c207ed3adb2e service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:12.704983 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed07e6-9478-4642-ad98-c207ed3adb2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:12.705481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed07e6-9478-4642-ad98-c207ed3adb2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:12.705822 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 835/1688] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:32:12 2022] DELETE /identity/v3/users/e7872cc1213c4d09bf0a8f76f10dbbe8 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:12.706885 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8e21a-12f7-4f3b-ae6e-83a30051f249 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:12.709249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-f1ed07e6-9478-4642-ad98-c207ed3adb2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:12.713247 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f3c8e21a-12f7-4f3b-ae6e-83a30051f249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:12.731658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed07e6-9478-4642-ad98-c207ed3adb2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:12.735799 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed07e6-9478-4642-ad98-c207ed3adb2e service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:12.773284 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 854/1689] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:12.775534 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa65ad-06f3-4504-b9c2-e2b762e3f50a None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:12.780055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa65ad-06f3-4504-b9c2-e2b762e3f50a None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:12.780790 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa65ad-06f3-4504-b9c2-e2b762e3f50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:12.868631 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8e21a-12f7-4f3b-ae6e-83a30051f249 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:12.887527 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd009a-db4a-4c8d-87a9-f193ae397fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:12.889278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd009a-db4a-4c8d-87a9-f193ae397fff admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:12.889751 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd009a-db4a-4c8d-87a9-f193ae397fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:12.890217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd009a-db4a-4c8d-87a9-f193ae397fff admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:12.893496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd009a-db4a-4c8d-87a9-f193ae397fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:12.896292 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd009a-db4a-4c8d-87a9-f193ae397fff admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:12.918258 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 836/1690] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:12.922523 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58f5ae-7324-4a3c-a232-17d96c04edc5 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:12.923359 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-bffa65ad-06f3-4504-b9c2-e2b762e3f50a None None] MFA Rules not processed for user `fd7782e68436445395dd49bf7d8302e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:12.923463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58f5ae-7324-4a3c-a232-17d96c04edc5 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:12.924401 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58f5ae-7324-4a3c-a232-17d96c04edc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:12.924584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-bffa65ad-06f3-4504-b9c2-e2b762e3f50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:12.972507 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-7f58f5ae-7324-4a3c-a232-17d96c04edc5 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:12.973869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-7f58f5ae-7324-4a3c-a232-17d96c04edc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:12.983207 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 837/1691] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:12.984095 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58f5ae-7324-4a3c-a232-17d96c04edc5 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:12.996057 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58f5ae-7324-4a3c-a232-17d96c04edc5 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:13.001299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0139d73-13ef-4c17-9e82-23d082c11e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:13.002426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0139d73-13ef-4c17-9e82-23d082c11e41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:13.002770 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0139d73-13ef-4c17-9e82-23d082c11e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:13.003148 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0139d73-13ef-4c17-9e82-23d082c11e41 admin admin] PATH_INFO: `/v3/projects/5372806467ef43acad0775ece37d74d3/users/126a989b0076458eab37df691a335bd4/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:13.033577 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0139d73-13ef-4c17-9e82-23d082c11e41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5372806467ef43acad0775ece37d74d3, user_id=126a989b0076458eab37df691a335bd4, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:13.036628 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0139d73-13ef-4c17-9e82-23d082c11e41 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:13.067221 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 838/1692] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:12 2022] PUT /identity/v3/projects/5372806467ef43acad0775ece37d74d3/users/126a989b0076458eab37df691a335bd4/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:13.067221 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0139d73-13ef-4c17-9e82-23d082c11e41 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:13.067221 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-d0139d73-13ef-4c17-9e82-23d082c11e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:13.112840 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 855/1693] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:13.113358 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41565212-a73e-4406-9731-81dcb6def6f4 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:13.113645 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41565212-a73e-4406-9731-81dcb6def6f4 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:13.113920 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41565212-a73e-4406-9731-81dcb6def6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:13.185214 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-41565212-a73e-4406-9731-81dcb6def6f4 None None] MFA Rules not processed for user `126a989b0076458eab37df691a335bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:13.186476 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-41565212-a73e-4406-9731-81dcb6def6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:13.243542 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:13.257150 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0139d73-13ef-4c17-9e82-23d082c11e41 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:13.272343 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c0c35-5a0a-4bf5-82b5-c0a2d188e616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:13.273173 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c0c35-5a0a-4bf5-82b5-c0a2d188e616 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:13.273690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c0c35-5a0a-4bf5-82b5-c0a2d188e616 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:13.274050 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c0c35-5a0a-4bf5-82b5-c0a2d188e616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:13.400945 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:13.421525 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 856/1694] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:13.425208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41565212-a73e-4406-9731-81dcb6def6f4 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:13.428453 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-41565212-a73e-4406-9731-81dcb6def6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:13.459282 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c0c35-5a0a-4bf5-82b5-c0a2d188e616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:13.460848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c0c35-5a0a-4bf5-82b5-c0a2d188e616 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:13.497619 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 839/1695] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:13.507968 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953f785-1182-48e3-b9e7-42279b0600b2 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:13.508258 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953f785-1182-48e3-b9e7-42279b0600b2 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:13.508530 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953f785-1182-48e3-b9e7-42279b0600b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:13.613383 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-8953f785-1182-48e3-b9e7-42279b0600b2 None None] MFA Rules not processed for user `ca1807ed523647849b30021b0f309fcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:13.616471 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-8953f785-1182-48e3-b9e7-42279b0600b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:13.677566 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41565212-a73e-4406-9731-81dcb6def6f4 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:13.693674 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a912c8-beff-4c85-a365-45269dbe7260 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:13.695936 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a912c8-beff-4c85-a365-45269dbe7260 service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:13.696204 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a912c8-beff-4c85-a365-45269dbe7260 service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:13.696488 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a912c8-beff-4c85-a365-45269dbe7260 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:13.803933 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 840/1696] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:13.805194 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953f785-1182-48e3-b9e7-42279b0600b2 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:13.833029 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953f785-1182-48e3-b9e7-42279b0600b2 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:13.855436 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1732bd-8291-4dab-82bd-b3eccb7b17a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:13.858147 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1732bd-8291-4dab-82bd-b3eccb7b17a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:13.858362 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1732bd-8291-4dab-82bd-b3eccb7b17a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:13.858635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1732bd-8291-4dab-82bd-b3eccb7b17a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:13.859317 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1732bd-8291-4dab-82bd-b3eccb7b17a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:13.866736 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1732bd-8291-4dab-82bd-b3eccb7b17a1 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:13.873734 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a912c8-beff-4c85-a365-45269dbe7260 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:13.881485 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a912c8-beff-4c85-a365-45269dbe7260 service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:13.927726 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 857/1697] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:13.933918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd11b90-7854-4362-8c87-495df55970bb None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:13.934338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd11b90-7854-4362-8c87-495df55970bb None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:13.934623 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd11b90-7854-4362-8c87-495df55970bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:13.986860 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 841/1698] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:13 2022] POST /identity/v3/projects => generated 367 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:13.997703 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1732bd-8291-4dab-82bd-b3eccb7b17a1 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:14.025090 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-ddd11b90-7854-4362-8c87-495df55970bb None None] MFA Rules not processed for user `ca1807ed523647849b30021b0f309fcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:14.027174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ddd11b90-7854-4362-8c87-495df55970bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:14.155209 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1732bd-8291-4dab-82bd-b3eccb7b17a1 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:14.173373 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8d62a-5552-4d8c-bfc2-eeb92456902a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:14.174014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8d62a-5552-4d8c-bfc2-eeb92456902a admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:14.174291 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8d62a-5552-4d8c-bfc2-eeb92456902a admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:14.174559 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8d62a-5552-4d8c-bfc2-eeb92456902a admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:14.176525 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 858/1699] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:14.176745 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8d62a-5552-4d8c-bfc2-eeb92456902a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:14.178738 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8d62a-5552-4d8c-bfc2-eeb92456902a admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:14.190437 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd11b90-7854-4362-8c87-495df55970bb None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:14.192184 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ddd11b90-7854-4362-8c87-495df55970bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:14.227905 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:14.259888 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 842/1700] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:13 2022] POST /identity/v3/users => generated 290 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:14.261318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8d62a-5552-4d8c-bfc2-eeb92456902a admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:14.282515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8d62a-5552-4d8c-bfc2-eeb92456902a admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:14.293546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:14.298747 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21b307-314d-40eb-a0e5-e6986a8bd58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:14.301804 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21b307-314d-40eb-a0e5-e6986a8bd58d admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:14.302304 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21b307-314d-40eb-a0e5-e6986a8bd58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:14.304500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21b307-314d-40eb-a0e5-e6986a8bd58d admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:14.305222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21b307-314d-40eb-a0e5-e6986a8bd58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:14.310522 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21b307-314d-40eb-a0e5-e6986a8bd58d admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:14.337299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 843/1701] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:14.338291 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21b307-314d-40eb-a0e5-e6986a8bd58d admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:14.362890 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21b307-314d-40eb-a0e5-e6986a8bd58d admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:14.365970 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd11b90-7854-4362-8c87-495df55970bb None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:14.374972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97574ae0-a8eb-4d67-a554-1b5a11a7c2a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:14.375795 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97574ae0-a8eb-4d67-a554-1b5a11a7c2a1 service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:14.376419 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97574ae0-a8eb-4d67-a554-1b5a11a7c2a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:14.376852 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712354a-091f-4913-b5ca-5187fd8ec3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:14.376976 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97574ae0-a8eb-4d67-a554-1b5a11a7c2a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:14.377547 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712354a-091f-4913-b5ca-5187fd8ec3a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:14.377823 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712354a-091f-4913-b5ca-5187fd8ec3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:14.378094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712354a-091f-4913-b5ca-5187fd8ec3a0 admin admin] PATH_INFO: `/v3/projects/9dd2fbf25e6a476daeff4d21f26e0c93/users/5ea7b9be20ab442fab2e8ffa296fed9f/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:14.391385 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97574ae0-a8eb-4d67-a554-1b5a11a7c2a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:14.393544 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97574ae0-a8eb-4d67-a554-1b5a11a7c2a1 service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:14.424226 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 859/1702] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:14.426496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97574ae0-a8eb-4d67-a554-1b5a11a7c2a1 service nova] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:14.433713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-97574ae0-a8eb-4d67-a554-1b5a11a7c2a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:14.438452 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712354a-091f-4913-b5ca-5187fd8ec3a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd2fbf25e6a476daeff4d21f26e0c93, user_id=5ea7b9be20ab442fab2e8ffa296fed9f, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:14.459131 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712354a-091f-4913-b5ca-5187fd8ec3a0 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:14.498964 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97574ae0-a8eb-4d67-a554-1b5a11a7c2a1 service nova] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:14.502268 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 844/1703] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:14 2022] PUT /identity/v3/projects/9dd2fbf25e6a476daeff4d21f26e0c93/users/5ea7b9be20ab442fab2e8ffa296fed9f/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:14.511081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712354a-091f-4913-b5ca-5187fd8ec3a0 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:14.674216 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d198c-4a73-45e9-8f2e-2f9eb6efd9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:14.675105 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d198c-4a73-45e9-8f2e-2f9eb6efd9a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:14.675486 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d198c-4a73-45e9-8f2e-2f9eb6efd9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:14.675856 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d198c-4a73-45e9-8f2e-2f9eb6efd9a3 admin admin] PATH_INFO: `/v3/projects/d2bfdace3f6d42a5b2dd07483e1f2c2d` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:14.678508 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d198c-4a73-45e9-8f2e-2f9eb6efd9a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2bfdace3f6d42a5b2dd07483e1f2c2d)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:14.680645 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d198c-4a73-45e9-8f2e-2f9eb6efd9a3 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:14.703420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712354a-091f-4913-b5ca-5187fd8ec3a0 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:14.715543 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83782a70-b911-421f-9944-0f4044028f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:14.716198 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83782a70-b911-421f-9944-0f4044028f83 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:14.716513 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83782a70-b911-421f-9944-0f4044028f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:14.716784 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83782a70-b911-421f-9944-0f4044028f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:14.717438 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83782a70-b911-421f-9944-0f4044028f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:14.719312 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83782a70-b911-421f-9944-0f4044028f83 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:14.744651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 845/1704] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:14.745989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83782a70-b911-421f-9944-0f4044028f83 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:14.771241 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83782a70-b911-421f-9944-0f4044028f83 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:14.783589 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-047d198c-4a73-45e9-8f2e-2f9eb6efd9a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2bfdace3f6d42a5b2dd07483e1f2c2d', 'request_id': 'req-047d198c-4a73-45e9-8f2e-2f9eb6efd9a3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:14.807526 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-047d198c-4a73-45e9-8f2e-2f9eb6efd9a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2bfdace3f6d42a5b2dd07483e1f2c2d', 'request_id': 'req-047d198c-4a73-45e9-8f2e-2f9eb6efd9a3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:14.815190 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-047d198c-4a73-45e9-8f2e-2f9eb6efd9a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2bfdace3f6d42a5b2dd07483e1f2c2d', 'request_id': 'req-047d198c-4a73-45e9-8f2e-2f9eb6efd9a3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:14.855162 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-047d198c-4a73-45e9-8f2e-2f9eb6efd9a3 admin admin] The token cache is being invalidate because project d2bfdace3f6d42a5b2dd07483e1f2c2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:32:14.855465 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-047d198c-4a73-45e9-8f2e-2f9eb6efd9a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:14.857615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-047d198c-4a73-45e9-8f2e-2f9eb6efd9a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:14.859721 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 860/1705] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:32:14 2022] DELETE /identity/v3/projects/d2bfdace3f6d42a5b2dd07483e1f2c2d => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:14.871335 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d198c-4a73-45e9-8f2e-2f9eb6efd9a3 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:14.879118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-047d198c-4a73-45e9-8f2e-2f9eb6efd9a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:14.893426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e6682-a578-4248-888c-ce994488975c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:14.894188 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e6682-a578-4248-888c-ce994488975c admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:14.894465 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e6682-a578-4248-888c-ce994488975c admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:14.894737 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e6682-a578-4248-888c-ce994488975c admin admin] PATH_INFO: `/v3/projects/9dd2fbf25e6a476daeff4d21f26e0c93/users/5ea7b9be20ab442fab2e8ffa296fed9f/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:14.899453 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e6682-a578-4248-888c-ce994488975c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd2fbf25e6a476daeff4d21f26e0c93, user_id=5ea7b9be20ab442fab2e8ffa296fed9f, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:14.902226 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e6682-a578-4248-888c-ce994488975c admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:14.914082 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d198c-4a73-45e9-8f2e-2f9eb6efd9a3 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:14.938223 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 846/1706] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:14 2022] PUT /identity/v3/projects/9dd2fbf25e6a476daeff4d21f26e0c93/users/5ea7b9be20ab442fab2e8ffa296fed9f/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:14.939827 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ac9aa-9bd2-489b-a9aa-066849de3725 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:14.940108 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ac9aa-9bd2-489b-a9aa-066849de3725 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:14.940378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ac9aa-9bd2-489b-a9aa-066849de3725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:15.006889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-a46ac9aa-9bd2-489b-a9aa-066849de3725 None None] MFA Rules not processed for user `5ea7b9be20ab442fab2e8ffa296fed9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:15.008179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a46ac9aa-9bd2-489b-a9aa-066849de3725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:15.027077 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:15.041304 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e5888-15f2-4056-876e-725f7c024845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:15.045476 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e5888-15f2-4056-876e-725f7c024845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:15.046373 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e5888-15f2-4056-876e-725f7c024845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:15.046676 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e5888-15f2-4056-876e-725f7c024845 admin admin] PATH_INFO: `/v3/users/f66dcd04a16546b98ce6cb3c1966c7f3` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:15.049446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e5888-15f2-4056-876e-725f7c024845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f66dcd04a16546b98ce6cb3c1966c7f3)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:15.051735 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e5888-15f2-4056-876e-725f7c024845 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:15.111351 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:15.164935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8b1e5888-15f2-4056-876e-725f7c024845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f66dcd04a16546b98ce6cb3c1966c7f3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:15.165878 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8b1e5888-15f2-4056-876e-725f7c024845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f66dcd04a16546b98ce6cb3c1966c7f3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:15.181475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 847/1707] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:15.196134 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ac9aa-9bd2-489b-a9aa-066849de3725 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:15.198023 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a46ac9aa-9bd2-489b-a9aa-066849de3725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:15.206157 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8b1e5888-15f2-4056-876e-725f7c024845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f66dcd04a16546b98ce6cb3c1966c7f3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:15.255531 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8b1e5888-15f2-4056-876e-725f7c024845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f66dcd04a16546b98ce6cb3c1966c7f3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:15.257455 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8b1e5888-15f2-4056-876e-725f7c024845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f66dcd04a16546b98ce6cb3c1966c7f3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:15.321259 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 861/1708] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:32:14 2022] DELETE /identity/v3/users/f66dcd04a16546b98ce6cb3c1966c7f3 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:15.370886 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ac9aa-9bd2-489b-a9aa-066849de3725 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:15.517022 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd2396-d441-48b6-a809-99b59d86d68a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:15.519821 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd2396-d441-48b6-a809-99b59d86d68a service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:15.520148 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd2396-d441-48b6-a809-99b59d86d68a service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:15.520486 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd2396-d441-48b6-a809-99b59d86d68a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:15.525138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c9cd2396-d441-48b6-a809-99b59d86d68a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:15.683946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd2396-d441-48b6-a809-99b59d86d68a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:15.685105 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd2396-d441-48b6-a809-99b59d86d68a service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:15.711403 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 848/1709] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:32:15.933699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e5888-15f2-4056-876e-725f7c024845 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:15.935834 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8b1e5888-15f2-4056-876e-725f7c024845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:15.963495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e5888-15f2-4056-876e-725f7c024845 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:15.983314 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11538b3-5aa0-4c18-aa4c-d39f1a7f08a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:15.984085 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11538b3-5aa0-4c18-aa4c-d39f1a7f08a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:15.984463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11538b3-5aa0-4c18-aa4c-d39f1a7f08a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:15.984797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11538b3-5aa0-4c18-aa4c-d39f1a7f08a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:15.991748 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b11538b3-5aa0-4c18-aa4c-d39f1a7f08a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:16.071114 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd2396-d441-48b6-a809-99b59d86d68a service cinder] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:16.072787 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c9cd2396-d441-48b6-a809-99b59d86d68a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:16.193159 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:16.221232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11538b3-5aa0-4c18-aa4c-d39f1a7f08a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:16.222723 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11538b3-5aa0-4c18-aa4c-d39f1a7f08a8 service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:16.247666 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd2396-d441-48b6-a809-99b59d86d68a service cinder] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:16.260618 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f3fd8-39d9-47af-b60a-4210f0ab0a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:16.261237 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f3fd8-39d9-47af-b60a-4210f0ab0a6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:16.261512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f3fd8-39d9-47af-b60a-4210f0ab0a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:16.261834 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f3fd8-39d9-47af-b60a-4210f0ab0a6d admin admin] PATH_INFO: `/v3/projects/74693854606748efb3cff910f53c9c54` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:16.263233 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f3fd8-39d9-47af-b60a-4210f0ab0a6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=74693854606748efb3cff910f53c9c54)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:16.271955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f3fd8-39d9-47af-b60a-4210f0ab0a6d admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:16.272295 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 862/1710] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:16.276808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09524ed4-5921-44aa-83bb-be6d8f73eb9b None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:16.277285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09524ed4-5921-44aa-83bb-be6d8f73eb9b None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:16.277699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09524ed4-5921-44aa-83bb-be6d8f73eb9b None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:16.279450 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 863/1711] 10.222.0.55 () {54 vars in 912 bytes} [Tue Oct 4 16:32:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:32:16.289554 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de80f3-9efa-4675-9a31-64ec3c79a368 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:16.295813 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de80f3-9efa-4675-9a31-64ec3c79a368 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:16.296700 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de80f3-9efa-4675-9a31-64ec3c79a368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:16.401284 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-03de80f3-9efa-4675-9a31-64ec3c79a368 None None] MFA Rules not processed for user `d6ae980afbfd49dea9bbb0adc02b9031`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:16.405938 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-03de80f3-9efa-4675-9a31-64ec3c79a368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:16.418171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ee4f3fd8-39d9-47af-b60a-4210f0ab0a6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74693854606748efb3cff910f53c9c54', 'request_id': 'req-ee4f3fd8-39d9-47af-b60a-4210f0ab0a6d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:16.439528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ee4f3fd8-39d9-47af-b60a-4210f0ab0a6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74693854606748efb3cff910f53c9c54', 'request_id': 'req-ee4f3fd8-39d9-47af-b60a-4210f0ab0a6d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:16.451330 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ee4f3fd8-39d9-47af-b60a-4210f0ab0a6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74693854606748efb3cff910f53c9c54', 'request_id': 'req-ee4f3fd8-39d9-47af-b60a-4210f0ab0a6d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:16.499655 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ee4f3fd8-39d9-47af-b60a-4210f0ab0a6d admin admin] The token cache is being invalidate because project 74693854606748efb3cff910f53c9c54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:32:16.499973 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ee4f3fd8-39d9-47af-b60a-4210f0ab0a6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:16.504028 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ee4f3fd8-39d9-47af-b60a-4210f0ab0a6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:16.512492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 849/1712] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:32:16 2022] DELETE /identity/v3/projects/74693854606748efb3cff910f53c9c54 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:32:16.516397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f3fd8-39d9-47af-b60a-4210f0ab0a6d admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:16.518443 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ee4f3fd8-39d9-47af-b60a-4210f0ab0a6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:16.547197 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 864/1713] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Oct 4 16:32:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:16.606738 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de80f3-9efa-4675-9a31-64ec3c79a368 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:16.611042 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-03de80f3-9efa-4675-9a31-64ec3c79a368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:16.630103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de80f3-9efa-4675-9a31-64ec3c79a368 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:16.657711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cc308-544a-4196-8349-6faa6d584a1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:16.660110 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cc308-544a-4196-8349-6faa6d584a1c service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:16.660617 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cc308-544a-4196-8349-6faa6d584a1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:16.662937 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cc308-544a-4196-8349-6faa6d584a1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:16.702454 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cc308-544a-4196-8349-6faa6d584a1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:16.717207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cc308-544a-4196-8349-6faa6d584a1c service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:16.737276 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:16.746185 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 865/1714] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:32:16.746623 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f3fd8-39d9-47af-b60a-4210f0ab0a6d admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:16.760059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66430af6-cea0-472d-9fd8-151233334d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:16.760842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66430af6-cea0-472d-9fd8-151233334d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:16.761118 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66430af6-cea0-472d-9fd8-151233334d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:16.761593 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66430af6-cea0-472d-9fd8-151233334d3c admin admin] PATH_INFO: `/v3/users/45baacc2c1d24bbdafc9b5f4ed3604dc` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:16.767117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66430af6-cea0-472d-9fd8-151233334d3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=45baacc2c1d24bbdafc9b5f4ed3604dc)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:16.770356 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66430af6-cea0-472d-9fd8-151233334d3c admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:16.878510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-66430af6-cea0-472d-9fd8-151233334d3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45baacc2c1d24bbdafc9b5f4ed3604dc'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:16.880233 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-66430af6-cea0-472d-9fd8-151233334d3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45baacc2c1d24bbdafc9b5f4ed3604dc'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:16.893764 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-66430af6-cea0-472d-9fd8-151233334d3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45baacc2c1d24bbdafc9b5f4ed3604dc'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:16.894515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-66430af6-cea0-472d-9fd8-151233334d3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45baacc2c1d24bbdafc9b5f4ed3604dc'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:16.921584 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-66430af6-cea0-472d-9fd8-151233334d3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45baacc2c1d24bbdafc9b5f4ed3604dc'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:16.958435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:16.996147 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 850/1715] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:32:16 2022] DELETE /identity/v3/users/45baacc2c1d24bbdafc9b5f4ed3604dc => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:17.697237 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cc308-544a-4196-8349-6faa6d584a1c service neutron] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:17.699730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b62cc308-544a-4196-8349-6faa6d584a1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:17.740006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cc308-544a-4196-8349-6faa6d584a1c service neutron] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:17.901897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c1463-6aaa-4a0e-86a9-149fc0e164bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:17.902613 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c1463-6aaa-4a0e-86a9-149fc0e164bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:17.902893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c1463-6aaa-4a0e-86a9-149fc0e164bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:17.903209 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c1463-6aaa-4a0e-86a9-149fc0e164bd admin admin] PATH_INFO: `/v3/projects/3c5c0caa7bc54705a76ffb0080862b82` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:17.904611 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c1463-6aaa-4a0e-86a9-149fc0e164bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c5c0caa7bc54705a76ffb0080862b82)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:17.906745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c1463-6aaa-4a0e-86a9-149fc0e164bd admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:17.999510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f97c1463-6aaa-4a0e-86a9-149fc0e164bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c5c0caa7bc54705a76ffb0080862b82', 'request_id': 'req-f97c1463-6aaa-4a0e-86a9-149fc0e164bd'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:18.028615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f97c1463-6aaa-4a0e-86a9-149fc0e164bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c5c0caa7bc54705a76ffb0080862b82', 'request_id': 'req-f97c1463-6aaa-4a0e-86a9-149fc0e164bd'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:18.038677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f97c1463-6aaa-4a0e-86a9-149fc0e164bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c5c0caa7bc54705a76ffb0080862b82', 'request_id': 'req-f97c1463-6aaa-4a0e-86a9-149fc0e164bd'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:18.067160 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f97c1463-6aaa-4a0e-86a9-149fc0e164bd admin admin] The token cache is being invalidate because project 3c5c0caa7bc54705a76ffb0080862b82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:32:18.067906 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f97c1463-6aaa-4a0e-86a9-149fc0e164bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:18.071380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f97c1463-6aaa-4a0e-86a9-149fc0e164bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:18.073109 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 866/1716] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:32:17 2022] DELETE /identity/v3/projects/3c5c0caa7bc54705a76ffb0080862b82 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:18.078296 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b087696-1275-48ad-9b40-5a8943f21615 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:18.078811 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b087696-1275-48ad-9b40-5a8943f21615 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:18.078886 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b087696-1275-48ad-9b40-5a8943f21615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:18.147922 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-8b087696-1275-48ad-9b40-5a8943f21615 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:18.149179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-8b087696-1275-48ad-9b40-5a8943f21615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:18.321064 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 851/1717] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:18.331214 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06964642-41f8-4349-bcbf-973f34eb44d0 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:18.331809 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06964642-41f8-4349-bcbf-973f34eb44d0 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:18.332703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06964642-41f8-4349-bcbf-973f34eb44d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:18.375642 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-06964642-41f8-4349-bcbf-973f34eb44d0 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:18.377071 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-06964642-41f8-4349-bcbf-973f34eb44d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:18.401808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 867/1718] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:18.406345 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b087696-1275-48ad-9b40-5a8943f21615 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:18.422210 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b087696-1275-48ad-9b40-5a8943f21615 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:18.443870 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64010950-c3f7-4a5d-94d5-cbd67df0712b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:18.444579 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64010950-c3f7-4a5d-94d5-cbd67df0712b admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:18.444931 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64010950-c3f7-4a5d-94d5-cbd67df0712b admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:18.445301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64010950-c3f7-4a5d-94d5-cbd67df0712b admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:18.453581 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64010950-c3f7-4a5d-94d5-cbd67df0712b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:32:18.453967 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64010950-c3f7-4a5d-94d5-cbd67df0712b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:18.455981 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64010950-c3f7-4a5d-94d5-cbd67df0712b admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:18.495611 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 852/1719] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:32:18.499891 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06964642-41f8-4349-bcbf-973f34eb44d0 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:18.514162 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06964642-41f8-4349-bcbf-973f34eb44d0 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:18.524813 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b4fa0-eca2-4517-8947-333f9daf2983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:18.525452 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b4fa0-eca2-4517-8947-333f9daf2983 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:18.525731 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b4fa0-eca2-4517-8947-333f9daf2983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:18.526027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b4fa0-eca2-4517-8947-333f9daf2983 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:18.526692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b4fa0-eca2-4517-8947-333f9daf2983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:18.528653 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b4fa0-eca2-4517-8947-333f9daf2983 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:18.623232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 868/1720] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:18 2022] POST /identity/v3/projects => generated 403 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:18.627345 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64010950-c3f7-4a5d-94d5-cbd67df0712b admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:18.639821 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64010950-c3f7-4a5d-94d5-cbd67df0712b admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:18.769843 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077dc154-5cc1-4f3f-a852-5b44b41d0033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:18.772002 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077dc154-5cc1-4f3f-a852-5b44b41d0033 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:18.772432 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077dc154-5cc1-4f3f-a852-5b44b41d0033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:18.772834 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077dc154-5cc1-4f3f-a852-5b44b41d0033 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:18.778231 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077dc154-5cc1-4f3f-a852-5b44b41d0033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:18.781456 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077dc154-5cc1-4f3f-a852-5b44b41d0033 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:18.847747 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 853/1721] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:18 2022] POST /identity/v3/users => generated 302 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:18.851524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b4fa0-eca2-4517-8947-333f9daf2983 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:18.866112 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b4fa0-eca2-4517-8947-333f9daf2983 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:18.879702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f583fca-a516-4f44-a19f-1740235ea716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:18.882700 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f583fca-a516-4f44-a19f-1740235ea716 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:18.883043 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f583fca-a516-4f44-a19f-1740235ea716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:18.883283 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f583fca-a516-4f44-a19f-1740235ea716 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:18.883952 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f583fca-a516-4f44-a19f-1740235ea716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:18.890286 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f583fca-a516-4f44-a19f-1740235ea716 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:18.939246 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 869/1722] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:18.943642 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077dc154-5cc1-4f3f-a852-5b44b41d0033 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:18.966533 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077dc154-5cc1-4f3f-a852-5b44b41d0033 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:18.980825 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e91b2-0dbd-4acc-9e35-606dd8d20c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:18.981493 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e91b2-0dbd-4acc-9e35-606dd8d20c09 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:18.981743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e91b2-0dbd-4acc-9e35-606dd8d20c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:18.982067 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e91b2-0dbd-4acc-9e35-606dd8d20c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:18.983534 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e91b2-0dbd-4acc-9e35-606dd8d20c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:18.986718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e91b2-0dbd-4acc-9e35-606dd8d20c09 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:19.019416 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f583fca-a516-4f44-a19f-1740235ea716 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:19.021695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 854/1723] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:19.031495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f583fca-a516-4f44-a19f-1740235ea716 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:19.051611 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8593ce1-3b7f-42a9-be46-4b37d4545586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:19.052362 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8593ce1-3b7f-42a9-be46-4b37d4545586 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:19.052645 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8593ce1-3b7f-42a9-be46-4b37d4545586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:19.052906 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8593ce1-3b7f-42a9-be46-4b37d4545586 admin admin] PATH_INFO: `/v3/projects/8e3382a59d5c4823b081686e37d5cbb1/users/95d242046f554c28a338351b7f580695/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:19.105709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8593ce1-3b7f-42a9-be46-4b37d4545586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e3382a59d5c4823b081686e37d5cbb1, user_id=95d242046f554c28a338351b7f580695, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:19.124254 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8593ce1-3b7f-42a9-be46-4b37d4545586 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:19.180088 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 870/1724] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:19 2022] PUT /identity/v3/projects/8e3382a59d5c4823b081686e37d5cbb1/users/95d242046f554c28a338351b7f580695/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:19.185731 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f0abe-0d67-455b-9afa-7f2f4759eb05 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:19.186326 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f0abe-0d67-455b-9afa-7f2f4759eb05 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:19.186326 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f0abe-0d67-455b-9afa-7f2f4759eb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:19.247552 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-fa2f0abe-0d67-455b-9afa-7f2f4759eb05 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:19.255439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-fa2f0abe-0d67-455b-9afa-7f2f4759eb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:19.453476 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:19.486599 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8593ce1-3b7f-42a9-be46-4b37d4545586 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:19.489491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-a8593ce1-3b7f-42a9-be46-4b37d4545586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:19.503726 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 855/1725] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:19.591169 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:19.708379 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f0abe-0d67-455b-9afa-7f2f4759eb05 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:19.709864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-fa2f0abe-0d67-455b-9afa-7f2f4759eb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:19.806923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8593ce1-3b7f-42a9-be46-4b37d4545586 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:19.830586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68281ccc-b69f-4b33-ab0e-95ec4ccb4221 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd59eac06e347ee9432185b24fdf773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:19.834208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68281ccc-b69f-4b33-ab0e-95ec4ccb4221 service placement] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:19.834498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68281ccc-b69f-4b33-ab0e-95ec4ccb4221 service placement] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:19.834778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68281ccc-b69f-4b33-ab0e-95ec4ccb4221 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:19.843358 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-68281ccc-b69f-4b33-ab0e-95ec4ccb4221 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:19.859829 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f0abe-0d67-455b-9afa-7f2f4759eb05 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:19.872583 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db98715-1ca2-4b18-99d6-288213e37e7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:19.875434 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db98715-1ca2-4b18-99d6-288213e37e7f service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:19.876336 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68281ccc-b69f-4b33-ab0e-95ec4ccb4221 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:19.878927 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68281ccc-b69f-4b33-ab0e-95ec4ccb4221 service placement] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:19.879665 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db98715-1ca2-4b18-99d6-288213e37e7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:19.880016 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db98715-1ca2-4b18-99d6-288213e37e7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:19.910532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 871/1726] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:19.911512 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68281ccc-b69f-4b33-ab0e-95ec4ccb4221 service placement] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:19.916914 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-68281ccc-b69f-4b33-ab0e-95ec4ccb4221 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:19.917504 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db98715-1ca2-4b18-99d6-288213e37e7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:19.922070 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db98715-1ca2-4b18-99d6-288213e37e7f service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:19.946167 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 856/1727] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:19.979538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68281ccc-b69f-4b33-ab0e-95ec4ccb4221 service placement] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:19.999011 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73760def-2038-4207-80a8-7b74f4b90917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:19.999690 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73760def-2038-4207-80a8-7b74f4b90917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:19.999970 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73760def-2038-4207-80a8-7b74f4b90917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:20.000242 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73760def-2038-4207-80a8-7b74f4b90917 admin admin] PATH_INFO: `/v3/projects/2591afa3a80f44a4a79e98f5a249f0fd` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:20.005671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73760def-2038-4207-80a8-7b74f4b90917 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2591afa3a80f44a4a79e98f5a249f0fd)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:20.007676 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73760def-2038-4207-80a8-7b74f4b90917 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:20.171789 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-73760def-2038-4207-80a8-7b74f4b90917 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2591afa3a80f44a4a79e98f5a249f0fd', 'request_id': 'req-73760def-2038-4207-80a8-7b74f4b90917'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:20.182638 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-73760def-2038-4207-80a8-7b74f4b90917 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2591afa3a80f44a4a79e98f5a249f0fd', 'request_id': 'req-73760def-2038-4207-80a8-7b74f4b90917'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:20.192255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-73760def-2038-4207-80a8-7b74f4b90917 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2591afa3a80f44a4a79e98f5a249f0fd', 'request_id': 'req-73760def-2038-4207-80a8-7b74f4b90917'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:20.213308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-73760def-2038-4207-80a8-7b74f4b90917 admin admin] The token cache is being invalidate because project 2591afa3a80f44a4a79e98f5a249f0fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:32:20.213897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-73760def-2038-4207-80a8-7b74f4b90917 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:20.217503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-73760def-2038-4207-80a8-7b74f4b90917 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:20.220117 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 872/1728] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:32:19 2022] DELETE /identity/v3/projects/2591afa3a80f44a4a79e98f5a249f0fd => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:20.225719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f7705-eb06-4a77-bbec-acc963929baf None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:20.226223 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f7705-eb06-4a77-bbec-acc963929baf None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:20.226688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f7705-eb06-4a77-bbec-acc963929baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:20.286470 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-de3f7705-eb06-4a77-bbec-acc963929baf None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:20.288536 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-de3f7705-eb06-4a77-bbec-acc963929baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:20.464127 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a1fa4-c149-4b2d-a618-51ae6aec6ead None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:20.464533 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a1fa4-c149-4b2d-a618-51ae6aec6ead None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:20.464841 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a1fa4-c149-4b2d-a618-51ae6aec6ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:20.548716 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-201a1fa4-c149-4b2d-a618-51ae6aec6ead None None] MFA Rules not processed for user `b505541b5fe8494fa9ae8777e7add970`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:20.550633 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-201a1fa4-c149-4b2d-a618-51ae6aec6ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:20.574869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 857/1729] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:20.581345 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dff5e9-f903-4564-b878-3b4da858dbe0 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:20.581825 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dff5e9-f903-4564-b878-3b4da858dbe0 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:20.582976 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dff5e9-f903-4564-b878-3b4da858dbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:20.609904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-82dff5e9-f903-4564-b878-3b4da858dbe0 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:20.611611 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-82dff5e9-f903-4564-b878-3b4da858dbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:20.624426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 858/1730] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:20.629155 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dff5e9-f903-4564-b878-3b4da858dbe0 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:20.641804 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dff5e9-f903-4564-b878-3b4da858dbe0 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:20.648955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca250d5a-9a5e-4d9a-a00d-1cdb21c571ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:20.651169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca250d5a-9a5e-4d9a-a00d-1cdb21c571ab admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:20.651609 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca250d5a-9a5e-4d9a-a00d-1cdb21c571ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:20.654716 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca250d5a-9a5e-4d9a-a00d-1cdb21c571ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:20.655795 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca250d5a-9a5e-4d9a-a00d-1cdb21c571ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:32:20.657533 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca250d5a-9a5e-4d9a-a00d-1cdb21c571ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:20.665259 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca250d5a-9a5e-4d9a-a00d-1cdb21c571ab admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:20.696909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 859/1731] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:32:20.699711 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca250d5a-9a5e-4d9a-a00d-1cdb21c571ab admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:20.732031 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 873/1732] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:20.733159 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca250d5a-9a5e-4d9a-a00d-1cdb21c571ab admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:20.747445 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a1fa4-c149-4b2d-a618-51ae6aec6ead None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:20.749060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-201a1fa4-c149-4b2d-a618-51ae6aec6ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:20.760398 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa554b20-6905-4eee-bd7b-88dbaea1eef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:20.764675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa554b20-6905-4eee-bd7b-88dbaea1eef8 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:20.765165 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa554b20-6905-4eee-bd7b-88dbaea1eef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:20.765537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa554b20-6905-4eee-bd7b-88dbaea1eef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:20.766442 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa554b20-6905-4eee-bd7b-88dbaea1eef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:20.768951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa554b20-6905-4eee-bd7b-88dbaea1eef8 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:20.857057 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:20.866850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 860/1733] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:20 2022] POST /identity/v3/projects => generated 409 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:20.873782 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa554b20-6905-4eee-bd7b-88dbaea1eef8 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:21.002591 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:21.007152 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa554b20-6905-4eee-bd7b-88dbaea1eef8 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:21.033170 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a1fa4-c149-4b2d-a618-51ae6aec6ead None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:21.046653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcf21a-fe0c-4dd1-bef2-b863176939d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:21.047831 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcf21a-fe0c-4dd1-bef2-b863176939d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:21.048315 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcf21a-fe0c-4dd1-bef2-b863176939d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:21.048781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcf21a-fe0c-4dd1-bef2-b863176939d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:21.050292 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bcf21a-fe0c-4dd1-bef2-b863176939d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:21.057209 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bcf21a-fe0c-4dd1-bef2-b863176939d0 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:21.124098 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 861/1734] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:20 2022] POST /identity/v3/users => generated 305 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:32:21.130438 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcf21a-fe0c-4dd1-bef2-b863176939d0 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:21.173586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcf21a-fe0c-4dd1-bef2-b863176939d0 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:21.192939 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974f4ef-8ba9-4d6d-a01e-ac77805b428b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:21.193884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974f4ef-8ba9-4d6d-a01e-ac77805b428b admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:21.195596 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974f4ef-8ba9-4d6d-a01e-ac77805b428b admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:21.197468 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974f4ef-8ba9-4d6d-a01e-ac77805b428b admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:21.198383 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974f4ef-8ba9-4d6d-a01e-ac77805b428b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:21.205035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974f4ef-8ba9-4d6d-a01e-ac77805b428b admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:21.243567 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 862/1735] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:21.249494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974f4ef-8ba9-4d6d-a01e-ac77805b428b admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:21.271769 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974f4ef-8ba9-4d6d-a01e-ac77805b428b admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:21.278252 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99b7ea-443d-4ec9-b62b-50ec851d1e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:21.279333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99b7ea-443d-4ec9-b62b-50ec851d1e66 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:21.280030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99b7ea-443d-4ec9-b62b-50ec851d1e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:21.281038 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99b7ea-443d-4ec9-b62b-50ec851d1e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:21.281904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99b7ea-443d-4ec9-b62b-50ec851d1e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:21.286339 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0511f9e-1622-404f-96b7-014ee377345a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:21.289104 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0511f9e-1622-404f-96b7-014ee377345a service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:21.289388 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0511f9e-1622-404f-96b7-014ee377345a service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:21.289656 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0511f9e-1622-404f-96b7-014ee377345a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:21.294312 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99b7ea-443d-4ec9-b62b-50ec851d1e66 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:21.317860 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 863/1736] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:21.321724 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99b7ea-443d-4ec9-b62b-50ec851d1e66 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:21.335228 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99b7ea-443d-4ec9-b62b-50ec851d1e66 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:21.342551 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20463e9-17fc-4c4a-9e3b-4441ee7109cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:21.343601 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20463e9-17fc-4c4a-9e3b-4441ee7109cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:21.344362 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20463e9-17fc-4c4a-9e3b-4441ee7109cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:21.344871 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20463e9-17fc-4c4a-9e3b-4441ee7109cd admin admin] PATH_INFO: `/v3/projects/66f55c3c9232499d843e19e8df323c51/users/2f0c7f6122164f0cb8e3486104463ca3/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:21.372026 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20463e9-17fc-4c4a-9e3b-4441ee7109cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f55c3c9232499d843e19e8df323c51, user_id=2f0c7f6122164f0cb8e3486104463ca3, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:21.385562 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20463e9-17fc-4c4a-9e3b-4441ee7109cd admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:21.417665 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 864/1737] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:21 2022] PUT /identity/v3/projects/66f55c3c9232499d843e19e8df323c51/users/2f0c7f6122164f0cb8e3486104463ca3/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:21.443418 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7f589-b913-441c-9b73-45cc06fa4409 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:21.446385 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7f589-b913-441c-9b73-45cc06fa4409 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:21.446684 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7f589-b913-441c-9b73-45cc06fa4409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:21.460266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0511f9e-1622-404f-96b7-014ee377345a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:21.461905 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0511f9e-1622-404f-96b7-014ee377345a service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:21.487450 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 874/1738] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 741 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:21.539995 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-19a7f589-b913-441c-9b73-45cc06fa4409 None None] MFA Rules not processed for user `2f0c7f6122164f0cb8e3486104463ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:21.545799 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-19a7f589-b913-441c-9b73-45cc06fa4409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:21.722951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 865/1739] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:21 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:21.727561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0511f9e-1622-404f-96b7-014ee377345a service nova] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:21.743143 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0511f9e-1622-404f-96b7-014ee377345a service nova] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:21.874406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1f276-de73-4e8b-960b-eefa265652bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:21.875072 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1f276-de73-4e8b-960b-eefa265652bd admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:21.875353 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1f276-de73-4e8b-960b-eefa265652bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:21.875692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1f276-de73-4e8b-960b-eefa265652bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:21.876261 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1f276-de73-4e8b-960b-eefa265652bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:21.881391 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1f276-de73-4e8b-960b-eefa265652bd admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:21.898844 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:21.945664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 875/1740] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:21 2022] POST /identity/v3/projects => generated 409 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:32:21.950285 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7f589-b913-441c-9b73-45cc06fa4409 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:21.968902 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7f589-b913-441c-9b73-45cc06fa4409 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:22.015230 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94026dbb-e1c6-47f1-9688-6d8ab7296b8c None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:22.015523 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94026dbb-e1c6-47f1-9688-6d8ab7296b8c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:22.016447 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94026dbb-e1c6-47f1-9688-6d8ab7296b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:22.052041 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-94026dbb-e1c6-47f1-9688-6d8ab7296b8c None None] MFA Rules not processed for user `fd7782e68436445395dd49bf7d8302e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:22.053430 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-94026dbb-e1c6-47f1-9688-6d8ab7296b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:22.243349 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 876/1741] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:22.288592 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc83a1-ca16-4534-a4c6-431b7fe79ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:22.298001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc83a1-ca16-4534-a4c6-431b7fe79ffc admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:22.300676 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc83a1-ca16-4534-a4c6-431b7fe79ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:22.308273 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc83a1-ca16-4534-a4c6-431b7fe79ffc admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:22.311964 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc83a1-ca16-4534-a4c6-431b7fe79ffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:22.324615 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc83a1-ca16-4534-a4c6-431b7fe79ffc admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:22.414052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 866/1742] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:21 2022] POST /identity/v3/users => generated 311 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:22.415723 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94026dbb-e1c6-47f1-9688-6d8ab7296b8c None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:22.440698 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94026dbb-e1c6-47f1-9688-6d8ab7296b8c None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:22.468891 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937dfb1-3168-4fe3-a406-3fb84bf10a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:22.469692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937dfb1-3168-4fe3-a406-3fb84bf10a63 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:22.470045 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937dfb1-3168-4fe3-a406-3fb84bf10a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:22.470579 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937dfb1-3168-4fe3-a406-3fb84bf10a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:22.471662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937dfb1-3168-4fe3-a406-3fb84bf10a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:22.475828 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937dfb1-3168-4fe3-a406-3fb84bf10a63 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:22.493607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 877/1743] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:22.494943 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc83a1-ca16-4534-a4c6-431b7fe79ffc admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:22.509309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc83a1-ca16-4534-a4c6-431b7fe79ffc admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:22.521013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d74fe7-8e26-4044-a797-db74712e0f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:22.527356 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d74fe7-8e26-4044-a797-db74712e0f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:22.527577 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d74fe7-8e26-4044-a797-db74712e0f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:22.527838 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d74fe7-8e26-4044-a797-db74712e0f45 admin admin] PATH_INFO: `/v3/projects/8dc91c3d02a14d1ba8a001f6530c87f7/users/a9aefa1370f547289e9abdc6d022d637/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:22.560313 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d74fe7-8e26-4044-a797-db74712e0f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc91c3d02a14d1ba8a001f6530c87f7, user_id=a9aefa1370f547289e9abdc6d022d637, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:22.568493 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d74fe7-8e26-4044-a797-db74712e0f45 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:22.584144 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:22.606856 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 867/1744] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:22 2022] PUT /identity/v3/projects/8dc91c3d02a14d1ba8a001f6530c87f7/users/a9aefa1370f547289e9abdc6d022d637/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:22.611025 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937dfb1-3168-4fe3-a406-3fb84bf10a63 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:22.630283 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937dfb1-3168-4fe3-a406-3fb84bf10a63 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:22.805533 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92bb59-ac0a-4d9b-a624-716a4c31605a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:22.806345 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92bb59-ac0a-4d9b-a624-716a4c31605a admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:22.806767 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92bb59-ac0a-4d9b-a624-716a4c31605a admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:22.807397 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92bb59-ac0a-4d9b-a624-716a4c31605a admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:22.808195 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92bb59-ac0a-4d9b-a624-716a4c31605a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:22.809990 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92bb59-ac0a-4d9b-a624-716a4c31605a admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:22.846421 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 878/1745] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:22.847836 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d74fe7-8e26-4044-a797-db74712e0f45 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:22.886702 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d74fe7-8e26-4044-a797-db74712e0f45 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:22.893222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c26847-39e1-4188-8760-ba11831492aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:22.894081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c26847-39e1-4188-8760-ba11831492aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:22.894502 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c26847-39e1-4188-8760-ba11831492aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:22.894784 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c26847-39e1-4188-8760-ba11831492aa admin admin] PATH_INFO: `/v3/projects/8dc91c3d02a14d1ba8a001f6530c87f7/users/a9aefa1370f547289e9abdc6d022d637/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:22.901549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c26847-39e1-4188-8760-ba11831492aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc91c3d02a14d1ba8a001f6530c87f7, user_id=a9aefa1370f547289e9abdc6d022d637, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:22.911309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c26847-39e1-4188-8760-ba11831492aa admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:22.935695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 868/1746] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:22 2022] PUT /identity/v3/projects/8dc91c3d02a14d1ba8a001f6530c87f7/users/a9aefa1370f547289e9abdc6d022d637/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:22.950075 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fbd09-6477-4426-b216-d4c984f02016 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:22.950573 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fbd09-6477-4426-b216-d4c984f02016 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:22.950863 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fbd09-6477-4426-b216-d4c984f02016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:23.014231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-5c4fbd09-6477-4426-b216-d4c984f02016 None None] MFA Rules not processed for user `a9aefa1370f547289e9abdc6d022d637`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:23.018573 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-5c4fbd09-6477-4426-b216-d4c984f02016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:23.263234 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 879/1747] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:22 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:23.271584 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c26847-39e1-4188-8760-ba11831492aa admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:23.273966 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-80c26847-39e1-4188-8760-ba11831492aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:23.467679 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83e66c-031a-41a8-a359-d427df50afbf None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:23.468692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83e66c-031a-41a8-a359-d427df50afbf None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:23.469086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83e66c-031a-41a8-a359-d427df50afbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:23.481148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:23.510944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c26847-39e1-4188-8760-ba11831492aa admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:23.529413 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f7553-922a-4822-8e8d-e53c16839b8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:23.530057 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f7553-922a-4822-8e8d-e53c16839b8b service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:23.530340 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f7553-922a-4822-8e8d-e53c16839b8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:23.533734 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f7553-922a-4822-8e8d-e53c16839b8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:23.556643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-9d83e66c-031a-41a8-a359-d427df50afbf None None] MFA Rules not processed for user `95d242046f554c28a338351b7f580695`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:23.558083 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-9d83e66c-031a-41a8-a359-d427df50afbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:23.565762 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f7553-922a-4822-8e8d-e53c16839b8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:23.568632 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f7553-922a-4822-8e8d-e53c16839b8b service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:23.632214 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 869/1748] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:23 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:23.633846 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2cc5d-06a9-405f-bac0-bd6e0b40ae70 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:23.634235 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2cc5d-06a9-405f-bac0-bd6e0b40ae70 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:23.634606 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2cc5d-06a9-405f-bac0-bd6e0b40ae70 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:23.645670 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 870/1749] 10.222.0.55 () {54 vars in 912 bytes} [Tue Oct 4 16:32:23 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:32:23.655878 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634aeb7c-32f2-4695-80f9-03d9548da731 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:23.656176 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634aeb7c-32f2-4695-80f9-03d9548da731 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:23.656449 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634aeb7c-32f2-4695-80f9-03d9548da731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:23.775409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 880/1750] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:23 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:23.779729 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f2234-96fb-4e68-ac61-5a2ca8fac33f None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:23.780142 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f2234-96fb-4e68-ac61-5a2ca8fac33f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:23.780888 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f2234-96fb-4e68-ac61-5a2ca8fac33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:23.781699 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-634aeb7c-32f2-4695-80f9-03d9548da731 None None] MFA Rules not processed for user `d6ae980afbfd49dea9bbb0adc02b9031`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:23.785713 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-634aeb7c-32f2-4695-80f9-03d9548da731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:23.894292 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-d75f2234-96fb-4e68-ac61-5a2ca8fac33f None None] MFA Rules not processed for user `06aca6bb76ec4290b591d9c7a5a6c5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:23.909881 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-d75f2234-96fb-4e68-ac61-5a2ca8fac33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:23.912017 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 871/1751] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Oct 4 16:32:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:23.919163 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634aeb7c-32f2-4695-80f9-03d9548da731 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:23.928358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-634aeb7c-32f2-4695-80f9-03d9548da731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:24.174825 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 881/1752] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:24.178286 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f2234-96fb-4e68-ac61-5a2ca8fac33f None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:24.185761 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-d75f2234-96fb-4e68-ac61-5a2ca8fac33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:24.220182 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634aeb7c-32f2-4695-80f9-03d9548da731 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:24.234436 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224543f-31b7-4164-bdba-7d1b4df8903b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:24.235655 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224543f-31b7-4164-bdba-7d1b4df8903b admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:24.236129 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224543f-31b7-4164-bdba-7d1b4df8903b admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:24.236592 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224543f-31b7-4164-bdba-7d1b4df8903b admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:24.237452 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224543f-31b7-4164-bdba-7d1b4df8903b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:24.244842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224543f-31b7-4164-bdba-7d1b4df8903b admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:24.259531 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f2234-96fb-4e68-ac61-5a2ca8fac33f None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:24.273518 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b6b59-4f2a-4290-b651-6b07a796b78d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:24.278488 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b6b59-4f2a-4290-b651-6b07a796b78d service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:24.278612 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b6b59-4f2a-4290-b651-6b07a796b78d service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:24.278808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b6b59-4f2a-4290-b651-6b07a796b78d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:24.306074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b6b59-4f2a-4290-b651-6b07a796b78d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:24.313226 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b6b59-4f2a-4290-b651-6b07a796b78d service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:24.329944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 872/1753] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:23 2022] POST /identity/v3/projects => generated 403 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:24.331814 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde20f7-2555-4366-b94f-b09f92ce03ca None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:24.333356 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde20f7-2555-4366-b94f-b09f92ce03ca None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:24.333737 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde20f7-2555-4366-b94f-b09f92ce03ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:24.366653 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 882/1754] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:24.369017 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b6b59-4f2a-4290-b651-6b07a796b78d service neutron] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:24.378172 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-dfde20f7-2555-4366-b94f-b09f92ce03ca None None] MFA Rules not processed for user `06aca6bb76ec4290b591d9c7a5a6c5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:24.380922 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-dfde20f7-2555-4366-b94f-b09f92ce03ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:24.416503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b6b59-4f2a-4290-b651-6b07a796b78d service neutron] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:24.425014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:24.559368 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 873/1755] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:24.561232 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde20f7-2555-4366-b94f-b09f92ce03ca None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:24.566537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-dfde20f7-2555-4366-b94f-b09f92ce03ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:24.569778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d32466-d9ed-49ed-a867-00f5cfb6e312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:24.575721 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d32466-d9ed-49ed-a867-00f5cfb6e312 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:24.577093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d32466-d9ed-49ed-a867-00f5cfb6e312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:24.577381 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d32466-d9ed-49ed-a867-00f5cfb6e312 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:24.578119 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d32466-d9ed-49ed-a867-00f5cfb6e312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:24.586189 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d32466-d9ed-49ed-a867-00f5cfb6e312 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:24.655339 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:24.664285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 883/1756] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:24 2022] POST /identity/v3/users => generated 308 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:24.675173 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bad46-c37a-413a-900f-4873865a92e1 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:24.675522 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bad46-c37a-413a-900f-4873865a92e1 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:24.678111 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bad46-c37a-413a-900f-4873865a92e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:24.712474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde20f7-2555-4366-b94f-b09f92ce03ca None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:24.720918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f68aef-95a6-4291-9a3e-1c14e3efe267 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:24.721823 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f68aef-95a6-4291-9a3e-1c14e3efe267 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:24.722110 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f68aef-95a6-4291-9a3e-1c14e3efe267 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:24.722386 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f68aef-95a6-4291-9a3e-1c14e3efe267 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:24.836685 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-004bad46-c37a-413a-900f-4873865a92e1 None None] MFA Rules not processed for user `05cfc9d62a244701a5df524d1c26f107`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:24.838859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-004bad46-c37a-413a-900f-4873865a92e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:24.901881 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f68aef-95a6-4291-9a3e-1c14e3efe267 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:24.907197 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f68aef-95a6-4291-9a3e-1c14e3efe267 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:24.937052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 874/1757] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:24 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:24.937052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f68aef-95a6-4291-9a3e-1c14e3efe267 service cinder] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:25.025161 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 884/1758] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Oct 4 16:32:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:25.026360 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bad46-c37a-413a-900f-4873865a92e1 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:25.076754 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bad46-c37a-413a-900f-4873865a92e1 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:25.087697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a80b7-398c-4d13-a570-db391d2b6208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:25.088365 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a80b7-398c-4d13-a570-db391d2b6208 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:25.088648 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a80b7-398c-4d13-a570-db391d2b6208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:25.088922 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a80b7-398c-4d13-a570-db391d2b6208 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:25.090143 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a80b7-398c-4d13-a570-db391d2b6208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:25.093350 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a80b7-398c-4d13-a570-db391d2b6208 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:25.115311 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 885/1759] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:25.117654 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a80b7-398c-4d13-a570-db391d2b6208 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:25.120625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-206a80b7-398c-4d13-a570-db391d2b6208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:25.140218 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f68aef-95a6-4291-9a3e-1c14e3efe267 service cinder] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:25.146624 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a80b7-398c-4d13-a570-db391d2b6208 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:25.156501 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e4fd5-9fe7-4eb0-995b-2c6d2662a673 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:25.157604 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e4fd5-9fe7-4eb0-995b-2c6d2662a673 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:25.157886 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e4fd5-9fe7-4eb0-995b-2c6d2662a673 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:25.158173 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e4fd5-9fe7-4eb0-995b-2c6d2662a673 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:25.161349 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc991c-5a4f-47a5-ba44-ccf880d24cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:25.162015 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc991c-5a4f-47a5-ba44-ccf880d24cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:25.162289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc991c-5a4f-47a5-ba44-ccf880d24cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:25.162561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc991c-5a4f-47a5-ba44-ccf880d24cb6 admin admin] PATH_INFO: `/v3/users/126a989b0076458eab37df691a335bd4` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:25.165522 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc991c-5a4f-47a5-ba44-ccf880d24cb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=126a989b0076458eab37df691a335bd4)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:25.168270 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc991c-5a4f-47a5-ba44-ccf880d24cb6 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:25.179082 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e4fd5-9fe7-4eb0-995b-2c6d2662a673 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:25.181516 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e4fd5-9fe7-4eb0-995b-2c6d2662a673 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:25.217039 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 875/1760] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:24 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:25.217800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e4fd5-9fe7-4eb0-995b-2c6d2662a673 service nova] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:25.235647 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:25.241448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e4fd5-9fe7-4eb0-995b-2c6d2662a673 service nova] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:25.261510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83885ccc-5664-464c-903c-366f94c17d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:25.262213 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83885ccc-5664-464c-903c-366f94c17d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:25.262485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83885ccc-5664-464c-903c-366f94c17d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:25.262765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83885ccc-5664-464c-903c-366f94c17d37 admin admin] PATH_INFO: `/v3/projects/90f80819ac11434fae0dd1eec2f8be01/users/fd3504690cae4136bbbb9e5e854d9649/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:25.298428 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3fdc991c-5a4f-47a5-ba44-ccf880d24cb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '126a989b0076458eab37df691a335bd4'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:25.299369 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3fdc991c-5a4f-47a5-ba44-ccf880d24cb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '126a989b0076458eab37df691a335bd4'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:25.321852 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83885ccc-5664-464c-903c-366f94c17d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90f80819ac11434fae0dd1eec2f8be01, user_id=fd3504690cae4136bbbb9e5e854d9649, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:25.326368 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3fdc991c-5a4f-47a5-ba44-ccf880d24cb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '126a989b0076458eab37df691a335bd4'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:25.330097 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83885ccc-5664-464c-903c-366f94c17d37 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:25.349080 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3fdc991c-5a4f-47a5-ba44-ccf880d24cb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '126a989b0076458eab37df691a335bd4'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:25.354639 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3fdc991c-5a4f-47a5-ba44-ccf880d24cb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '126a989b0076458eab37df691a335bd4'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:25.389947 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 876/1761] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:25 2022] PUT /identity/v3/projects/90f80819ac11434fae0dd1eec2f8be01/users/fd3504690cae4136bbbb9e5e854d9649/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:25.392706 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83885ccc-5664-464c-903c-366f94c17d37 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:25.396816 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-83885ccc-5664-464c-903c-366f94c17d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:25.409795 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 886/1762] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:32:25 2022] DELETE /identity/v3/users/126a989b0076458eab37df691a335bd4 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:25.409795 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc991c-5a4f-47a5-ba44-ccf880d24cb6 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:25.413065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-3fdc991c-5a4f-47a5-ba44-ccf880d24cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:25.506311 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:25.608353 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc991c-5a4f-47a5-ba44-ccf880d24cb6 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:25.625323 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83885ccc-5664-464c-903c-366f94c17d37 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:25.633871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a354d8-997e-4121-88ef-51a8046392bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:25.634592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a354d8-997e-4121-88ef-51a8046392bb admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:25.637721 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a354d8-997e-4121-88ef-51a8046392bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:25.638646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a354d8-997e-4121-88ef-51a8046392bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:25.638792 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a354d8-997e-4121-88ef-51a8046392bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:25.640677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a354d8-997e-4121-88ef-51a8046392bb admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:25.653382 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 887/1763] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:25.654916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d2682-cba8-46fb-9aa2-bda0c100d58c None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:25.655330 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d2682-cba8-46fb-9aa2-bda0c100d58c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:25.655770 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d2682-cba8-46fb-9aa2-bda0c100d58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:25.694070 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-106d2682-cba8-46fb-9aa2-bda0c100d58c None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:25.699757 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-106d2682-cba8-46fb-9aa2-bda0c100d58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:25.734307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 888/1764] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:25.746689 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e4aec-dbf2-4e15-b3eb-9cdcbaa2adb3 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:25.747526 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e4aec-dbf2-4e15-b3eb-9cdcbaa2adb3 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:25.747825 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e4aec-dbf2-4e15-b3eb-9cdcbaa2adb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:25.787888 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7eea8-0628-4b6a-9441-32b2c52b0483 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6590cb6c1c964039b9dea771a647bdac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:25.788537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7eea8-0628-4b6a-9441-32b2c52b0483 service swift] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:25.788816 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7eea8-0628-4b6a-9441-32b2c52b0483 service swift] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:25.789086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7eea8-0628-4b6a-9441-32b2c52b0483 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:25.792480 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ffd7eea8-0628-4b6a-9441-32b2c52b0483 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:25.795065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-008e4aec-dbf2-4e15-b3eb-9cdcbaa2adb3 None None] MFA Rules not processed for user `b505541b5fe8494fa9ae8777e7add970`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:25.796431 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-008e4aec-dbf2-4e15-b3eb-9cdcbaa2adb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:25.907648 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd7eea8-0628-4b6a-9441-32b2c52b0483 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:25.909341 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 889/1765] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:25.910245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e4aec-dbf2-4e15-b3eb-9cdcbaa2adb3 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:25.916048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd7eea8-0628-4b6a-9441-32b2c52b0483 service swift] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:25.927649 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e4aec-dbf2-4e15-b3eb-9cdcbaa2adb3 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:25.933152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880c4b0-b02f-4b9a-862e-c08beddc4a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:25.934219 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880c4b0-b02f-4b9a-862e-c08beddc4a6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:25.934582 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880c4b0-b02f-4b9a-862e-c08beddc4a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:25.935132 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880c4b0-b02f-4b9a-862e-c08beddc4a6b admin admin] PATH_INFO: `/v3/projects/90f80819ac11434fae0dd1eec2f8be01/users/fd3504690cae4136bbbb9e5e854d9649/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:25.937678 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b880c4b0-b02f-4b9a-862e-c08beddc4a6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=90f80819ac11434fae0dd1eec2f8be01, user_id=fd3504690cae4136bbbb9e5e854d9649, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:25.940672 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b880c4b0-b02f-4b9a-862e-c08beddc4a6b admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:25.941568 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 877/1766] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Oct 4 16:32:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 16:32:25.942444 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7eea8-0628-4b6a-9441-32b2c52b0483 service swift] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:25.945902 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ffd7eea8-0628-4b6a-9441-32b2c52b0483 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:25.958927 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:25.968586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 890/1767] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:25 2022] PUT /identity/v3/projects/90f80819ac11434fae0dd1eec2f8be01/users/fd3504690cae4136bbbb9e5e854d9649/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:26.093438 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7eea8-0628-4b6a-9441-32b2c52b0483 service swift] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:26.227906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ccff9-8e10-4aab-8e57-e4ded078a7d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:26.228562 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ccff9-8e10-4aab-8e57-e4ded078a7d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:26.228840 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ccff9-8e10-4aab-8e57-e4ded078a7d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:26.229275 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ccff9-8e10-4aab-8e57-e4ded078a7d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:26.376029 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ccff9-8e10-4aab-8e57-e4ded078a7d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:26.377874 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ccff9-8e10-4aab-8e57-e4ded078a7d5 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:26.405793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 878/1768] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:27.651855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b538f-fca7-49de-82ae-48a9acc05eec None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:27.651855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b538f-fca7-49de-82ae-48a9acc05eec None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:27.651855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b538f-fca7-49de-82ae-48a9acc05eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:27.796707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-018b538f-fca7-49de-82ae-48a9acc05eec None None] MFA Rules not processed for user `d6ae980afbfd49dea9bbb0adc02b9031`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:27.797984 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-018b538f-fca7-49de-82ae-48a9acc05eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:27.862684 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 891/1769] 10.222.0.42 () {58 vars in 1015 bytes} [Tue Oct 4 16:32:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:27.944763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ccff9-8e10-4aab-8e57-e4ded078a7d5 service neutron] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:27.946596 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-866ccff9-8e10-4aab-8e57-e4ded078a7d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:27.983280 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ccff9-8e10-4aab-8e57-e4ded078a7d5 service neutron] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:27.997412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8c7e8-9860-4302-91d8-aeb50a442468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:28.001392 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8c7e8-9860-4302-91d8-aeb50a442468 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:28.001927 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8c7e8-9860-4302-91d8-aeb50a442468 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:28.002473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8c7e8-9860-4302-91d8-aeb50a442468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:28.036215 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8c7e8-9860-4302-91d8-aeb50a442468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:28.044397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8c7e8-9860-4302-91d8-aeb50a442468 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:28.105126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 879/1770] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:28.261226 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b538f-fca7-49de-82ae-48a9acc05eec None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:28.264375 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-018b538f-fca7-49de-82ae-48a9acc05eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:28.305710 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b538f-fca7-49de-82ae-48a9acc05eec None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:28.327839 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8fddb-f96d-4979-a2e6-84c6f09614b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:28.330412 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8fddb-f96d-4979-a2e6-84c6f09614b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:28.332617 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8fddb-f96d-4979-a2e6-84c6f09614b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:28.333837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8fddb-f96d-4979-a2e6-84c6f09614b5 admin admin] PATH_INFO: `/v3/projects/5372806467ef43acad0775ece37d74d3` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:28.337142 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8fddb-f96d-4979-a2e6-84c6f09614b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5372806467ef43acad0775ece37d74d3)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:28.343358 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8fddb-f96d-4979-a2e6-84c6f09614b5 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:28.415790 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67633e6-cbf4-4a34-abe1-8647997ffa34 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:28.416624 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67633e6-cbf4-4a34-abe1-8647997ffa34 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:28.417112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67633e6-cbf4-4a34-abe1-8647997ffa34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:28.486406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-99a8fddb-f96d-4979-a2e6-84c6f09614b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5372806467ef43acad0775ece37d74d3', 'request_id': 'req-99a8fddb-f96d-4979-a2e6-84c6f09614b5'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:28.500976 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-99a8fddb-f96d-4979-a2e6-84c6f09614b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5372806467ef43acad0775ece37d74d3', 'request_id': 'req-99a8fddb-f96d-4979-a2e6-84c6f09614b5'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:28.517476 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-c67633e6-cbf4-4a34-abe1-8647997ffa34 None None] MFA Rules not processed for user `fd3504690cae4136bbbb9e5e854d9649`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:28.517895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-99a8fddb-f96d-4979-a2e6-84c6f09614b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5372806467ef43acad0775ece37d74d3', 'request_id': 'req-99a8fddb-f96d-4979-a2e6-84c6f09614b5'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:28.522132 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c67633e6-cbf4-4a34-abe1-8647997ffa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:28.568590 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-99a8fddb-f96d-4979-a2e6-84c6f09614b5 admin admin] The token cache is being invalidate because project 5372806467ef43acad0775ece37d74d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:32:28.569443 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-99a8fddb-f96d-4979-a2e6-84c6f09614b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:28.571812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-99a8fddb-f96d-4979-a2e6-84c6f09614b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:28.581803 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 892/1771] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:32:28 2022] DELETE /identity/v3/projects/5372806467ef43acad0775ece37d74d3 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:28.587510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8fddb-f96d-4979-a2e6-84c6f09614b5 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:28.594237 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-99a8fddb-f96d-4979-a2e6-84c6f09614b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:28.783459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:28.789771 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:28.928870 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 880/1772] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:28 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 515 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:28.965837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8fddb-f96d-4979-a2e6-84c6f09614b5 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:28.988255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d3715-fbe7-411b-92c3-e9a2feee1dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:28.989055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d3715-fbe7-411b-92c3-e9a2feee1dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:28.991691 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d3715-fbe7-411b-92c3-e9a2feee1dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:28.992025 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d3715-fbe7-411b-92c3-e9a2feee1dfc admin admin] PATH_INFO: `/v3/users/5ea7b9be20ab442fab2e8ffa296fed9f` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:28.999602 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d3715-fbe7-411b-92c3-e9a2feee1dfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ea7b9be20ab442fab2e8ffa296fed9f)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:29.013616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d3715-fbe7-411b-92c3-e9a2feee1dfc admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:29.177310 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-ee2d3715-fbe7-411b-92c3-e9a2feee1dfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ea7b9be20ab442fab2e8ffa296fed9f'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:29.182967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-ee2d3715-fbe7-411b-92c3-e9a2feee1dfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ea7b9be20ab442fab2e8ffa296fed9f'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:29.218828 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-ee2d3715-fbe7-411b-92c3-e9a2feee1dfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ea7b9be20ab442fab2e8ffa296fed9f'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:29.237273 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-ee2d3715-fbe7-411b-92c3-e9a2feee1dfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ea7b9be20ab442fab2e8ffa296fed9f'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:29.237941 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-ee2d3715-fbe7-411b-92c3-e9a2feee1dfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ea7b9be20ab442fab2e8ffa296fed9f'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:29.317493 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 893/1773] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:32:28 2022] DELETE /identity/v3/users/5ea7b9be20ab442fab2e8ffa296fed9f => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:30.743119 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67633e6-cbf4-4a34-abe1-8647997ffa34 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:30.767844 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67633e6-cbf4-4a34-abe1-8647997ffa34 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:31.041889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b13dc-36bf-4518-9855-085b8335d4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:31.044335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b13dc-36bf-4518-9855-085b8335d4a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:31.044335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b13dc-36bf-4518-9855-085b8335d4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:31.044630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b13dc-36bf-4518-9855-085b8335d4a7 admin admin] PATH_INFO: `/v3/projects/9dd2fbf25e6a476daeff4d21f26e0c93` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:31.057561 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b13dc-36bf-4518-9855-085b8335d4a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dd2fbf25e6a476daeff4d21f26e0c93)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:31.065031 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b13dc-36bf-4518-9855-085b8335d4a7 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:31.196755 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-109b13dc-36bf-4518-9855-085b8335d4a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dd2fbf25e6a476daeff4d21f26e0c93', 'request_id': 'req-109b13dc-36bf-4518-9855-085b8335d4a7'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:31.230019 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-109b13dc-36bf-4518-9855-085b8335d4a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dd2fbf25e6a476daeff4d21f26e0c93', 'request_id': 'req-109b13dc-36bf-4518-9855-085b8335d4a7'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:31.257917 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-109b13dc-36bf-4518-9855-085b8335d4a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dd2fbf25e6a476daeff4d21f26e0c93', 'request_id': 'req-109b13dc-36bf-4518-9855-085b8335d4a7'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:31.299702 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-109b13dc-36bf-4518-9855-085b8335d4a7 admin admin] The token cache is being invalidate because project 9dd2fbf25e6a476daeff4d21f26e0c93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:32:31.300291 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-109b13dc-36bf-4518-9855-085b8335d4a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:31.301833 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-109b13dc-36bf-4518-9855-085b8335d4a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:31.307775 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 881/1774] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:32:30 2022] DELETE /identity/v3/projects/9dd2fbf25e6a476daeff4d21f26e0c93 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:31.312761 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb8b7f-3664-4273-be6e-93cddfbc510f None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:31.313275 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb8b7f-3664-4273-be6e-93cddfbc510f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:31.313378 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb8b7f-3664-4273-be6e-93cddfbc510f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:31.378735 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-a4fb8b7f-3664-4273-be6e-93cddfbc510f None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:31.382099 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-a4fb8b7f-3664-4273-be6e-93cddfbc510f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:31.640141 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 894/1775] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:31.648617 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231f207-8f39-475d-a7b3-ed00b9b99b94 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:31.648938 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231f207-8f39-475d-a7b3-ed00b9b99b94 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:31.649199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231f207-8f39-475d-a7b3-ed00b9b99b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:31.710387 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-9231f207-8f39-475d-a7b3-ed00b9b99b94 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:31.711737 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-9231f207-8f39-475d-a7b3-ed00b9b99b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:31.739438 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 882/1776] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:31.744281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb8b7f-3664-4273-be6e-93cddfbc510f None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:31.760228 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb8b7f-3664-4273-be6e-93cddfbc510f None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:31.771538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50852e-53a8-4740-94be-4de9757bb637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:31.774451 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50852e-53a8-4740-94be-4de9757bb637 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:31.776153 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50852e-53a8-4740-94be-4de9757bb637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:31.778304 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50852e-53a8-4740-94be-4de9757bb637 admin admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:31.801802 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50852e-53a8-4740-94be-4de9757bb637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:32:31.805023 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50852e-53a8-4740-94be-4de9757bb637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:31.810864 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50852e-53a8-4740-94be-4de9757bb637 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:31.827923 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd044c-e40a-47eb-b3a7-931c0b561b59 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:31.830381 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd044c-e40a-47eb-b3a7-931c0b561b59 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:31.830857 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd044c-e40a-47eb-b3a7-931c0b561b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:31.861086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 895/1777] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:32:31.865362 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50852e-53a8-4740-94be-4de9757bb637 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:31.888782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50852e-53a8-4740-94be-4de9757bb637 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:31.900128 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd244740-6220-4625-a723-361458f14528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:31.901082 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd244740-6220-4625-a723-361458f14528 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:31.901506 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd244740-6220-4625-a723-361458f14528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:31.901954 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd244740-6220-4625-a723-361458f14528 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:31.903897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd244740-6220-4625-a723-361458f14528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:31.908085 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd244740-6220-4625-a723-361458f14528 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:31.909521 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-31bd044c-e40a-47eb-b3a7-931c0b561b59 None None] MFA Rules not processed for user `06aca6bb76ec4290b591d9c7a5a6c5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:31.923955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-31bd044c-e40a-47eb-b3a7-931c0b561b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:32.002587 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 896/1778] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:31 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:32.007590 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd244740-6220-4625-a723-361458f14528 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:32.046420 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:32.151235 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 883/1779] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:31 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:32.354733 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd244740-6220-4625-a723-361458f14528 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:32.381713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4803a-c110-4db1-a741-1890ab0ae9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:32.383191 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4803a-c110-4db1-a741-1890ab0ae9a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:32.384289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4803a-c110-4db1-a741-1890ab0ae9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:32.384940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4803a-c110-4db1-a741-1890ab0ae9a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:32.386133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4803a-c110-4db1-a741-1890ab0ae9a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:32.389702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4803a-c110-4db1-a741-1890ab0ae9a3 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:32.473013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd044c-e40a-47eb-b3a7-931c0b561b59 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:32.474824 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 897/1780] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:32 2022] POST /identity/v3/users => generated 291 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:32.494798 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd044c-e40a-47eb-b3a7-931c0b561b59 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:32.505014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a1536-2f5e-48ea-ac2e-7344e39eb606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:32.506445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a1536-2f5e-48ea-ac2e-7344e39eb606 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:32.506445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a1536-2f5e-48ea-ac2e-7344e39eb606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:32.506445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a1536-2f5e-48ea-ac2e-7344e39eb606 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:32.507133 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a1536-2f5e-48ea-ac2e-7344e39eb606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:32.508521 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a1536-2f5e-48ea-ac2e-7344e39eb606 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:32.522152 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:32.533909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 884/1781] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:32:32.541599 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4803a-c110-4db1-a741-1890ab0ae9a3 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:32.575387 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4803a-c110-4db1-a741-1890ab0ae9a3 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:32.611508 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed2454-57df-432f-b4dc-de1b4bb3bbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:32.612840 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed2454-57df-432f-b4dc-de1b4bb3bbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:32.613693 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed2454-57df-432f-b4dc-de1b4bb3bbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:32.614171 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed2454-57df-432f-b4dc-de1b4bb3bbb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:32.615563 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed2454-57df-432f-b4dc-de1b4bb3bbb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:32.620743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c9888-56c9-46fa-9582-510ff375500e None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:32.621191 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c9888-56c9-46fa-9582-510ff375500e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:32.621410 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c9888-56c9-46fa-9582-510ff375500e None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:32.622737 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed2454-57df-432f-b4dc-de1b4bb3bbb5 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:32.622873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 885/1782] 10.222.0.55 () {54 vars in 921 bytes} [Tue Oct 4 16:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 16:32:32.673201 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c9888-56c9-46fa-9582-510ff375500e None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:32.676293 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 898/1783] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:32.703801 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c9888-56c9-46fa-9582-510ff375500e None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:32.713783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32b1ff-5579-4488-9213-3639d20e3edf None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:32.715145 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32b1ff-5579-4488-9213-3639d20e3edf None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:32.715538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32b1ff-5579-4488-9213-3639d20e3edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:32.719712 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8fca3-8eb4-4b95-8ea3-cf245c4e6c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:32.720438 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8fca3-8eb4-4b95-8ea3-cf245c4e6c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:32.720716 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8fca3-8eb4-4b95-8ea3-cf245c4e6c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:32.720966 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8fca3-8eb4-4b95-8ea3-cf245c4e6c63 admin admin] PATH_INFO: `/v3/projects/d35c5156405447de94d9edd09569a1cd/users/688a72414491449f860e34e9876c31c5/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:32.774845 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd8fca3-8eb4-4b95-8ea3-cf245c4e6c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35c5156405447de94d9edd09569a1cd, user_id=688a72414491449f860e34e9876c31c5, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:32.791386 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd8fca3-8eb4-4b95-8ea3-cf245c4e6c63 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:32.808952 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-4b32b1ff-5579-4488-9213-3639d20e3edf None None] MFA Rules not processed for user `8cd59eac06e347ee9432185b24fdf773`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:32.814564 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-4b32b1ff-5579-4488-9213-3639d20e3edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:32.848068 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 886/1784] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:32 2022] PUT /identity/v3/projects/d35c5156405447de94d9edd09569a1cd/users/688a72414491449f860e34e9876c31c5/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:32.861525 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ad022-5273-423e-9721-0bea87ce8427 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:32.861976 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ad022-5273-423e-9721-0bea87ce8427 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:32.862564 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ad022-5273-423e-9721-0bea87ce8427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:32.935579 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-5b6ad022-5273-423e-9721-0bea87ce8427 None None] MFA Rules not processed for user `688a72414491449f860e34e9876c31c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:32.938618 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-5b6ad022-5273-423e-9721-0bea87ce8427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:33.124162 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 899/1785] 10.222.0.55 () {58 vars in 1018 bytes} [Tue Oct 4 16:32:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:32:33.125672 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd617a-9c5c-4c3f-a883-c72f7aefd3a8 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:33.126073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd617a-9c5c-4c3f-a883-c72f7aefd3a8 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:33.126499 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd617a-9c5c-4c3f-a883-c72f7aefd3a8 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:33.129260 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 900/1786] 10.222.0.55 () {54 vars in 921 bytes} [Tue Oct 4 16:32:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:32:33.149197 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd617a-9c5c-4c3f-a883-c72f7aefd3a8 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:33.149433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 887/1787] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:32:33.168373 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ad2f0-ffe4-4225-b724-39b0af9b344e None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:33.168642 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ad2f0-ffe4-4225-b724-39b0af9b344e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:33.168929 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ad2f0-ffe4-4225-b724-39b0af9b344e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:33.238789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-718ad2f0-ffe4-4225-b724-39b0af9b344e None None] MFA Rules not processed for user `6cdee0584fe045028a44c385d032d2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:33.240602 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-718ad2f0-ffe4-4225-b724-39b0af9b344e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:33.383581 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd617a-9c5c-4c3f-a883-c72f7aefd3a8 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:33.397716 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5363e-2b31-4fa8-b0c9-e18e3c1812c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:33.398448 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5363e-2b31-4fa8-b0c9-e18e3c1812c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:33.399280 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5363e-2b31-4fa8-b0c9-e18e3c1812c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:33.400378 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5363e-2b31-4fa8-b0c9-e18e3c1812c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:33.402815 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5363e-2b31-4fa8-b0c9-e18e3c1812c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:33.413453 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5363e-2b31-4fa8-b0c9-e18e3c1812c5 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:33.471648 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 888/1788] 10.222.0.55 () {58 vars in 1018 bytes} [Tue Oct 4 16:32:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:33.472619 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ad2f0-ffe4-4225-b724-39b0af9b344e None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:33.474528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-718ad2f0-ffe4-4225-b724-39b0af9b344e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:33.485847 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 901/1789] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:33 2022] POST /identity/v3/projects => generated 379 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:33.487237 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5363e-2b31-4fa8-b0c9-e18e3c1812c5 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:33.490589 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-5ff5363e-2b31-4fa8-b0c9-e18e3c1812c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:33.525507 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:33.535882 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ad2f0-ffe4-4225-b724-39b0af9b344e None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:33.628880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5363e-2b31-4fa8-b0c9-e18e3c1812c5 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:33.640684 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990c3e6-35ed-4cfc-ae0e-dde7ab802bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:33.641516 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990c3e6-35ed-4cfc-ae0e-dde7ab802bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:33.641871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990c3e6-35ed-4cfc-ae0e-dde7ab802bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:33.642248 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990c3e6-35ed-4cfc-ae0e-dde7ab802bf4 admin admin] PATH_INFO: `/v3/users/2f0c7f6122164f0cb8e3486104463ca3` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:33.647743 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990c3e6-35ed-4cfc-ae0e-dde7ab802bf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f0c7f6122164f0cb8e3486104463ca3)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:33.650601 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990c3e6-35ed-4cfc-ae0e-dde7ab802bf4 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:33.718922 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:33.747743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f0342-99f2-43a0-bc4e-fca89cb9745b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd59eac06e347ee9432185b24fdf773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:33.748546 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f0342-99f2-43a0-bc4e-fca89cb9745b service placement] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:33.748825 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f0342-99f2-43a0-bc4e-fca89cb9745b service placement] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:33.749098 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f0342-99f2-43a0-bc4e-fca89cb9745b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:33.767346 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f0342-99f2-43a0-bc4e-fca89cb9745b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:33.768974 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f0342-99f2-43a0-bc4e-fca89cb9745b service placement] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:33.775390 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3990c3e6-35ed-4cfc-ae0e-dde7ab802bf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f0c7f6122164f0cb8e3486104463ca3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:33.777628 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3990c3e6-35ed-4cfc-ae0e-dde7ab802bf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f0c7f6122164f0cb8e3486104463ca3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:33.790525 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 889/1790] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:33.791467 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f0342-99f2-43a0-bc4e-fca89cb9745b service placement] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:33.818196 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f0342-99f2-43a0-bc4e-fca89cb9745b service placement] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:33.820537 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3990c3e6-35ed-4cfc-ae0e-dde7ab802bf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f0c7f6122164f0cb8e3486104463ca3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:33.833467 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788f4b7-7373-4b92-967a-7669ba070f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:33.834290 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788f4b7-7373-4b92-967a-7669ba070f38 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:33.834691 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788f4b7-7373-4b92-967a-7669ba070f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:33.835390 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788f4b7-7373-4b92-967a-7669ba070f38 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:33.836929 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788f4b7-7373-4b92-967a-7669ba070f38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:33.837559 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3990c3e6-35ed-4cfc-ae0e-dde7ab802bf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f0c7f6122164f0cb8e3486104463ca3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:33.839201 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3990c3e6-35ed-4cfc-ae0e-dde7ab802bf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f0c7f6122164f0cb8e3486104463ca3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:33.841420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788f4b7-7373-4b92-967a-7669ba070f38 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:33.874645 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 902/1791] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:32:33 2022] DELETE /identity/v3/users/2f0c7f6122164f0cb8e3486104463ca3 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:33.879369 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770eac27-5ff4-4cdc-8cd0-d595e7669cfc None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:33.880073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770eac27-5ff4-4cdc-8cd0-d595e7669cfc None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:33.880581 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770eac27-5ff4-4cdc-8cd0-d595e7669cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:33.913419 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-770eac27-5ff4-4cdc-8cd0-d595e7669cfc None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:33.923568 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 890/1792] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:33 2022] POST /identity/v3/users => generated 296 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:33.928326 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788f4b7-7373-4b92-967a-7669ba070f38 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:33.934182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-770eac27-5ff4-4cdc-8cd0-d595e7669cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:33.937008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-3788f4b7-7373-4b92-967a-7669ba070f38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:33.966249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788f4b7-7373-4b92-967a-7669ba070f38 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:34.120600 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e0d00-e0f5-429b-a4ab-d29eb3780a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:34.122013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e0d00-e0f5-429b-a4ab-d29eb3780a3e admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:34.124325 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e0d00-e0f5-429b-a4ab-d29eb3780a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:34.125282 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e0d00-e0f5-429b-a4ab-d29eb3780a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:34.127211 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 903/1793] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:34.127572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e0d00-e0f5-429b-a4ab-d29eb3780a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:34.129895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e0d00-e0f5-429b-a4ab-d29eb3780a3e admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:34.143931 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 891/1794] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:34.148277 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770eac27-5ff4-4cdc-8cd0-d595e7669cfc None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:34.163215 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770eac27-5ff4-4cdc-8cd0-d595e7669cfc None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:34.179395 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48d666-50ea-4d34-82dc-8b19cc23380c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:34.180217 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48d666-50ea-4d34-82dc-8b19cc23380c admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:34.181561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48d666-50ea-4d34-82dc-8b19cc23380c admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:34.181986 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48d666-50ea-4d34-82dc-8b19cc23380c admin admin] PATH_INFO: `/v3/projects/fea75ca2941a485eb3be172174168f73/users/0f903d38619741e1ae1b5ebf6ff8fd2e/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:34.209006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48d666-50ea-4d34-82dc-8b19cc23380c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea75ca2941a485eb3be172174168f73, user_id=0f903d38619741e1ae1b5ebf6ff8fd2e, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:34.212750 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48d666-50ea-4d34-82dc-8b19cc23380c admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:34.226804 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e0d00-e0f5-429b-a4ab-d29eb3780a3e admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:34.228798 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-858e0d00-e0f5-429b-a4ab-d29eb3780a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:34.267597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 904/1795] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:34 2022] PUT /identity/v3/projects/fea75ca2941a485eb3be172174168f73/users/0f903d38619741e1ae1b5ebf6ff8fd2e/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:34.273163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48d666-50ea-4d34-82dc-8b19cc23380c admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:34.314355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:34.426235 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e0d00-e0f5-429b-a4ab-d29eb3780a3e admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:34.639946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6189cd-de73-4fbd-a090-59d9407c44b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:34.642173 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6189cd-de73-4fbd-a090-59d9407c44b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:34.643330 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6189cd-de73-4fbd-a090-59d9407c44b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:34.644844 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6189cd-de73-4fbd-a090-59d9407c44b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:34.703887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48d666-50ea-4d34-82dc-8b19cc23380c admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:34.737822 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc4ace-f4ac-43df-b17c-98d421e3f59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:34.745391 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc4ace-f4ac-43df-b17c-98d421e3f59a admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:34.747392 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc4ace-f4ac-43df-b17c-98d421e3f59a admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:34.747691 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc4ace-f4ac-43df-b17c-98d421e3f59a admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:34.748393 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc4ace-f4ac-43df-b17c-98d421e3f59a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:34.750101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc4ace-f4ac-43df-b17c-98d421e3f59a admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:34.781711 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:34.796304 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 905/1796] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 524 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:34.797508 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc4ace-f4ac-43df-b17c-98d421e3f59a admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:34.851343 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6189cd-de73-4fbd-a090-59d9407c44b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:34.853717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc4ace-f4ac-43df-b17c-98d421e3f59a admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:34.854228 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6189cd-de73-4fbd-a090-59d9407c44b9 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:34.872542 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 892/1797] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:34.876387 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c070198-1e68-4a63-99a9-2d85f3b2b943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:34.878428 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c070198-1e68-4a63-99a9-2d85f3b2b943 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:34.879937 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c070198-1e68-4a63-99a9-2d85f3b2b943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:34.880550 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c070198-1e68-4a63-99a9-2d85f3b2b943 admin admin] PATH_INFO: `/v3/projects/fea75ca2941a485eb3be172174168f73/users/0f903d38619741e1ae1b5ebf6ff8fd2e/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:34.886140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c070198-1e68-4a63-99a9-2d85f3b2b943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea75ca2941a485eb3be172174168f73, user_id=0f903d38619741e1ae1b5ebf6ff8fd2e, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:34.897915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c070198-1e68-4a63-99a9-2d85f3b2b943 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:34.931918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 906/1798] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:34 2022] PUT /identity/v3/projects/fea75ca2941a485eb3be172174168f73/users/0f903d38619741e1ae1b5ebf6ff8fd2e/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:34.943115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c6701-82d5-4506-9ded-28b6aad8d964 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:34.943637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c6701-82d5-4506-9ded-28b6aad8d964 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:34.943637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c6701-82d5-4506-9ded-28b6aad8d964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:35.025838 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-932c6701-82d5-4506-9ded-28b6aad8d964 None None] MFA Rules not processed for user `0f903d38619741e1ae1b5ebf6ff8fd2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:35.027407 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-932c6701-82d5-4506-9ded-28b6aad8d964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:35.241177 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 893/1799] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:35.262490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c070198-1e68-4a63-99a9-2d85f3b2b943 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:35.265035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8c070198-1e68-4a63-99a9-2d85f3b2b943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:35.426178 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c070198-1e68-4a63-99a9-2d85f3b2b943 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:35.444062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8af973-2157-41f4-a111-40ca0d239db4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:35.444886 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8af973-2157-41f4-a111-40ca0d239db4 service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:35.445170 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8af973-2157-41f4-a111-40ca0d239db4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:35.446646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8af973-2157-41f4-a111-40ca0d239db4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:35.478358 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8af973-2157-41f4-a111-40ca0d239db4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:35.495173 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8af973-2157-41f4-a111-40ca0d239db4 service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:35.536301 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 907/1800] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:35 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:36.445456 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c6701-82d5-4506-9ded-28b6aad8d964 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:36.677920 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c6701-82d5-4506-9ded-28b6aad8d964 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:36.692567 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde4051-223f-47c2-8b9a-1c20d3763646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:36.693344 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde4051-223f-47c2-8b9a-1c20d3763646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:36.693722 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde4051-223f-47c2-8b9a-1c20d3763646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:36.694446 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde4051-223f-47c2-8b9a-1c20d3763646 admin admin] PATH_INFO: `/v3/users/688a72414491449f860e34e9876c31c5` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:36.697354 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde4051-223f-47c2-8b9a-1c20d3763646 admin admin] RBAC: Authorizing `identity:delete_user(user_id=688a72414491449f860e34e9876c31c5)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:36.702801 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde4051-223f-47c2-8b9a-1c20d3763646 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:36.729713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8af973-2157-41f4-a111-40ca0d239db4 service cinder] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:36.747417 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-7f8af973-2157-41f4-a111-40ca0d239db4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:36.784192 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8af973-2157-41f4-a111-40ca0d239db4 service cinder] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:36.798939 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91f6e2-40b3-4498-91e8-9d257aec2f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:36.801085 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91f6e2-40b3-4498-91e8-9d257aec2f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:36.809880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91f6e2-40b3-4498-91e8-9d257aec2f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:36.811349 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91f6e2-40b3-4498-91e8-9d257aec2f9a admin admin] PATH_INFO: `/v3/users/95d242046f554c28a338351b7f580695` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:36.817947 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91f6e2-40b3-4498-91e8-9d257aec2f9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=95d242046f554c28a338351b7f580695)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:36.825755 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91f6e2-40b3-4498-91e8-9d257aec2f9a admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:36.876468 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ffde4051-223f-47c2-8b9a-1c20d3763646 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '688a72414491449f860e34e9876c31c5'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:36.880374 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ffde4051-223f-47c2-8b9a-1c20d3763646 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '688a72414491449f860e34e9876c31c5'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:36.908890 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ffde4051-223f-47c2-8b9a-1c20d3763646 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '688a72414491449f860e34e9876c31c5'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:36.913110 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ffde4051-223f-47c2-8b9a-1c20d3763646 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '688a72414491449f860e34e9876c31c5'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:36.927423 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:36.944964 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ffde4051-223f-47c2-8b9a-1c20d3763646 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '688a72414491449f860e34e9876c31c5'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:37.006244 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 894/1801] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:32:36 2022] DELETE /identity/v3/users/688a72414491449f860e34e9876c31c5 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:37.007477 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde4051-223f-47c2-8b9a-1c20d3763646 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:37.013150 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ffde4051-223f-47c2-8b9a-1c20d3763646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:37.055042 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-7b91f6e2-40b3-4498-91e8-9d257aec2f9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95d242046f554c28a338351b7f580695'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:37.055791 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-7b91f6e2-40b3-4498-91e8-9d257aec2f9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95d242046f554c28a338351b7f580695'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:37.101044 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-7b91f6e2-40b3-4498-91e8-9d257aec2f9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95d242046f554c28a338351b7f580695'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:37.112945 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-7b91f6e2-40b3-4498-91e8-9d257aec2f9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95d242046f554c28a338351b7f580695'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:37.113853 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-7b91f6e2-40b3-4498-91e8-9d257aec2f9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95d242046f554c28a338351b7f580695'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:37.170609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 908/1802] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:32:36 2022] DELETE /identity/v3/users/95d242046f554c28a338351b7f580695 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:37.173438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0346f0e-02e4-45bc-8bd1-a1793cbbc9d4 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:37.187481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0346f0e-02e4-45bc-8bd1-a1793cbbc9d4 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:37.188027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0346f0e-02e4-45bc-8bd1-a1793cbbc9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:37.214516 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:37.229495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-e0346f0e-02e4-45bc-8bd1-a1793cbbc9d4 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:37.230849 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-e0346f0e-02e4-45bc-8bd1-a1793cbbc9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:37.253859 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde4051-223f-47c2-8b9a-1c20d3763646 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:37.386970 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 909/1803] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:37.414713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0346f0e-02e4-45bc-8bd1-a1793cbbc9d4 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:37.416892 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-e0346f0e-02e4-45bc-8bd1-a1793cbbc9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:37.474127 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be0269-5508-4f22-a85a-df32a1d1b615 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:37.474812 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be0269-5508-4f22-a85a-df32a1d1b615 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:37.475231 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be0269-5508-4f22-a85a-df32a1d1b615 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:37.475502 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be0269-5508-4f22-a85a-df32a1d1b615 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:37.477494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-00be0269-5508-4f22-a85a-df32a1d1b615 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:37.528409 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be0269-5508-4f22-a85a-df32a1d1b615 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:37.531362 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be0269-5508-4f22-a85a-df32a1d1b615 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:37.586223 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 895/1804] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:37.641276 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0346f0e-02e4-45bc-8bd1-a1793cbbc9d4 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:37.650833 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27591860-7d1a-4a95-a4a2-698e73d21fb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:37.651807 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27591860-7d1a-4a95-a4a2-698e73d21fb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:37.652188 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27591860-7d1a-4a95-a4a2-698e73d21fb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:37.652669 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27591860-7d1a-4a95-a4a2-698e73d21fb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:37.677475 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27591860-7d1a-4a95-a4a2-698e73d21fb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:37.679307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27591860-7d1a-4a95-a4a2-698e73d21fb0 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:37.701850 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 910/1805] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:37.714416 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be0269-5508-4f22-a85a-df32a1d1b615 service nova] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:37.716040 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-00be0269-5508-4f22-a85a-df32a1d1b615 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:37.741313 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be0269-5508-4f22-a85a-df32a1d1b615 service nova] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:37.752079 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836eb64-c256-4117-a95e-0eab7c809248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:37.753308 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836eb64-c256-4117-a95e-0eab7c809248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:37.753742 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836eb64-c256-4117-a95e-0eab7c809248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:37.755060 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836eb64-c256-4117-a95e-0eab7c809248 admin admin] PATH_INFO: `/v3/projects/8e3382a59d5c4823b081686e37d5cbb1` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:37.757829 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836eb64-c256-4117-a95e-0eab7c809248 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e3382a59d5c4823b081686e37d5cbb1)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:37.776552 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836eb64-c256-4117-a95e-0eab7c809248 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:37.901201 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-8836eb64-c256-4117-a95e-0eab7c809248 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e3382a59d5c4823b081686e37d5cbb1', 'request_id': 'req-8836eb64-c256-4117-a95e-0eab7c809248'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:37.915591 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:37.940912 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-8836eb64-c256-4117-a95e-0eab7c809248 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e3382a59d5c4823b081686e37d5cbb1', 'request_id': 'req-8836eb64-c256-4117-a95e-0eab7c809248'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:37.953640 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-8836eb64-c256-4117-a95e-0eab7c809248 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e3382a59d5c4823b081686e37d5cbb1', 'request_id': 'req-8836eb64-c256-4117-a95e-0eab7c809248'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:37.993586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-8836eb64-c256-4117-a95e-0eab7c809248 admin admin] The token cache is being invalidate because project 8e3382a59d5c4823b081686e37d5cbb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:32:37.994389 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-8836eb64-c256-4117-a95e-0eab7c809248 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:37.997404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-8836eb64-c256-4117-a95e-0eab7c809248 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:38.006562 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 896/1806] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:32:37 2022] DELETE /identity/v3/projects/8e3382a59d5c4823b081686e37d5cbb1 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:38.011181 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27591860-7d1a-4a95-a4a2-698e73d21fb0 service neutron] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:38.034362 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27591860-7d1a-4a95-a4a2-698e73d21fb0 service neutron] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:38.219621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0c6a0-5bee-4c35-8f7b-753d152eb312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:38.220323 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0c6a0-5bee-4c35-8f7b-753d152eb312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:38.220594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0c6a0-5bee-4c35-8f7b-753d152eb312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:38.220868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0c6a0-5bee-4c35-8f7b-753d152eb312 admin admin] PATH_INFO: `/v3/users/fd3504690cae4136bbbb9e5e854d9649` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:38.223468 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0c6a0-5bee-4c35-8f7b-753d152eb312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd3504690cae4136bbbb9e5e854d9649)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:38.225468 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0c6a0-5bee-4c35-8f7b-753d152eb312 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:38.386960 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-4eb0c6a0-5bee-4c35-8f7b-753d152eb312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd3504690cae4136bbbb9e5e854d9649'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:38.388602 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-4eb0c6a0-5bee-4c35-8f7b-753d152eb312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd3504690cae4136bbbb9e5e854d9649'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:38.401631 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:38.407934 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-4eb0c6a0-5bee-4c35-8f7b-753d152eb312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd3504690cae4136bbbb9e5e854d9649'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:38.430471 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-4eb0c6a0-5bee-4c35-8f7b-753d152eb312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd3504690cae4136bbbb9e5e854d9649'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:38.431305 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-4eb0c6a0-5bee-4c35-8f7b-753d152eb312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd3504690cae4136bbbb9e5e854d9649'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:38.458864 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 911/1807] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:32:38 2022] DELETE /identity/v3/users/fd3504690cae4136bbbb9e5e854d9649 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:38.952120 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836eb64-c256-4117-a95e-0eab7c809248 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:38.954727 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-8836eb64-c256-4117-a95e-0eab7c809248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:38.981373 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836eb64-c256-4117-a95e-0eab7c809248 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:39.130823 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f863d63-de70-4eb5-8075-b72ac5b66ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:39.131042 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f863d63-de70-4eb5-8075-b72ac5b66ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:39.131362 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f863d63-de70-4eb5-8075-b72ac5b66ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:39.131622 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f863d63-de70-4eb5-8075-b72ac5b66ceb admin admin] PATH_INFO: `/v3/projects/66f55c3c9232499d843e19e8df323c51` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:39.132768 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f863d63-de70-4eb5-8075-b72ac5b66ceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=66f55c3c9232499d843e19e8df323c51)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:39.134714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f863d63-de70-4eb5-8075-b72ac5b66ceb admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:39.253536 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-4f863d63-de70-4eb5-8075-b72ac5b66ceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66f55c3c9232499d843e19e8df323c51', 'request_id': 'req-4f863d63-de70-4eb5-8075-b72ac5b66ceb'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:39.265213 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36980a-e408-4f12-99f6-088772af3be6 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:39.265783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36980a-e408-4f12-99f6-088772af3be6 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:39.266110 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36980a-e408-4f12-99f6-088772af3be6 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:39.267900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 912/1808] 10.222.0.55 () {54 vars in 921 bytes} [Tue Oct 4 16:32:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:32:39.274006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-4f863d63-de70-4eb5-8075-b72ac5b66ceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66f55c3c9232499d843e19e8df323c51', 'request_id': 'req-4f863d63-de70-4eb5-8075-b72ac5b66ceb'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:39.278910 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81165643-5799-4f0b-9468-d187445d63e8 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:39.279419 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81165643-5799-4f0b-9468-d187445d63e8 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:39.279793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81165643-5799-4f0b-9468-d187445d63e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:39.291629 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-4f863d63-de70-4eb5-8075-b72ac5b66ceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66f55c3c9232499d843e19e8df323c51', 'request_id': 'req-4f863d63-de70-4eb5-8075-b72ac5b66ceb'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:39.332833 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-81165643-5799-4f0b-9468-d187445d63e8 None None] MFA Rules not processed for user `6cdee0584fe045028a44c385d032d2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:39.334866 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-81165643-5799-4f0b-9468-d187445d63e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:39.343678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-4f863d63-de70-4eb5-8075-b72ac5b66ceb admin admin] The token cache is being invalidate because project 66f55c3c9232499d843e19e8df323c51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:32:39.343972 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-4f863d63-de70-4eb5-8075-b72ac5b66ceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:39.344645 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-4f863d63-de70-4eb5-8075-b72ac5b66ceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:39.346518 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 897/1809] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:32:38 2022] DELETE /identity/v3/projects/66f55c3c9232499d843e19e8df323c51 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:39.350269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f863d63-de70-4eb5-8075-b72ac5b66ceb admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:39.351712 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-4f863d63-de70-4eb5-8075-b72ac5b66ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:39.475649 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 913/1810] 10.222.0.55 () {58 vars in 1018 bytes} [Tue Oct 4 16:32:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:32:39.519252 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f863d63-de70-4eb5-8075-b72ac5b66ceb admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:39.540287 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b8f5d-a8fb-4534-9fd3-ee9d50d5ff08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:39.540287 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b8f5d-a8fb-4534-9fd3-ee9d50d5ff08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:39.540287 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b8f5d-a8fb-4534-9fd3-ee9d50d5ff08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:39.540642 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b8f5d-a8fb-4534-9fd3-ee9d50d5ff08 admin admin] PATH_INFO: `/v3/users/a9aefa1370f547289e9abdc6d022d637` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:39.543340 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b8f5d-a8fb-4534-9fd3-ee9d50d5ff08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9aefa1370f547289e9abdc6d022d637)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:39.553300 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b8f5d-a8fb-4534-9fd3-ee9d50d5ff08 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:39.594556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:39.708909 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81165643-5799-4f0b-9468-d187445d63e8 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:39.710363 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-81165643-5799-4f0b-9468-d187445d63e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:39.719333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b24b8f5d-a8fb-4534-9fd3-ee9d50d5ff08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9aefa1370f547289e9abdc6d022d637'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:39.720646 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b24b8f5d-a8fb-4534-9fd3-ee9d50d5ff08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9aefa1370f547289e9abdc6d022d637'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:39.736133 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b24b8f5d-a8fb-4534-9fd3-ee9d50d5ff08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9aefa1370f547289e9abdc6d022d637'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:39.737253 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b24b8f5d-a8fb-4534-9fd3-ee9d50d5ff08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9aefa1370f547289e9abdc6d022d637'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:39.747732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81165643-5799-4f0b-9468-d187445d63e8 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:39.754829 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b24b8f5d-a8fb-4534-9fd3-ee9d50d5ff08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9aefa1370f547289e9abdc6d022d637'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:39.758068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cd24c-8ebc-4f95-90ca-08e28f962b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:39.759104 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cd24c-8ebc-4f95-90ca-08e28f962b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:39.759534 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cd24c-8ebc-4f95-90ca-08e28f962b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:39.760081 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cd24c-8ebc-4f95-90ca-08e28f962b3e admin admin] PATH_INFO: `/v3/projects/d35c5156405447de94d9edd09569a1cd` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:39.762507 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331cd24c-8ebc-4f95-90ca-08e28f962b3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d35c5156405447de94d9edd09569a1cd)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:39.766818 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331cd24c-8ebc-4f95-90ca-08e28f962b3e admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:39.802708 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 898/1811] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:32:39 2022] DELETE /identity/v3/users/a9aefa1370f547289e9abdc6d022d637 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:32:39.893419 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b8f5d-a8fb-4534-9fd3-ee9d50d5ff08 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:39.897351 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-b24b8f5d-a8fb-4534-9fd3-ee9d50d5ff08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:39.948017 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-331cd24c-8ebc-4f95-90ca-08e28f962b3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd35c5156405447de94d9edd09569a1cd', 'request_id': 'req-331cd24c-8ebc-4f95-90ca-08e28f962b3e'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:39.972104 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-331cd24c-8ebc-4f95-90ca-08e28f962b3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd35c5156405447de94d9edd09569a1cd', 'request_id': 'req-331cd24c-8ebc-4f95-90ca-08e28f962b3e'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:39.984816 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-331cd24c-8ebc-4f95-90ca-08e28f962b3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd35c5156405447de94d9edd09569a1cd', 'request_id': 'req-331cd24c-8ebc-4f95-90ca-08e28f962b3e'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:40.012343 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-331cd24c-8ebc-4f95-90ca-08e28f962b3e admin admin] The token cache is being invalidate because project d35c5156405447de94d9edd09569a1cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:32:40.012343 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-331cd24c-8ebc-4f95-90ca-08e28f962b3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:40.021767 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-331cd24c-8ebc-4f95-90ca-08e28f962b3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:40.028266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 914/1812] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:32:39 2022] DELETE /identity/v3/projects/d35c5156405447de94d9edd09569a1cd => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:32:40.033106 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cd24c-8ebc-4f95-90ca-08e28f962b3e admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:40.037583 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-331cd24c-8ebc-4f95-90ca-08e28f962b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:40.109069 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b8f5d-a8fb-4534-9fd3-ee9d50d5ff08 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:40.129560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:40.158240 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cd24c-8ebc-4f95-90ca-08e28f962b3e admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:40.164141 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714fba0-56c0-4e74-891b-0fc0d03bb128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:40.165003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714fba0-56c0-4e74-891b-0fc0d03bb128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:40.165444 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714fba0-56c0-4e74-891b-0fc0d03bb128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:40.165770 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714fba0-56c0-4e74-891b-0fc0d03bb128 admin admin] PATH_INFO: `/v3/users/0f903d38619741e1ae1b5ebf6ff8fd2e` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:40.167754 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714fba0-56c0-4e74-891b-0fc0d03bb128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f903d38619741e1ae1b5ebf6ff8fd2e)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:40.169140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714fba0-56c0-4e74-891b-0fc0d03bb128 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:40.230679 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036e954-0fb2-43b6-bbef-90d5c3887d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:40.231518 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036e954-0fb2-43b6-bbef-90d5c3887d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:40.231839 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036e954-0fb2-43b6-bbef-90d5c3887d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:40.232193 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036e954-0fb2-43b6-bbef-90d5c3887d49 admin admin] PATH_INFO: `/v3/projects/90f80819ac11434fae0dd1eec2f8be01` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:40.237195 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036e954-0fb2-43b6-bbef-90d5c3887d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90f80819ac11434fae0dd1eec2f8be01)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:40.239425 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036e954-0fb2-43b6-bbef-90d5c3887d49 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:40.290292 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-d714fba0-56c0-4e74-891b-0fc0d03bb128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f903d38619741e1ae1b5ebf6ff8fd2e'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:40.291975 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-d714fba0-56c0-4e74-891b-0fc0d03bb128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f903d38619741e1ae1b5ebf6ff8fd2e'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:40.303530 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-d714fba0-56c0-4e74-891b-0fc0d03bb128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f903d38619741e1ae1b5ebf6ff8fd2e'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:40.318635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:40.326611 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b036e954-0fb2-43b6-bbef-90d5c3887d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90f80819ac11434fae0dd1eec2f8be01', 'request_id': 'req-b036e954-0fb2-43b6-bbef-90d5c3887d49'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:40.327363 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-d714fba0-56c0-4e74-891b-0fc0d03bb128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f903d38619741e1ae1b5ebf6ff8fd2e'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:40.328714 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-d714fba0-56c0-4e74-891b-0fc0d03bb128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f903d38619741e1ae1b5ebf6ff8fd2e'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:40.340451 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b036e954-0fb2-43b6-bbef-90d5c3887d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90f80819ac11434fae0dd1eec2f8be01', 'request_id': 'req-b036e954-0fb2-43b6-bbef-90d5c3887d49'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:40.359503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 915/1813] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:32:40 2022] DELETE /identity/v3/users/0f903d38619741e1ae1b5ebf6ff8fd2e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:40.360464 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714fba0-56c0-4e74-891b-0fc0d03bb128 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:40.362064 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-d714fba0-56c0-4e74-891b-0fc0d03bb128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:40.375421 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b036e954-0fb2-43b6-bbef-90d5c3887d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90f80819ac11434fae0dd1eec2f8be01', 'request_id': 'req-b036e954-0fb2-43b6-bbef-90d5c3887d49'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:40.406328 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b036e954-0fb2-43b6-bbef-90d5c3887d49 admin admin] The token cache is being invalidate because project 90f80819ac11434fae0dd1eec2f8be01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:32:40.406620 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b036e954-0fb2-43b6-bbef-90d5c3887d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:40.412846 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b036e954-0fb2-43b6-bbef-90d5c3887d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:40.418198 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 899/1814] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:32:39 2022] DELETE /identity/v3/projects/90f80819ac11434fae0dd1eec2f8be01 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:32:40.419946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e3e39-9171-46dc-8923-4b7a66e901e0 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:40.420236 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e3e39-9171-46dc-8923-4b7a66e901e0 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:40.420518 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e3e39-9171-46dc-8923-4b7a66e901e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:40.471394 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-898e3e39-9171-46dc-8923-4b7a66e901e0 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:40.472921 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-898e3e39-9171-46dc-8923-4b7a66e901e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:40.584944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714fba0-56c0-4e74-891b-0fc0d03bb128 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:40.591170 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cf74b-b8c2-4cc0-81d9-4a0d944aeafe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:40.591808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cf74b-b8c2-4cc0-81d9-4a0d944aeafe service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:40.592097 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cf74b-b8c2-4cc0-81d9-4a0d944aeafe service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:40.592367 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cf74b-b8c2-4cc0-81d9-4a0d944aeafe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:40.594355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-895cf74b-b8c2-4cc0-81d9-4a0d944aeafe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:40.616771 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 900/1815] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:32:40.618186 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895cf74b-b8c2-4cc0-81d9-4a0d944aeafe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:40.620143 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895cf74b-b8c2-4cc0-81d9-4a0d944aeafe service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:40.627315 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c7d79-8819-4d31-b043-43798bc6e6e5 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:40.627919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c7d79-8819-4d31-b043-43798bc6e6e5 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:40.628181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c7d79-8819-4d31-b043-43798bc6e6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:40.650500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 916/1816] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:40.664053 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-b10c7d79-8819-4d31-b043-43798bc6e6e5 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:40.665412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-b10c7d79-8819-4d31-b043-43798bc6e6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:40.678478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 901/1817] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:32:40.679797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cf74b-b8c2-4cc0-81d9-4a0d944aeafe service nova] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:40.690576 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cf74b-b8c2-4cc0-81d9-4a0d944aeafe service nova] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:40.696109 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5607e4-e585-4247-9c09-5a41db74d454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:40.696801 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5607e4-e585-4247-9c09-5a41db74d454 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:40.697106 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5607e4-e585-4247-9c09-5a41db74d454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:40.697554 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5607e4-e585-4247-9c09-5a41db74d454 admin admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:40.698253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5607e4-e585-4247-9c09-5a41db74d454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:32:40.698559 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5607e4-e585-4247-9c09-5a41db74d454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:40.700426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5607e4-e585-4247-9c09-5a41db74d454 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:40.718233 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 917/1818] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:32:40.726186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c7d79-8819-4d31-b043-43798bc6e6e5 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:40.745031 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c7d79-8819-4d31-b043-43798bc6e6e5 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:40.752724 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca324c-a8e5-4f96-aa36-b84645a47e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:40.753549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca324c-a8e5-4f96-aa36-b84645a47e75 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:40.753834 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca324c-a8e5-4f96-aa36-b84645a47e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:40.754107 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca324c-a8e5-4f96-aa36-b84645a47e75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:40.755304 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca324c-a8e5-4f96-aa36-b84645a47e75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:40.757237 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca324c-a8e5-4f96-aa36-b84645a47e75 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:40.791072 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 902/1819] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:40 2022] POST /identity/v3/projects => generated 357 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:40.793732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5607e4-e585-4247-9c09-5a41db74d454 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:40.813360 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5607e4-e585-4247-9c09-5a41db74d454 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:40.854402 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:40.891723 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9333f-e965-445c-a63a-b0bfce0cc29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:40.892360 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9333f-e965-445c-a63a-b0bfce0cc29a admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:40.892640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9333f-e965-445c-a63a-b0bfce0cc29a admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:40.892908 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9333f-e965-445c-a63a-b0bfce0cc29a admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:40.896135 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9333f-e965-445c-a63a-b0bfce0cc29a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:40.896135 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9333f-e965-445c-a63a-b0bfce0cc29a admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:40.930954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca324c-a8e5-4f96-aa36-b84645a47e75 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:40.936975 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 918/1820] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:40 2022] POST /identity/v3/users => generated 279 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:32:40.946413 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca324c-a8e5-4f96-aa36-b84645a47e75 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:40.961326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9333f-e965-445c-a63a-b0bfce0cc29a admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:40.964332 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809b2c2-a979-448e-b8d5-aa404dfa0952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:40.965462 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809b2c2-a979-448e-b8d5-aa404dfa0952 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:40.966269 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-f9d9333f-e965-445c-a63a-b0bfce0cc29a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:40.966479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809b2c2-a979-448e-b8d5-aa404dfa0952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:40.967300 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809b2c2-a979-448e-b8d5-aa404dfa0952 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:40.969211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809b2c2-a979-448e-b8d5-aa404dfa0952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:40.971997 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809b2c2-a979-448e-b8d5-aa404dfa0952 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:40.991110 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9333f-e965-445c-a63a-b0bfce0cc29a admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:41.007857 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 903/1821] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:41.011952 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809b2c2-a979-448e-b8d5-aa404dfa0952 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:41.017398 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-2809b2c2-a979-448e-b8d5-aa404dfa0952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:41.022302 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64370e-bee9-43d7-9ce4-46234e71cec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:41.023277 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64370e-bee9-43d7-9ce4-46234e71cec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:41.023716 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64370e-bee9-43d7-9ce4-46234e71cec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:41.024129 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64370e-bee9-43d7-9ce4-46234e71cec2 admin admin] PATH_INFO: `/v3/projects/8dc91c3d02a14d1ba8a001f6530c87f7` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:41.025836 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64370e-bee9-43d7-9ce4-46234e71cec2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dc91c3d02a14d1ba8a001f6530c87f7)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:41.028595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64370e-bee9-43d7-9ce4-46234e71cec2 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:41.079206 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809b2c2-a979-448e-b8d5-aa404dfa0952 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:41.100547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8f64370e-bee9-43d7-9ce4-46234e71cec2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dc91c3d02a14d1ba8a001f6530c87f7', 'request_id': 'req-8f64370e-bee9-43d7-9ce4-46234e71cec2'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:41.117235 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8f64370e-bee9-43d7-9ce4-46234e71cec2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dc91c3d02a14d1ba8a001f6530c87f7', 'request_id': 'req-8f64370e-bee9-43d7-9ce4-46234e71cec2'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:41.126120 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8f64370e-bee9-43d7-9ce4-46234e71cec2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dc91c3d02a14d1ba8a001f6530c87f7', 'request_id': 'req-8f64370e-bee9-43d7-9ce4-46234e71cec2'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:41.139260 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8f64370e-bee9-43d7-9ce4-46234e71cec2 admin admin] The token cache is being invalidate because project 8dc91c3d02a14d1ba8a001f6530c87f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:32:41.139527 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8f64370e-bee9-43d7-9ce4-46234e71cec2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:41.140293 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8f64370e-bee9-43d7-9ce4-46234e71cec2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:41.142350 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 919/1822] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:32:40 2022] DELETE /identity/v3/projects/8dc91c3d02a14d1ba8a001f6530c87f7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:41.146932 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64370e-bee9-43d7-9ce4-46234e71cec2 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:41.148456 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8f64370e-bee9-43d7-9ce4-46234e71cec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:41.185538 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c3a93-f803-43f8-8945-9778869785e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:41.186190 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c3a93-f803-43f8-8945-9778869785e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:41.186475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c3a93-f803-43f8-8945-9778869785e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:41.186741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c3a93-f803-43f8-8945-9778869785e7 admin admin] PATH_INFO: `/v3/projects/fea75ca2941a485eb3be172174168f73` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:41.187921 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c3a93-f803-43f8-8945-9778869785e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fea75ca2941a485eb3be172174168f73)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:41.189868 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c3a93-f803-43f8-8945-9778869785e7 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:41.245899 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:41.261054 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-130c3a93-f803-43f8-8945-9778869785e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fea75ca2941a485eb3be172174168f73', 'request_id': 'req-130c3a93-f803-43f8-8945-9778869785e7'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:41.269595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64370e-bee9-43d7-9ce4-46234e71cec2 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:41.275255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-130c3a93-f803-43f8-8945-9778869785e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fea75ca2941a485eb3be172174168f73', 'request_id': 'req-130c3a93-f803-43f8-8945-9778869785e7'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:41.287820 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-130c3a93-f803-43f8-8945-9778869785e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fea75ca2941a485eb3be172174168f73', 'request_id': 'req-130c3a93-f803-43f8-8945-9778869785e7'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:41.318223 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-130c3a93-f803-43f8-8945-9778869785e7 admin admin] The token cache is being invalidate because project fea75ca2941a485eb3be172174168f73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:32:41.318607 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-130c3a93-f803-43f8-8945-9778869785e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:41.319566 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-130c3a93-f803-43f8-8945-9778869785e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:41.322596 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 904/1823] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:32:41 2022] DELETE /identity/v3/projects/fea75ca2941a485eb3be172174168f73 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:41.323966 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cb6d1-eece-422c-b771-70b32c37c4f4 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:41.324311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cb6d1-eece-422c-b771-70b32c37c4f4 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:41.324648 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cb6d1-eece-422c-b771-70b32c37c4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:41.347791 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-6d7cb6d1-eece-422c-b771-70b32c37c4f4 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:41.349047 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-6d7cb6d1-eece-422c-b771-70b32c37c4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:41.353915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:41.363179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5ec5b-5cbc-4f1d-8644-8afafae945b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:41.364525 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5ec5b-5cbc-4f1d-8644-8afafae945b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:41.364525 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5ec5b-5cbc-4f1d-8644-8afafae945b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:41.364922 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5ec5b-5cbc-4f1d-8644-8afafae945b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:41.366458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5ec5b-5cbc-4f1d-8644-8afafae945b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:41.368553 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5ec5b-5cbc-4f1d-8644-8afafae945b0 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:41.387865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 920/1824] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:41.389268 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e233e5-a1bc-4d2a-aa0f-bd7601728eb0 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:41.389558 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e233e5-a1bc-4d2a-aa0f-bd7601728eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:41.389828 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e233e5-a1bc-4d2a-aa0f-bd7601728eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:41.412792 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-e7e233e5-a1bc-4d2a-aa0f-bd7601728eb0 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:41.414139 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-e7e233e5-a1bc-4d2a-aa0f-bd7601728eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:41.416227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 905/1825] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:41.417236 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cb6d1-eece-422c-b771-70b32c37c4f4 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:41.418639 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-6d7cb6d1-eece-422c-b771-70b32c37c4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:41.428812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 921/1826] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:41.430161 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7c660-901c-4580-b9e9-3f0cedc6d258 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:41.430446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7c660-901c-4580-b9e9-3f0cedc6d258 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:41.430718 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7c660-901c-4580-b9e9-3f0cedc6d258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:41.431502 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cb6d1-eece-422c-b771-70b32c37c4f4 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:41.442665 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06a27e-9347-4473-a9ae-d621a6311038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:41.444203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06a27e-9347-4473-a9ae-d621a6311038 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:41.444556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06a27e-9347-4473-a9ae-d621a6311038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:41.444927 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06a27e-9347-4473-a9ae-d621a6311038 admin admin] PATH_INFO: `/v3/projects/a71d4ff6433e4b25b1d0991b8440b909/users/610d434525c24338b405e9f93bd96db3/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:41.453851 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-1be7c660-901c-4580-b9e9-3f0cedc6d258 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:41.455260 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-1be7c660-901c-4580-b9e9-3f0cedc6d258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:41.467725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 922/1827] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:41.469142 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474ee12-6ad4-490f-95a1-ebd8050d7c35 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:41.469364 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06a27e-9347-4473-a9ae-d621a6311038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a71d4ff6433e4b25b1d0991b8440b909, user_id=610d434525c24338b405e9f93bd96db3, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:41.469483 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474ee12-6ad4-490f-95a1-ebd8050d7c35 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:41.469678 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474ee12-6ad4-490f-95a1-ebd8050d7c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:41.472780 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06a27e-9347-4473-a9ae-d621a6311038 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:41.500240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 906/1828] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:41 2022] PUT /identity/v3/projects/a71d4ff6433e4b25b1d0991b8440b909/users/610d434525c24338b405e9f93bd96db3/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:41.501219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06a27e-9347-4473-a9ae-d621a6311038 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:41.515807 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-0474ee12-6ad4-490f-95a1-ebd8050d7c35 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:41.518267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-0474ee12-6ad4-490f-95a1-ebd8050d7c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:41.585920 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06a27e-9347-4473-a9ae-d621a6311038 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:41.591910 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b780eb2-9745-4ce6-9656-d1b975f9147e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:41.592370 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b780eb2-9745-4ce6-9656-d1b975f9147e admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:41.592483 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b780eb2-9745-4ce6-9656-d1b975f9147e admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:41.592713 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b780eb2-9745-4ce6-9656-d1b975f9147e admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:41.593394 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b780eb2-9745-4ce6-9656-d1b975f9147e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:32:41.593668 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b780eb2-9745-4ce6-9656-d1b975f9147e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:41.596098 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b780eb2-9745-4ce6-9656-d1b975f9147e admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:41.612230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 907/1829] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:32:41.613679 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e5745-b2e1-4cdc-a2ff-def97b4402fc None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:41.613966 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e5745-b2e1-4cdc-a2ff-def97b4402fc None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:41.614236 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e5745-b2e1-4cdc-a2ff-def97b4402fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:41.668070 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-d45e5745-b2e1-4cdc-a2ff-def97b4402fc None None] MFA Rules not processed for user `610d434525c24338b405e9f93bd96db3`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:41.669477 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-d45e5745-b2e1-4cdc-a2ff-def97b4402fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:41.676513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 923/1830] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:41.680696 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474ee12-6ad4-490f-95a1-ebd8050d7c35 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:41.726595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474ee12-6ad4-490f-95a1-ebd8050d7c35 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:41.739754 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:41.745041 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42add6a5-f952-4dff-bca2-a6865e8b415d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:41.746014 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42add6a5-f952-4dff-bca2-a6865e8b415d admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:41.746626 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42add6a5-f952-4dff-bca2-a6865e8b415d admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:41.747143 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42add6a5-f952-4dff-bca2-a6865e8b415d admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:41.748220 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42add6a5-f952-4dff-bca2-a6865e8b415d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:41.753620 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42add6a5-f952-4dff-bca2-a6865e8b415d admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:41.826134 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 924/1831] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:41 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:41.828535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42add6a5-f952-4dff-bca2-a6865e8b415d admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:41.831469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 908/1832] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:41.834528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e5745-b2e1-4cdc-a2ff-def97b4402fc None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:41.854719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e5745-b2e1-4cdc-a2ff-def97b4402fc None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:41.940433 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42add6a5-f952-4dff-bca2-a6865e8b415d admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:41.946649 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f662b-f6c0-4b7a-aacb-a2f7fdff57a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:41.947356 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f662b-f6c0-4b7a-aacb-a2f7fdff57a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:41.947638 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f662b-f6c0-4b7a-aacb-a2f7fdff57a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:41.947910 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f662b-f6c0-4b7a-aacb-a2f7fdff57a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:41.948559 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f662b-f6c0-4b7a-aacb-a2f7fdff57a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:41.950532 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f662b-f6c0-4b7a-aacb-a2f7fdff57a8 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:41.954730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f13fd2-e4a6-4ea5-8ff4-6204a87252d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:41.956974 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f13fd2-e4a6-4ea5-8ff4-6204a87252d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:41.957689 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f13fd2-e4a6-4ea5-8ff4-6204a87252d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:41.958314 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f13fd2-e4a6-4ea5-8ff4-6204a87252d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:41.960037 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f13fd2-e4a6-4ea5-8ff4-6204a87252d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:32:41.964292 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f13fd2-e4a6-4ea5-8ff4-6204a87252d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:41.965914 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f13fd2-e4a6-4ea5-8ff4-6204a87252d2 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:41.979145 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 909/1833] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:41 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:41.979145 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f662b-f6c0-4b7a-aacb-a2f7fdff57a8 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:41.993399 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f662b-f6c0-4b7a-aacb-a2f7fdff57a8 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:42.001754 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a9dc9-8740-47bb-842b-392598420216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:42.001754 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a9dc9-8740-47bb-842b-392598420216 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:42.001966 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a9dc9-8740-47bb-842b-392598420216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:42.002355 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a9dc9-8740-47bb-842b-392598420216 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:42.003229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a9dc9-8740-47bb-842b-392598420216 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:42.005574 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a9dc9-8740-47bb-842b-392598420216 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:42.028411 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 925/1834] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:32:42.029421 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f13fd2-e4a6-4ea5-8ff4-6204a87252d2 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:42.050887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f13fd2-e4a6-4ea5-8ff4-6204a87252d2 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:42.058736 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 910/1835] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:41 2022] POST /identity/v3/projects => generated 357 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:42.064818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a9dc9-8740-47bb-842b-392598420216 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:42.066844 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24851b91-90cc-4afc-92ad-064f8b7ee6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:42.067558 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24851b91-90cc-4afc-92ad-064f8b7ee6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:42.067907 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24851b91-90cc-4afc-92ad-064f8b7ee6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:42.068212 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24851b91-90cc-4afc-92ad-064f8b7ee6c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:42.068885 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24851b91-90cc-4afc-92ad-064f8b7ee6c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:42.070598 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24851b91-90cc-4afc-92ad-064f8b7ee6c1 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:42.099152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 926/1836] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:42.099152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24851b91-90cc-4afc-92ad-064f8b7ee6c1 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:42.112697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24851b91-90cc-4afc-92ad-064f8b7ee6c1 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:42.165567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:42.192854 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a9dc9-8740-47bb-842b-392598420216 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:42.198005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d56931-ba6c-496e-9515-6432a9ec09c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:42.198692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d56931-ba6c-496e-9515-6432a9ec09c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:42.198944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d56931-ba6c-496e-9515-6432a9ec09c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:42.199264 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d56931-ba6c-496e-9515-6432a9ec09c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:42.200271 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d56931-ba6c-496e-9515-6432a9ec09c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:42.202301 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d56931-ba6c-496e-9515-6432a9ec09c8 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:42.209743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873f3e3-12f8-49de-952e-d0d935d38a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:42.210545 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873f3e3-12f8-49de-952e-d0d935d38a33 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:42.210826 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873f3e3-12f8-49de-952e-d0d935d38a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:42.211177 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873f3e3-12f8-49de-952e-d0d935d38a33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:42.211832 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873f3e3-12f8-49de-952e-d0d935d38a33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:42.215122 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873f3e3-12f8-49de-952e-d0d935d38a33 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:42.248668 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 927/1837] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:42 2022] POST /identity/v3/users => generated 285 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:42.252250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d56931-ba6c-496e-9515-6432a9ec09c8 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:42.262229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 911/1838] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:42 2022] POST /identity/v3/projects => generated 371 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:42.263319 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873f3e3-12f8-49de-952e-d0d935d38a33 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:42.281677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:42.287353 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d56931-ba6c-496e-9515-6432a9ec09c8 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:42.373866 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9d9e2-f20b-4f7f-a542-f055f551c43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:42.374513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9d9e2-f20b-4f7f-a542-f055f551c43a admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:42.374761 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9d9e2-f20b-4f7f-a542-f055f551c43a admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:42.375057 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9d9e2-f20b-4f7f-a542-f055f551c43a admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:42.375528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873f3e3-12f8-49de-952e-d0d935d38a33 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:42.375713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9d9e2-f20b-4f7f-a542-f055f551c43a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:42.377469 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9d9e2-f20b-4f7f-a542-f055f551c43a admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:42.382171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f92469-7a76-48d1-bac4-bbefa4b50e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:42.386057 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f92469-7a76-48d1-bac4-bbefa4b50e33 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:42.386629 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f92469-7a76-48d1-bac4-bbefa4b50e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:42.387275 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f92469-7a76-48d1-bac4-bbefa4b50e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:42.388171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f92469-7a76-48d1-bac4-bbefa4b50e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:42.390006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f92469-7a76-48d1-bac4-bbefa4b50e33 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:42.393910 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 928/1839] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:42.393910 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9d9e2-f20b-4f7f-a542-f055f551c43a admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:42.408813 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9d9e2-f20b-4f7f-a542-f055f551c43a admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:42.412554 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 912/1840] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:42.412554 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f92469-7a76-48d1-bac4-bbefa4b50e33 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:42.422155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781e5f1-40af-4c98-9758-7a6f23f6d39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:42.423146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781e5f1-40af-4c98-9758-7a6f23f6d39d admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:42.423146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781e5f1-40af-4c98-9758-7a6f23f6d39d admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:42.423354 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781e5f1-40af-4c98-9758-7a6f23f6d39d admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:42.423993 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781e5f1-40af-4c98-9758-7a6f23f6d39d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:42.426136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781e5f1-40af-4c98-9758-7a6f23f6d39d admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:42.434424 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f92469-7a76-48d1-bac4-bbefa4b50e33 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:42.442383 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139a584-daf1-4fb9-92ce-e12a2c33961f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:42.443870 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139a584-daf1-4fb9-92ce-e12a2c33961f admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:42.443870 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139a584-daf1-4fb9-92ce-e12a2c33961f admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:42.443870 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139a584-daf1-4fb9-92ce-e12a2c33961f admin admin] PATH_INFO: `/v3/projects/9d849a4d1f1646efb577167d41c713d6/users/317aa855716a4f56ab2313a01addbf96/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:42.461257 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139a584-daf1-4fb9-92ce-e12a2c33961f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d849a4d1f1646efb577167d41c713d6, user_id=317aa855716a4f56ab2313a01addbf96, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:42.464139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139a584-daf1-4fb9-92ce-e12a2c33961f admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:42.465291 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 929/1841] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:42 2022] POST /identity/v3/users => generated 286 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:42.467636 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781e5f1-40af-4c98-9758-7a6f23f6d39d admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:42.481181 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781e5f1-40af-4c98-9758-7a6f23f6d39d admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:42.497280 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 913/1842] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:42 2022] PUT /identity/v3/projects/9d849a4d1f1646efb577167d41c713d6/users/317aa855716a4f56ab2313a01addbf96/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:42.497280 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139a584-daf1-4fb9-92ce-e12a2c33961f admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:42.502299 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37974427-6b65-4cc0-8903-d9318b625478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:42.503208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37974427-6b65-4cc0-8903-d9318b625478 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:42.503648 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37974427-6b65-4cc0-8903-d9318b625478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:42.504063 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37974427-6b65-4cc0-8903-d9318b625478 admin admin] PATH_INFO: `/v3/projects/e2a94422e488441fbc9a2b7ee7991240/users/0b0982ddb5a14fd08553ed2aa37d572c/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:42.524095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37974427-6b65-4cc0-8903-d9318b625478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2a94422e488441fbc9a2b7ee7991240, user_id=0b0982ddb5a14fd08553ed2aa37d572c, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:42.527940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37974427-6b65-4cc0-8903-d9318b625478 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:42.547652 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 930/1843] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:42 2022] PUT /identity/v3/projects/e2a94422e488441fbc9a2b7ee7991240/users/0b0982ddb5a14fd08553ed2aa37d572c/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:42.549512 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afe9b9-2f95-4d78-99e3-9fae91514811 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:42.549923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afe9b9-2f95-4d78-99e3-9fae91514811 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:42.550327 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afe9b9-2f95-4d78-99e3-9fae91514811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:42.584582 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139a584-daf1-4fb9-92ce-e12a2c33961f admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:42.613610 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-89afe9b9-2f95-4d78-99e3-9fae91514811 None None] MFA Rules not processed for user `317aa855716a4f56ab2313a01addbf96`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:42.614834 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-89afe9b9-2f95-4d78-99e3-9fae91514811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:42.673504 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9a33c-cf35-4ce3-b123-23eedee0084f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:42.674141 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9a33c-cf35-4ce3-b123-23eedee0084f admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:42.674413 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9a33c-cf35-4ce3-b123-23eedee0084f admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:42.674679 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9a33c-cf35-4ce3-b123-23eedee0084f admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:42.675357 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9a33c-cf35-4ce3-b123-23eedee0084f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:42.677427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9a33c-cf35-4ce3-b123-23eedee0084f admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:42.694266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 914/1844] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:42.694266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9a33c-cf35-4ce3-b123-23eedee0084f admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:42.706438 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9a33c-cf35-4ce3-b123-23eedee0084f admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:42.711120 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 931/1845] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:42.712236 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afe9b9-2f95-4d78-99e3-9fae91514811 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:42.718107 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80e222-87e3-4c95-87bf-a35e7825a988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:42.718632 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80e222-87e3-4c95-87bf-a35e7825a988 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:42.718953 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80e222-87e3-4c95-87bf-a35e7825a988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:42.719257 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80e222-87e3-4c95-87bf-a35e7825a988 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:42.720052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80e222-87e3-4c95-87bf-a35e7825a988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:42.723130 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80e222-87e3-4c95-87bf-a35e7825a988 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:42.729709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afe9b9-2f95-4d78-99e3-9fae91514811 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:42.736977 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599fc9ab-b2d9-4412-bb86-83cd43e34f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:42.737610 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fc9ab-b2d9-4412-bb86-83cd43e34f08 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:42.737883 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fc9ab-b2d9-4412-bb86-83cd43e34f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:42.738148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fc9ab-b2d9-4412-bb86-83cd43e34f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:42.738817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599fc9ab-b2d9-4412-bb86-83cd43e34f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:42.740494 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599fc9ab-b2d9-4412-bb86-83cd43e34f08 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:42.747083 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 915/1846] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:42.747083 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80e222-87e3-4c95-87bf-a35e7825a988 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:42.753556 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 932/1847] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:42.755183 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599fc9ab-b2d9-4412-bb86-83cd43e34f08 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:42.760751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:42.765304 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80e222-87e3-4c95-87bf-a35e7825a988 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:42.769845 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599fc9ab-b2d9-4412-bb86-83cd43e34f08 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:42.773406 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd2b3e-046b-44a1-b6da-54fcaded61e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:42.774285 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd2b3e-046b-44a1-b6da-54fcaded61e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:42.774883 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd2b3e-046b-44a1-b6da-54fcaded61e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:42.775986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd2b3e-046b-44a1-b6da-54fcaded61e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:42.776837 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd2b3e-046b-44a1-b6da-54fcaded61e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:42.777205 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222814a3-b7f4-4f6c-bf80-eabbfb00e769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:42.777885 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222814a3-b7f4-4f6c-bf80-eabbfb00e769 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:42.778154 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222814a3-b7f4-4f6c-bf80-eabbfb00e769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:42.778827 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222814a3-b7f4-4f6c-bf80-eabbfb00e769 admin admin] PATH_INFO: `/v3/projects/e2a94422e488441fbc9a2b7ee7991240/users/0b0982ddb5a14fd08553ed2aa37d572c/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:42.780834 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222814a3-b7f4-4f6c-bf80-eabbfb00e769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2a94422e488441fbc9a2b7ee7991240, user_id=0b0982ddb5a14fd08553ed2aa37d572c, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:42.781372 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd2b3e-046b-44a1-b6da-54fcaded61e1 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:42.783560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222814a3-b7f4-4f6c-bf80-eabbfb00e769 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:42.805975 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 933/1848] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:42 2022] PUT /identity/v3/projects/e2a94422e488441fbc9a2b7ee7991240/users/0b0982ddb5a14fd08553ed2aa37d572c/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:42.805975 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222814a3-b7f4-4f6c-bf80-eabbfb00e769 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:42.841650 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:42.871554 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 916/1849] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:42 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:42.873563 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023a0e5-c608-41f5-abca-2b8391be0f4a None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:42.873895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023a0e5-c608-41f5-abca-2b8391be0f4a None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:42.875016 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023a0e5-c608-41f5-abca-2b8391be0f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:42.897164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222814a3-b7f4-4f6c-bf80-eabbfb00e769 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:42.909321 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-8023a0e5-c608-41f5-abca-2b8391be0f4a None None] MFA Rules not processed for user `0b0982ddb5a14fd08553ed2aa37d572c`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:42.910562 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-8023a0e5-c608-41f5-abca-2b8391be0f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:42.970465 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e566700-ae54-4ab1-8297-8582ba1cc38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:42.971227 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e566700-ae54-4ab1-8297-8582ba1cc38a admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:42.971568 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e566700-ae54-4ab1-8297-8582ba1cc38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:42.972112 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e566700-ae54-4ab1-8297-8582ba1cc38a admin admin] PATH_INFO: `/v3/projects/70b9de8d8b5647f4bf2ff65849fce857/users/f9229da833ad4621866c5ee98c24c8f8/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:42.983618 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 917/1850] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:42 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:42.984524 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023a0e5-c608-41f5-abca-2b8391be0f4a None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:42.992990 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e566700-ae54-4ab1-8297-8582ba1cc38a admin admin] RBAC: Authorizing `identity:create_grant(project_id=70b9de8d8b5647f4bf2ff65849fce857, user_id=f9229da833ad4621866c5ee98c24c8f8, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:42.995271 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023a0e5-c608-41f5-abca-2b8391be0f4a None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:42.996192 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e566700-ae54-4ab1-8297-8582ba1cc38a admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:43.001072 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4240ba6-7b6c-4106-958e-67539d844c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:43.001777 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4240ba6-7b6c-4106-958e-67539d844c7b admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:43.002121 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4240ba6-7b6c-4106-958e-67539d844c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:43.002460 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4240ba6-7b6c-4106-958e-67539d844c7b admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:43.003290 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4240ba6-7b6c-4106-958e-67539d844c7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:43.005411 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4240ba6-7b6c-4106-958e-67539d844c7b admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:43.015458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 934/1851] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:42 2022] PUT /identity/v3/projects/70b9de8d8b5647f4bf2ff65849fce857/users/f9229da833ad4621866c5ee98c24c8f8/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:43.016472 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e566700-ae54-4ab1-8297-8582ba1cc38a admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:43.018313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-3e566700-ae54-4ab1-8297-8582ba1cc38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:43.036310 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 918/1852] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:42 2022] POST /identity/v3/users => generated 290 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:43.036310 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f7fd3-9c93-47d4-acfe-b52fa4a20069 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:43.036310 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f7fd3-9c93-47d4-acfe-b52fa4a20069 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:43.036310 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f7fd3-9c93-47d4-acfe-b52fa4a20069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:43.056746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-df6f7fd3-9c93-47d4-acfe-b52fa4a20069 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:43.056933 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-df6f7fd3-9c93-47d4-acfe-b52fa4a20069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:43.106860 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e566700-ae54-4ab1-8297-8582ba1cc38a admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:43.113853 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddbd41-379c-4f07-b610-b5cc602943d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:43.114564 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddbd41-379c-4f07-b610-b5cc602943d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:43.114912 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddbd41-379c-4f07-b610-b5cc602943d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:43.115299 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddbd41-379c-4f07-b610-b5cc602943d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:43.145073 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 919/1853] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:43.146658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f7fd3-9c93-47d4-acfe-b52fa4a20069 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:43.162735 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f7fd3-9c93-47d4-acfe-b52fa4a20069 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:43.165157 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:43.168657 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c910f12-2a6f-47ee-85f0-7494309d2292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:43.169469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c910f12-2a6f-47ee-85f0-7494309d2292 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:43.170195 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c910f12-2a6f-47ee-85f0-7494309d2292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:43.170493 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c910f12-2a6f-47ee-85f0-7494309d2292 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:43.171313 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c910f12-2a6f-47ee-85f0-7494309d2292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:43.173413 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c910f12-2a6f-47ee-85f0-7494309d2292 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:43.185568 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 920/1854] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:43.186435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c910f12-2a6f-47ee-85f0-7494309d2292 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:43.188281 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-3c910f12-2a6f-47ee-85f0-7494309d2292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:43.210647 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddbd41-379c-4f07-b610-b5cc602943d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:43.212588 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddbd41-379c-4f07-b610-b5cc602943d0 service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:43.234046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 935/1855] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:43 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:43.236689 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddbd41-379c-4f07-b610-b5cc602943d0 service cinder] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:43.257234 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddbd41-379c-4f07-b610-b5cc602943d0 service cinder] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:43.274154 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892aa99-155a-4e3e-9687-4a39191d83ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:43.275778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892aa99-155a-4e3e-9687-4a39191d83ce admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:43.275937 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c910f12-2a6f-47ee-85f0-7494309d2292 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:43.276825 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892aa99-155a-4e3e-9687-4a39191d83ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:43.277108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892aa99-155a-4e3e-9687-4a39191d83ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:43.278607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892aa99-155a-4e3e-9687-4a39191d83ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:43.280213 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1ebc5-dba8-45cb-bdb7-be75b6d805df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:43.280834 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1ebc5-dba8-45cb-bdb7-be75b6d805df service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:43.281118 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1ebc5-dba8-45cb-bdb7-be75b6d805df service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:43.281386 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1ebc5-dba8-45cb-bdb7-be75b6d805df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:43.282121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892aa99-155a-4e3e-9687-4a39191d83ce admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:43.295138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:43.306131 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1ebc5-dba8-45cb-bdb7-be75b6d805df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:43.306687 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 936/1856] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:43.307930 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1ebc5-dba8-45cb-bdb7-be75b6d805df service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:43.312836 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892aa99-155a-4e3e-9687-4a39191d83ce admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:43.329056 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892aa99-155a-4e3e-9687-4a39191d83ce admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:43.332290 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 921/1857] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:43.342244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5674b-598e-4fe2-98fb-b7d27c3f819f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:43.343292 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5674b-598e-4fe2-98fb-b7d27c3f819f admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:43.343661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5674b-598e-4fe2-98fb-b7d27c3f819f admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:43.344009 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5674b-598e-4fe2-98fb-b7d27c3f819f admin admin] PATH_INFO: `/v3/projects/ea6bc2e28e5c4aeb8e7b2f254985d98c/users/d41026ed0deb4ab0a42bcc16152a2d44/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:43.349510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1ebc5-dba8-45cb-bdb7-be75b6d805df service neutron] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:43.365329 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1ebc5-dba8-45cb-bdb7-be75b6d805df service neutron] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:43.372890 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c7640-7765-44dc-9d40-98055b8df4c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:43.373664 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c7640-7765-44dc-9d40-98055b8df4c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:43.375035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c7640-7765-44dc-9d40-98055b8df4c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:43.375035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c7640-7765-44dc-9d40-98055b8df4c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:43.383208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5674b-598e-4fe2-98fb-b7d27c3f819f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea6bc2e28e5c4aeb8e7b2f254985d98c, user_id=d41026ed0deb4ab0a42bcc16152a2d44, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:43.390235 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5674b-598e-4fe2-98fb-b7d27c3f819f admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:43.426395 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 937/1858] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:43 2022] PUT /identity/v3/projects/ea6bc2e28e5c4aeb8e7b2f254985d98c/users/d41026ed0deb4ab0a42bcc16152a2d44/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:43.437910 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255cdfa-1e03-40cc-8f54-92c96508b074 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:43.439311 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255cdfa-1e03-40cc-8f54-92c96508b074 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:43.439311 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255cdfa-1e03-40cc-8f54-92c96508b074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:43.490892 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-9255cdfa-1e03-40cc-8f54-92c96508b074 None None] MFA Rules not processed for user `d41026ed0deb4ab0a42bcc16152a2d44`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:43.492651 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-9255cdfa-1e03-40cc-8f54-92c96508b074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:43.516187 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c7640-7765-44dc-9d40-98055b8df4c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:43.524909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c7640-7765-44dc-9d40-98055b8df4c7 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:43.551144 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 922/1859] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:32:43.636235 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 938/1860] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:32:43.641785 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c7640-7765-44dc-9d40-98055b8df4c7 service cinder] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:43.663839 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255cdfa-1e03-40cc-8f54-92c96508b074 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:43.665304 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-9255cdfa-1e03-40cc-8f54-92c96508b074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:43.667865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c7640-7765-44dc-9d40-98055b8df4c7 service cinder] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:43.765315 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255cdfa-1e03-40cc-8f54-92c96508b074 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:43.765808 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011542e6-32db-4a6e-9d7c-8ebbae352c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:43.766433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011542e6-32db-4a6e-9d7c-8ebbae352c6b admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:43.766738 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011542e6-32db-4a6e-9d7c-8ebbae352c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:43.766954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011542e6-32db-4a6e-9d7c-8ebbae352c6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:43.767628 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011542e6-32db-4a6e-9d7c-8ebbae352c6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:43.770366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011542e6-32db-4a6e-9d7c-8ebbae352c6b admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:43.777106 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882c8aa-a6bf-4318-9fa8-9a4f38a945f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:43.778243 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882c8aa-a6bf-4318-9fa8-9a4f38a945f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:43.778650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882c8aa-a6bf-4318-9fa8-9a4f38a945f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:43.779551 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882c8aa-a6bf-4318-9fa8-9a4f38a945f2 admin admin] PATH_INFO: `/v3/users/e38a93b37cef47d7af138269bec008cb` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:43.783112 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882c8aa-a6bf-4318-9fa8-9a4f38a945f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e38a93b37cef47d7af138269bec008cb)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:43.786280 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882c8aa-a6bf-4318-9fa8-9a4f38a945f2 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:43.818047 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 923/1861] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:43 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:43.822258 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011542e6-32db-4a6e-9d7c-8ebbae352c6b admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:43.854174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:43.900747 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5882c8aa-a6bf-4318-9fa8-9a4f38a945f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e38a93b37cef47d7af138269bec008cb'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:43.901562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5882c8aa-a6bf-4318-9fa8-9a4f38a945f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e38a93b37cef47d7af138269bec008cb'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:43.912583 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5882c8aa-a6bf-4318-9fa8-9a4f38a945f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e38a93b37cef47d7af138269bec008cb'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:43.924772 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5882c8aa-a6bf-4318-9fa8-9a4f38a945f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e38a93b37cef47d7af138269bec008cb'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:43.927537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011542e6-32db-4a6e-9d7c-8ebbae352c6b admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:43.927993 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5882c8aa-a6bf-4318-9fa8-9a4f38a945f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e38a93b37cef47d7af138269bec008cb'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:43.939067 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d37054-6b6b-4e01-8643-c1edf10ffdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:43.939767 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d37054-6b6b-4e01-8643-c1edf10ffdfb admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:43.940051 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d37054-6b6b-4e01-8643-c1edf10ffdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:43.940324 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d37054-6b6b-4e01-8643-c1edf10ffdfb admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:43.942580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d37054-6b6b-4e01-8643-c1edf10ffdfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:43.946073 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d37054-6b6b-4e01-8643-c1edf10ffdfb admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:43.961972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 939/1862] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:32:43 2022] DELETE /identity/v3/users/e38a93b37cef47d7af138269bec008cb => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:43.967498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e079af-7a83-4253-b3cb-2223f05f3cb0 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:43.967987 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e079af-7a83-4253-b3cb-2223f05f3cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:43.969212 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e079af-7a83-4253-b3cb-2223f05f3cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:43.985011 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 924/1863] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:43 2022] POST /identity/v3/users => generated 296 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:43.989980 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d37054-6b6b-4e01-8643-c1edf10ffdfb admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:43.991999 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c8d37054-6b6b-4e01-8643-c1edf10ffdfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:44.003495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-b3e079af-7a83-4253-b3cb-2223f05f3cb0 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:44.005031 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b3e079af-7a83-4253-b3cb-2223f05f3cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:44.006194 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d37054-6b6b-4e01-8643-c1edf10ffdfb admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:44.011869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:44.097972 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98809294-70b3-4175-aff1-1474aff3a0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:44.098752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98809294-70b3-4175-aff1-1474aff3a0fc admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:44.099166 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98809294-70b3-4175-aff1-1474aff3a0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:44.099551 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98809294-70b3-4175-aff1-1474aff3a0fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:44.100461 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98809294-70b3-4175-aff1-1474aff3a0fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:44.102523 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98809294-70b3-4175-aff1-1474aff3a0fc admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:44.104189 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 940/1864] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:32:44.114487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e079af-7a83-4253-b3cb-2223f05f3cb0 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:44.115948 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 925/1865] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:44.116908 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b3e079af-7a83-4253-b3cb-2223f05f3cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:44.120076 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98809294-70b3-4175-aff1-1474aff3a0fc admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:44.133481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98809294-70b3-4175-aff1-1474aff3a0fc admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:44.145237 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f5c11-ae3b-4e30-bb41-e28296e9ff8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:44.146467 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f5c11-ae3b-4e30-bb41-e28296e9ff8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:44.147076 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f5c11-ae3b-4e30-bb41-e28296e9ff8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:44.147354 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f5c11-ae3b-4e30-bb41-e28296e9ff8d admin admin] PATH_INFO: `/v3/projects/b8791b9d0c744482a6e5741aed06bf03/users/b3331767166d44279d42b3fd99b3e06a/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:44.165467 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f5c11-ae3b-4e30-bb41-e28296e9ff8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8791b9d0c744482a6e5741aed06bf03, user_id=b3331767166d44279d42b3fd99b3e06a, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:44.168987 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f5c11-ae3b-4e30-bb41-e28296e9ff8d admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:44.192564 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 926/1866] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:44 2022] PUT /identity/v3/projects/b8791b9d0c744482a6e5741aed06bf03/users/b3331767166d44279d42b3fd99b3e06a/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:44.197802 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e079af-7a83-4253-b3cb-2223f05f3cb0 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:44.198221 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f5c11-ae3b-4e30-bb41-e28296e9ff8d admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:44.274626 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff9c93-5a67-407e-a6aa-4e0d06adbc3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:44.275800 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff9c93-5a67-407e-a6aa-4e0d06adbc3a service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:44.276292 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff9c93-5a67-407e-a6aa-4e0d06adbc3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:44.276775 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff9c93-5a67-407e-a6aa-4e0d06adbc3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:44.284681 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f5c11-ae3b-4e30-bb41-e28296e9ff8d admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:44.290466 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff9c93-5a67-407e-a6aa-4e0d06adbc3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:44.291590 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63bf74-06b6-49a9-970f-e0b4079f5990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:44.292268 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63bf74-06b6-49a9-970f-e0b4079f5990 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:44.292680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63bf74-06b6-49a9-970f-e0b4079f5990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:44.292959 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63bf74-06b6-49a9-970f-e0b4079f5990 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:44.293416 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff9c93-5a67-407e-a6aa-4e0d06adbc3a service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:44.293613 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63bf74-06b6-49a9-970f-e0b4079f5990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:44.295369 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63bf74-06b6-49a9-970f-e0b4079f5990 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:44.312135 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 941/1867] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:32:44.312293 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 927/1868] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:44.313353 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63bf74-06b6-49a9-970f-e0b4079f5990 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:44.325053 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63bf74-06b6-49a9-970f-e0b4079f5990 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:44.332152 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6db0c-d001-4a66-b3db-5e04ffec5b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:44.333097 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6db0c-d001-4a66-b3db-5e04ffec5b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:44.333438 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6db0c-d001-4a66-b3db-5e04ffec5b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:44.333816 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6db0c-d001-4a66-b3db-5e04ffec5b02 admin admin] PATH_INFO: `/v3/projects/b8791b9d0c744482a6e5741aed06bf03/users/b3331767166d44279d42b3fd99b3e06a/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:44.336069 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6db0c-d001-4a66-b3db-5e04ffec5b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8791b9d0c744482a6e5741aed06bf03, user_id=b3331767166d44279d42b3fd99b3e06a, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:44.339273 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6db0c-d001-4a66-b3db-5e04ffec5b02 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:44.361328 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 928/1869] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:44 2022] PUT /identity/v3/projects/b8791b9d0c744482a6e5741aed06bf03/users/b3331767166d44279d42b3fd99b3e06a/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:44.363829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9f1f5-117f-49e4-b3fc-ec7626513162 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:44.364378 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9f1f5-117f-49e4-b3fc-ec7626513162 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:44.364826 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9f1f5-117f-49e4-b3fc-ec7626513162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:44.376095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:44.417931 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-9da9f1f5-117f-49e4-b3fc-ec7626513162 None None] MFA Rules not processed for user `b3331767166d44279d42b3fd99b3e06a`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:44.420221 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-9da9f1f5-117f-49e4-b3fc-ec7626513162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:44.468640 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3d54b-09e3-4a37-8c7e-bbd9692206dc None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:44.469069 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3d54b-09e3-4a37-8c7e-bbd9692206dc None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:44.471064 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3d54b-09e3-4a37-8c7e-bbd9692206dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:44.509019 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-61e3d54b-09e3-4a37-8c7e-bbd9692206dc None None] MFA Rules not processed for user `f9229da833ad4621866c5ee98c24c8f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:44.510414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-61e3d54b-09e3-4a37-8c7e-bbd9692206dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:44.552650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 942/1870] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:44 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:44.567990 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9f1f5-117f-49e4-b3fc-ec7626513162 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:44.570067 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-9da9f1f5-117f-49e4-b3fc-ec7626513162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:44.603905 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:44.626385 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 929/1871] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:44.627817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3d54b-09e3-4a37-8c7e-bbd9692206dc None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:44.631206 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-61e3d54b-09e3-4a37-8c7e-bbd9692206dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:44.706018 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9f1f5-117f-49e4-b3fc-ec7626513162 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:44.718299 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d35f0-9153-4fa2-94e1-879aa010a3f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:44.719237 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d35f0-9153-4fa2-94e1-879aa010a3f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:44.719714 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d35f0-9153-4fa2-94e1-879aa010a3f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:44.720535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d35f0-9153-4fa2-94e1-879aa010a3f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:44.745948 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d35f0-9153-4fa2-94e1-879aa010a3f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:44.752298 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d35f0-9153-4fa2-94e1-879aa010a3f1 service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:44.795168 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3d54b-09e3-4a37-8c7e-bbd9692206dc None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:44.812681 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 943/1872] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:44.816787 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d35f0-9153-4fa2-94e1-879aa010a3f1 service cinder] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:44.818673 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8b2d35f0-9153-4fa2-94e1-879aa010a3f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:44.848017 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c0ca1-5f5c-4b8f-9785-0075596f4f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:44.849094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c0ca1-5f5c-4b8f-9785-0075596f4f3a admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:44.849851 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d35f0-9153-4fa2-94e1-879aa010a3f1 service cinder] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:44.850050 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c0ca1-5f5c-4b8f-9785-0075596f4f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:44.850793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c0ca1-5f5c-4b8f-9785-0075596f4f3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:44.854358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c0ca1-5f5c-4b8f-9785-0075596f4f3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:44.860588 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7a96c-55ae-45eb-a968-f9e42dbb68d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:44.864122 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7a96c-55ae-45eb-a968-f9e42dbb68d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:44.865184 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7a96c-55ae-45eb-a968-f9e42dbb68d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:44.865184 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7a96c-55ae-45eb-a968-f9e42dbb68d7 admin admin] PATH_INFO: `/v3/projects/a2aebdceb8a248c986e1122b08282506` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:44.867791 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7a96c-55ae-45eb-a968-f9e42dbb68d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2aebdceb8a248c986e1122b08282506)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:44.868293 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c0ca1-5f5c-4b8f-9785-0075596f4f3a admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:44.873147 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7a96c-55ae-45eb-a968-f9e42dbb68d7 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:45.010199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 930/1873] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:44 2022] POST /identity/v3/projects => generated 371 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:45.011599 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c0ca1-5f5c-4b8f-9785-0075596f4f3a admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:45.018066 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-2d6c0ca1-5f5c-4b8f-9785-0075596f4f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:45.048481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-bfd7a96c-55ae-45eb-a968-f9e42dbb68d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2aebdceb8a248c986e1122b08282506', 'request_id': 'req-bfd7a96c-55ae-45eb-a968-f9e42dbb68d7'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:45.081713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-bfd7a96c-55ae-45eb-a968-f9e42dbb68d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2aebdceb8a248c986e1122b08282506', 'request_id': 'req-bfd7a96c-55ae-45eb-a968-f9e42dbb68d7'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:45.096532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-bfd7a96c-55ae-45eb-a968-f9e42dbb68d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2aebdceb8a248c986e1122b08282506', 'request_id': 'req-bfd7a96c-55ae-45eb-a968-f9e42dbb68d7'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:45.124092 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-bfd7a96c-55ae-45eb-a968-f9e42dbb68d7 admin admin] The token cache is being invalidate because project a2aebdceb8a248c986e1122b08282506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:32:45.124396 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-bfd7a96c-55ae-45eb-a968-f9e42dbb68d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:45.125805 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-bfd7a96c-55ae-45eb-a968-f9e42dbb68d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:45.130952 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 944/1874] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:32:44 2022] DELETE /identity/v3/projects/a2aebdceb8a248c986e1122b08282506 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:45.136423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7a96c-55ae-45eb-a968-f9e42dbb68d7 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:45.155400 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-bfd7a96c-55ae-45eb-a968-f9e42dbb68d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:45.185449 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c0ca1-5f5c-4b8f-9785-0075596f4f3a admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:45.187903 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:45.191112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377587c8-c7c6-47e7-8f7b-824d545b3fa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:45.191899 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377587c8-c7c6-47e7-8f7b-824d545b3fa2 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:45.192669 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377587c8-c7c6-47e7-8f7b-824d545b3fa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:45.192669 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377587c8-c7c6-47e7-8f7b-824d545b3fa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:45.194514 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-377587c8-c7c6-47e7-8f7b-824d545b3fa2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:45.279076 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377587c8-c7c6-47e7-8f7b-824d545b3fa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:45.280731 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377587c8-c7c6-47e7-8f7b-824d545b3fa2 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:45.291658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 931/1875] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:45.293362 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377587c8-c7c6-47e7-8f7b-824d545b3fa2 service cinder] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:45.294579 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-377587c8-c7c6-47e7-8f7b-824d545b3fa2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:45.314018 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7a96c-55ae-45eb-a968-f9e42dbb68d7 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:45.331722 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:45.422879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c927b-5612-4b35-87f3-f680a218d29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:45.424122 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c927b-5612-4b35-87f3-f680a218d29e admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:45.424122 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c927b-5612-4b35-87f3-f680a218d29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:45.426360 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c927b-5612-4b35-87f3-f680a218d29e admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:45.430300 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c927b-5612-4b35-87f3-f680a218d29e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:45.434346 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c927b-5612-4b35-87f3-f680a218d29e admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:45.435402 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377587c8-c7c6-47e7-8f7b-824d545b3fa2 service cinder] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:45.455788 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2b061-176e-4e39-8ff7-1413a250164d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:45.456475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2b061-176e-4e39-8ff7-1413a250164d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:45.456754 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2b061-176e-4e39-8ff7-1413a250164d admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:45.457066 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2b061-176e-4e39-8ff7-1413a250164d admin admin] PATH_INFO: `/v3/users/7abd1772b8674027ae3d0d2f048dc20e` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:45.458262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2b061-176e-4e39-8ff7-1413a250164d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7abd1772b8674027ae3d0d2f048dc20e)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:45.460236 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2b061-176e-4e39-8ff7-1413a250164d admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:45.469807 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 945/1876] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:45 2022] POST /identity/v3/users => generated 292 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:45.473880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c927b-5612-4b35-87f3-f680a218d29e admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:45.485913 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c927b-5612-4b35-87f3-f680a218d29e admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:45.494110 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48f080-b317-46f0-a34d-bea257d2e0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:45.494875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48f080-b317-46f0-a34d-bea257d2e0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:45.495202 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48f080-b317-46f0-a34d-bea257d2e0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:45.495477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48f080-b317-46f0-a34d-bea257d2e0f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:45.496139 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48f080-b317-46f0-a34d-bea257d2e0f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:45.498850 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48f080-b317-46f0-a34d-bea257d2e0f5 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:45.520331 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 946/1877] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:45.523171 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48f080-b317-46f0-a34d-bea257d2e0f5 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:45.535384 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48f080-b317-46f0-a34d-bea257d2e0f5 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:45.540426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b4254-16da-42fa-b28d-2d83bb06e580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:45.541491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b4254-16da-42fa-b28d-2d83bb06e580 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:45.542161 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b4254-16da-42fa-b28d-2d83bb06e580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:45.542693 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b4254-16da-42fa-b28d-2d83bb06e580 admin admin] PATH_INFO: `/v3/projects/cdf37ae4b6854e93a79c8d1dfce8a9a6/users/b91f9343e5c54a9892203d16c52a4f40/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:45.563171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-69c2b061-176e-4e39-8ff7-1413a250164d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7abd1772b8674027ae3d0d2f048dc20e'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:45.563867 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-69c2b061-176e-4e39-8ff7-1413a250164d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7abd1772b8674027ae3d0d2f048dc20e'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:45.577720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-69c2b061-176e-4e39-8ff7-1413a250164d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7abd1772b8674027ae3d0d2f048dc20e'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:45.578589 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-69c2b061-176e-4e39-8ff7-1413a250164d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7abd1772b8674027ae3d0d2f048dc20e'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:45.597494 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b4254-16da-42fa-b28d-2d83bb06e580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf37ae4b6854e93a79c8d1dfce8a9a6, user_id=b91f9343e5c54a9892203d16c52a4f40, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:45.601109 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b4254-16da-42fa-b28d-2d83bb06e580 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:45.605447 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-69c2b061-176e-4e39-8ff7-1413a250164d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7abd1772b8674027ae3d0d2f048dc20e'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:45.625440 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 947/1878] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:45 2022] PUT /identity/v3/projects/cdf37ae4b6854e93a79c8d1dfce8a9a6/users/b91f9343e5c54a9892203d16c52a4f40/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:45.628520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b4254-16da-42fa-b28d-2d83bb06e580 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:45.634052 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-421b4254-16da-42fa-b28d-2d83bb06e580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:45.647462 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 932/1879] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:32:45 2022] DELETE /identity/v3/users/7abd1772b8674027ae3d0d2f048dc20e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:45.779751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b4254-16da-42fa-b28d-2d83bb06e580 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:45.803129 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:45.864454 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a47bd-892e-4317-b615-87aa3efa3f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:45.865342 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a47bd-892e-4317-b615-87aa3efa3f3a admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:45.866961 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a47bd-892e-4317-b615-87aa3efa3f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:45.867398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a47bd-892e-4317-b615-87aa3efa3f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:45.870765 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a47bd-892e-4317-b615-87aa3efa3f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:45.874472 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a47bd-892e-4317-b615-87aa3efa3f3a admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:45.907124 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 948/1880] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:45.908982 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2b061-176e-4e39-8ff7-1413a250164d admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:45.927072 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2b061-176e-4e39-8ff7-1413a250164d admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:45.933821 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c390998-e1c3-45fc-8cb2-af18f27e8ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:45.934524 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c390998-e1c3-45fc-8cb2-af18f27e8ede admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:45.934801 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c390998-e1c3-45fc-8cb2-af18f27e8ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:45.935158 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c390998-e1c3-45fc-8cb2-af18f27e8ede admin admin] PATH_INFO: `/v3/projects/cdf37ae4b6854e93a79c8d1dfce8a9a6/users/b91f9343e5c54a9892203d16c52a4f40/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:45.937344 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c390998-e1c3-45fc-8cb2-af18f27e8ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf37ae4b6854e93a79c8d1dfce8a9a6, user_id=b91f9343e5c54a9892203d16c52a4f40, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:45.940886 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c390998-e1c3-45fc-8cb2-af18f27e8ede admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:45.954024 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 933/1881] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:45 2022] PUT /identity/v3/projects/cdf37ae4b6854e93a79c8d1dfce8a9a6/users/b91f9343e5c54a9892203d16c52a4f40/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:46.063365 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a47bd-892e-4317-b615-87aa3efa3f3a admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:46.066297 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-a61a47bd-892e-4317-b615-87aa3efa3f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:46.080464 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a47bd-892e-4317-b615-87aa3efa3f3a admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:46.215582 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36d507-07c1-4c1a-8e8e-3043f609aa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:46.216530 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36d507-07c1-4c1a-8e8e-3043f609aa90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:46.216974 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36d507-07c1-4c1a-8e8e-3043f609aa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:46.217444 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36d507-07c1-4c1a-8e8e-3043f609aa90 admin admin] PATH_INFO: `/v3/projects/558e08bf824e46729d917376bb8c7a28` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:46.220987 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36d507-07c1-4c1a-8e8e-3043f609aa90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=558e08bf824e46729d917376bb8c7a28)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:46.224060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36d507-07c1-4c1a-8e8e-3043f609aa90 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:46.341381 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5f36d507-07c1-4c1a-8e8e-3043f609aa90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '558e08bf824e46729d917376bb8c7a28', 'request_id': 'req-5f36d507-07c1-4c1a-8e8e-3043f609aa90'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:46.374952 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5f36d507-07c1-4c1a-8e8e-3043f609aa90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '558e08bf824e46729d917376bb8c7a28', 'request_id': 'req-5f36d507-07c1-4c1a-8e8e-3043f609aa90'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:46.398258 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5f36d507-07c1-4c1a-8e8e-3043f609aa90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '558e08bf824e46729d917376bb8c7a28', 'request_id': 'req-5f36d507-07c1-4c1a-8e8e-3043f609aa90'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:46.434684 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5f36d507-07c1-4c1a-8e8e-3043f609aa90 admin admin] The token cache is being invalidate because project 558e08bf824e46729d917376bb8c7a28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:32:46.435884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5f36d507-07c1-4c1a-8e8e-3043f609aa90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:46.436944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5f36d507-07c1-4c1a-8e8e-3043f609aa90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:46.444085 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 949/1882] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:32:46 2022] DELETE /identity/v3/projects/558e08bf824e46729d917376bb8c7a28 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:46.449245 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb59c0-6f85-43fe-b9de-48c62f98ae81 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:46.449815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb59c0-6f85-43fe-b9de-48c62f98ae81 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:46.450139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb59c0-6f85-43fe-b9de-48c62f98ae81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:46.476836 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-5ffb59c0-6f85-43fe-b9de-48c62f98ae81 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:46.478273 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-5ffb59c0-6f85-43fe-b9de-48c62f98ae81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:46.600676 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 934/1883] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:46.608501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e2617-db10-4874-a399-df14ea62440f None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:46.609461 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e2617-db10-4874-a399-df14ea62440f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:46.609767 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e2617-db10-4874-a399-df14ea62440f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:46.649262 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-b36e2617-db10-4874-a399-df14ea62440f None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:46.659922 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b36e2617-db10-4874-a399-df14ea62440f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:46.680423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 950/1884] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:46.686170 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb59c0-6f85-43fe-b9de-48c62f98ae81 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:46.710825 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb59c0-6f85-43fe-b9de-48c62f98ae81 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:46.734201 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fbd7e-dddf-4dc6-bb73-e24e83879d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:46.734875 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fbd7e-dddf-4dc6-bb73-e24e83879d0c admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:46.735198 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fbd7e-dddf-4dc6-bb73-e24e83879d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:46.735413 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fbd7e-dddf-4dc6-bb73-e24e83879d0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:46.736090 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9fbd7e-dddf-4dc6-bb73-e24e83879d0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:32:46.736359 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9fbd7e-dddf-4dc6-bb73-e24e83879d0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:46.738218 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9fbd7e-dddf-4dc6-bb73-e24e83879d0c admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:46.760305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 935/1885] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:32:46.766193 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e2617-db10-4874-a399-df14ea62440f None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:46.777900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e2617-db10-4874-a399-df14ea62440f None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:46.785963 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8213b3e-f765-4fcb-bce9-9b7d2d0b6d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:46.787106 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8213b3e-f765-4fcb-bce9-9b7d2d0b6d25 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:46.787578 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8213b3e-f765-4fcb-bce9-9b7d2d0b6d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:46.787923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8213b3e-f765-4fcb-bce9-9b7d2d0b6d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:46.789374 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8213b3e-f765-4fcb-bce9-9b7d2d0b6d25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:46.791916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8213b3e-f765-4fcb-bce9-9b7d2d0b6d25 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:46.853578 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 951/1886] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:46 2022] POST /identity/v3/projects => generated 365 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:46.854211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fbd7e-dddf-4dc6-bb73-e24e83879d0c admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:46.867342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fbd7e-dddf-4dc6-bb73-e24e83879d0c admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:46.916532 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:46.961610 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611be032-fb7f-4053-bb2a-532c843cc981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:46.962344 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611be032-fb7f-4053-bb2a-532c843cc981 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:46.962773 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611be032-fb7f-4053-bb2a-532c843cc981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:46.963204 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611be032-fb7f-4053-bb2a-532c843cc981 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:46.963855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611be032-fb7f-4053-bb2a-532c843cc981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:46.965942 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611be032-fb7f-4053-bb2a-532c843cc981 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:46.992919 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 936/1887] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:46 2022] POST /identity/v3/users => generated 283 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:32:46.997157 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8213b3e-f765-4fcb-bce9-9b7d2d0b6d25 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:47.011304 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8213b3e-f765-4fcb-bce9-9b7d2d0b6d25 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:47.016812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae44e58-40f1-48b1-b3c4-60d1ce7792a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:47.017760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae44e58-40f1-48b1-b3c4-60d1ce7792a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:47.018281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae44e58-40f1-48b1-b3c4-60d1ce7792a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:47.018753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae44e58-40f1-48b1-b3c4-60d1ce7792a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:47.019790 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae44e58-40f1-48b1-b3c4-60d1ce7792a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:47.022371 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae44e58-40f1-48b1-b3c4-60d1ce7792a4 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:47.038778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 952/1888] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:32:47.040285 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611be032-fb7f-4053-bb2a-532c843cc981 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:47.059223 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611be032-fb7f-4053-bb2a-532c843cc981 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:47.064557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6250e9-f7cc-491b-82fd-11f6d9865536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:47.065657 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6250e9-f7cc-491b-82fd-11f6d9865536 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:47.065999 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6250e9-f7cc-491b-82fd-11f6d9865536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:47.066271 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6250e9-f7cc-491b-82fd-11f6d9865536 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:47.067135 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6250e9-f7cc-491b-82fd-11f6d9865536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:47.068779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6250e9-f7cc-491b-82fd-11f6d9865536 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:47.081847 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066a96a-93eb-41ad-9258-cfc4c238fa72 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:47.082539 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066a96a-93eb-41ad-9258-cfc4c238fa72 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:47.083031 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066a96a-93eb-41ad-9258-cfc4c238fa72 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:47.086732 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 937/1889] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:32:47.088240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6250e9-f7cc-491b-82fd-11f6d9865536 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:47.088651 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 953/1890] 10.222.0.55 () {54 vars in 921 bytes} [Tue Oct 4 16:32:47 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:32:47.102331 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6250e9-f7cc-491b-82fd-11f6d9865536 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:47.110028 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f2d4b-4a4f-4286-8aaa-5ec8a591e582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:47.110955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f2d4b-4a4f-4286-8aaa-5ec8a591e582 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:47.111467 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f2d4b-4a4f-4286-8aaa-5ec8a591e582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:47.111947 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f2d4b-4a4f-4286-8aaa-5ec8a591e582 admin admin] PATH_INFO: `/v3/projects/d5b8f925e06e4cc292823308a2df234e/users/dec540640d8a4cccb0b0fff42c8ac172/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:47.130555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f2d4b-4a4f-4286-8aaa-5ec8a591e582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b8f925e06e4cc292823308a2df234e, user_id=dec540640d8a4cccb0b0fff42c8ac172, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:47.135224 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf88d7d-f89e-4597-999e-477b90e1e531 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:47.135521 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f2d4b-4a4f-4286-8aaa-5ec8a591e582 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:47.135881 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf88d7d-f89e-4597-999e-477b90e1e531 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:47.136298 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf88d7d-f89e-4597-999e-477b90e1e531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:47.172390 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 938/1891] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:47 2022] PUT /identity/v3/projects/d5b8f925e06e4cc292823308a2df234e/users/dec540640d8a4cccb0b0fff42c8ac172/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:47.180215 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83167b74-ad95-42a2-8e57-335e09ad9a6b None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:47.180872 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83167b74-ad95-42a2-8e57-335e09ad9a6b None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:47.181340 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83167b74-ad95-42a2-8e57-335e09ad9a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:47.186636 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-bbf88d7d-f89e-4597-999e-477b90e1e531 None None] MFA Rules not processed for user `6cdee0584fe045028a44c385d032d2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:47.187984 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-bbf88d7d-f89e-4597-999e-477b90e1e531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:47.195014 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:47.233070 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-83167b74-ad95-42a2-8e57-335e09ad9a6b None None] MFA Rules not processed for user `dec540640d8a4cccb0b0fff42c8ac172`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:47.234785 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-83167b74-ad95-42a2-8e57-335e09ad9a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:47.335146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 954/1892] 10.222.0.55 () {58 vars in 1018 bytes} [Tue Oct 4 16:32:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:32:47.351107 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 939/1893] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:47.356167 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf88d7d-f89e-4597-999e-477b90e1e531 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:47.482364 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf88d7d-f89e-4597-999e-477b90e1e531 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:47.488145 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25542311-6bfe-42f4-808a-996c23d068db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:47.488829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25542311-6bfe-42f4-808a-996c23d068db admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:47.489107 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25542311-6bfe-42f4-808a-996c23d068db admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:47.489377 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25542311-6bfe-42f4-808a-996c23d068db admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:47.490997 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25542311-6bfe-42f4-808a-996c23d068db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:47.493058 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25542311-6bfe-42f4-808a-996c23d068db admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:47.514518 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83167b74-ad95-42a2-8e57-335e09ad9a6b None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:47.516709 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-83167b74-ad95-42a2-8e57-335e09ad9a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:47.548386 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83167b74-ad95-42a2-8e57-335e09ad9a6b None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:47.554718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2ebc1-e9ff-483d-9c7c-54e07971d606 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:47.555454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2ebc1-e9ff-483d-9c7c-54e07971d606 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:47.556370 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2ebc1-e9ff-483d-9c7c-54e07971d606 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:47.556370 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2ebc1-e9ff-483d-9c7c-54e07971d606 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:47.569277 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2ebc1-e9ff-483d-9c7c-54e07971d606 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:47.571574 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2ebc1-e9ff-483d-9c7c-54e07971d606 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:47.581915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 955/1894] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:47 2022] POST /identity/v3/projects => generated 365 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:47.583201 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be6cf3-69ad-4301-adb9-97d28da15677 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:47.583491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be6cf3-69ad-4301-adb9-97d28da15677 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:47.583764 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be6cf3-69ad-4301-adb9-97d28da15677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:47.589283 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 940/1895] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:32:47.590400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2ebc1-e9ff-483d-9c7c-54e07971d606 service nova] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:47.602590 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2ebc1-e9ff-483d-9c7c-54e07971d606 service nova] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:47.621215 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-d5be6cf3-69ad-4301-adb9-97d28da15677 None None] MFA Rules not processed for user `b91f9343e5c54a9892203d16c52a4f40`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:47.625172 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-d5be6cf3-69ad-4301-adb9-97d28da15677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:47.681107 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:47.696240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1484622-6487-46d7-89ab-09f4c2336957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:47.696854 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1484622-6487-46d7-89ab-09f4c2336957 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:47.697203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1484622-6487-46d7-89ab-09f4c2336957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:47.697471 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1484622-6487-46d7-89ab-09f4c2336957 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:47.701068 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1484622-6487-46d7-89ab-09f4c2336957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:47.704571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1484622-6487-46d7-89ab-09f4c2336957 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:47.773510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 941/1896] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:47 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:47.775851 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1484622-6487-46d7-89ab-09f4c2336957 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:47.788014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1484622-6487-46d7-89ab-09f4c2336957 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:47.795387 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f244c4d-0f34-45fd-ad1a-302e8a421544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:47.797088 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f244c4d-0f34-45fd-ad1a-302e8a421544 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:47.797088 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f244c4d-0f34-45fd-ad1a-302e8a421544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:47.797088 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f244c4d-0f34-45fd-ad1a-302e8a421544 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:47.806784 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f244c4d-0f34-45fd-ad1a-302e8a421544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:47.810036 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f244c4d-0f34-45fd-ad1a-302e8a421544 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:47.814953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 956/1897] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:47.827805 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c85b09-75a2-4b27-a944-f792f73ed72d None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:47.828791 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c85b09-75a2-4b27-a944-f792f73ed72d None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:47.829642 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c85b09-75a2-4b27-a944-f792f73ed72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:47.847601 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 942/1898] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:47.849154 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f244c4d-0f34-45fd-ad1a-302e8a421544 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:47.863892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f244c4d-0f34-45fd-ad1a-302e8a421544 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:47.872522 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-73c85b09-75a2-4b27-a944-f792f73ed72d None None] MFA Rules not processed for user `f9229da833ad4621866c5ee98c24c8f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:47.872734 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7eba01-c795-4af3-b764-7400986765ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:47.873570 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7eba01-c795-4af3-b764-7400986765ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:47.874108 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7eba01-c795-4af3-b764-7400986765ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:47.874478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7eba01-c795-4af3-b764-7400986765ff admin admin] PATH_INFO: `/v3/projects/99faebdb9f034e7a897604e950c17797/users/6dbfc26b7bb74bf1b58ed506d988bb7a/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:47.879887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-73c85b09-75a2-4b27-a944-f792f73ed72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:47.900673 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7eba01-c795-4af3-b764-7400986765ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=99faebdb9f034e7a897604e950c17797, user_id=6dbfc26b7bb74bf1b58ed506d988bb7a, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:47.904391 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7eba01-c795-4af3-b764-7400986765ff admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:47.910371 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:47.943050 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 943/1899] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:47 2022] PUT /identity/v3/projects/99faebdb9f034e7a897604e950c17797/users/6dbfc26b7bb74bf1b58ed506d988bb7a/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:47.947753 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7eba01-c795-4af3-b764-7400986765ff admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:48.104299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7eba01-c795-4af3-b764-7400986765ff admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:48.108397 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 957/1900] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:48.113208 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd9a8d-4740-477d-ba12-da49e8294f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:48.122082 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd9a8d-4740-477d-ba12-da49e8294f45 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:48.122082 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd9a8d-4740-477d-ba12-da49e8294f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:48.122082 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd9a8d-4740-477d-ba12-da49e8294f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:48.122082 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd9a8d-4740-477d-ba12-da49e8294f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:48.122082 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd9a8d-4740-477d-ba12-da49e8294f45 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:48.139754 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 944/1901] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:48.141782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c85b09-75a2-4b27-a944-f792f73ed72d None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:48.161251 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c85b09-75a2-4b27-a944-f792f73ed72d None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:48.166785 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718905b-27d9-4ba8-bd1e-d116baa197ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:48.167513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718905b-27d9-4ba8-bd1e-d116baa197ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:48.167774 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718905b-27d9-4ba8-bd1e-d116baa197ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:48.168759 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718905b-27d9-4ba8-bd1e-d116baa197ac admin admin] PATH_INFO: `/v3/projects/99faebdb9f034e7a897604e950c17797/users/6dbfc26b7bb74bf1b58ed506d988bb7a/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:48.171863 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718905b-27d9-4ba8-bd1e-d116baa197ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=99faebdb9f034e7a897604e950c17797, user_id=6dbfc26b7bb74bf1b58ed506d988bb7a, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:48.192954 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718905b-27d9-4ba8-bd1e-d116baa197ac admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:48.239076 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 958/1902] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:48 2022] PUT /identity/v3/projects/99faebdb9f034e7a897604e950c17797/users/6dbfc26b7bb74bf1b58ed506d988bb7a/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:48.244588 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0c43b-8a18-4cd4-8e4c-d9dfd5543f04 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:48.245001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0c43b-8a18-4cd4-8e4c-d9dfd5543f04 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:48.245438 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0c43b-8a18-4cd4-8e4c-d9dfd5543f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:48.264694 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718905b-27d9-4ba8-bd1e-d116baa197ac admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:48.303269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-22c0c43b-8a18-4cd4-8e4c-d9dfd5543f04 None None] MFA Rules not processed for user `6dbfc26b7bb74bf1b58ed506d988bb7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:48.304642 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-22c0c43b-8a18-4cd4-8e4c-d9dfd5543f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:48.377912 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718905b-27d9-4ba8-bd1e-d116baa197ac admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:48.386681 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde80e3-6eb1-49d5-872d-8aa921ab30a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:48.387412 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde80e3-6eb1-49d5-872d-8aa921ab30a1 service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:48.387650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde80e3-6eb1-49d5-872d-8aa921ab30a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:48.387981 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde80e3-6eb1-49d5-872d-8aa921ab30a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:48.389822 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-6bde80e3-6eb1-49d5-872d-8aa921ab30a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:48.427300 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 945/1903] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:48.441224 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0c43b-8a18-4cd4-8e4c-d9dfd5543f04 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:48.443050 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-22c0c43b-8a18-4cd4-8e4c-d9dfd5543f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:48.489579 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde80e3-6eb1-49d5-872d-8aa921ab30a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:48.491278 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde80e3-6eb1-49d5-872d-8aa921ab30a1 service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:48.499505 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:48.504366 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 959/1904] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:32:48.525366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0c43b-8a18-4cd4-8e4c-d9dfd5543f04 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:48.528984 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ea7d5-cbb8-4643-adf9-326e61c87e9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:48.529611 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ea7d5-cbb8-4643-adf9-326e61c87e9d service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:48.529954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ea7d5-cbb8-4643-adf9-326e61c87e9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:48.530243 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ea7d5-cbb8-4643-adf9-326e61c87e9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:48.541232 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ea7d5-cbb8-4643-adf9-326e61c87e9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:48.542695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ea7d5-cbb8-4643-adf9-326e61c87e9d service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:48.552807 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 946/1905] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:32:48.647088 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde80e3-6eb1-49d5-872d-8aa921ab30a1 service nova] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:48.658124 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde80e3-6eb1-49d5-872d-8aa921ab30a1 service nova] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:48.662371 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee7c8c-edee-480b-b1a5-7d35cfe27675 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:48.663060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee7c8c-edee-480b-b1a5-7d35cfe27675 service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:48.663341 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee7c8c-edee-480b-b1a5-7d35cfe27675 service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:48.663646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee7c8c-edee-480b-b1a5-7d35cfe27675 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:48.723826 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:48.752006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee7c8c-edee-480b-b1a5-7d35cfe27675 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:48.753459 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee7c8c-edee-480b-b1a5-7d35cfe27675 service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:48.769948 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 960/1906] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:48.877093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ea7d5-cbb8-4643-adf9-326e61c87e9d service cinder] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:48.880032 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-214ea7d5-cbb8-4643-adf9-326e61c87e9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:48.989436 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ea7d5-cbb8-4643-adf9-326e61c87e9d service cinder] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:48.994218 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcfad3-1bbf-4508-804d-81fd9188bbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:48.994890 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcfad3-1bbf-4508-804d-81fd9188bbf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:48.995237 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcfad3-1bbf-4508-804d-81fd9188bbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:48.995555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcfad3-1bbf-4508-804d-81fd9188bbf8 admin admin] PATH_INFO: `/v3/users/317aa855716a4f56ab2313a01addbf96` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:48.997302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbcfad3-1bbf-4508-804d-81fd9188bbf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=317aa855716a4f56ab2313a01addbf96)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:48.999677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbcfad3-1bbf-4508-804d-81fd9188bbf8 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:49.068166 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-3dbcfad3-1bbf-4508-804d-81fd9188bbf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '317aa855716a4f56ab2313a01addbf96'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:49.069269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-3dbcfad3-1bbf-4508-804d-81fd9188bbf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '317aa855716a4f56ab2313a01addbf96'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:49.076857 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-3dbcfad3-1bbf-4508-804d-81fd9188bbf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '317aa855716a4f56ab2313a01addbf96'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:49.077507 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-3dbcfad3-1bbf-4508-804d-81fd9188bbf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '317aa855716a4f56ab2313a01addbf96'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:49.085958 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-3dbcfad3-1bbf-4508-804d-81fd9188bbf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '317aa855716a4f56ab2313a01addbf96'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:49.104654 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 947/1907] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:32:48 2022] DELETE /identity/v3/users/317aa855716a4f56ab2313a01addbf96 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:49.109347 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edda65-a3c6-412a-b762-e8f91538ec05 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:49.109702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edda65-a3c6-412a-b762-e8f91538ec05 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:49.110076 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edda65-a3c6-412a-b762-e8f91538ec05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:49.141142 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-86edda65-a3c6-412a-b762-e8f91538ec05 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:49.142553 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-86edda65-a3c6-412a-b762-e8f91538ec05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:49.220945 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 961/1908] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:49.231366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcfad3-1bbf-4508-804d-81fd9188bbf8 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:49.232876 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-3dbcfad3-1bbf-4508-804d-81fd9188bbf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:49.296004 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcfad3-1bbf-4508-804d-81fd9188bbf8 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:49.300066 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f58b8-d6f1-4b22-99d9-107428715da4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:49.300782 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f58b8-d6f1-4b22-99d9-107428715da4 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:49.301173 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f58b8-d6f1-4b22-99d9-107428715da4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:49.301531 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f58b8-d6f1-4b22-99d9-107428715da4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:49.320354 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f58b8-d6f1-4b22-99d9-107428715da4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:49.321865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f58b8-d6f1-4b22-99d9-107428715da4 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:49.326222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:49.334190 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 948/1909] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:49.667840 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86edda65-a3c6-412a-b762-e8f91538ec05 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:49.669457 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-86edda65-a3c6-412a-b762-e8f91538ec05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:49.690799 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86edda65-a3c6-412a-b762-e8f91538ec05 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:49.696757 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498af07c-2932-4540-9344-d38edaa12b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:49.697797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498af07c-2932-4540-9344-d38edaa12b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:49.698288 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498af07c-2932-4540-9344-d38edaa12b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:49.698742 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498af07c-2932-4540-9344-d38edaa12b22 admin admin] PATH_INFO: `/v3/projects/9d849a4d1f1646efb577167d41c713d6` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:49.700122 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498af07c-2932-4540-9344-d38edaa12b22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d849a4d1f1646efb577167d41c713d6)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:49.702223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498af07c-2932-4540-9344-d38edaa12b22 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:49.773866 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-498af07c-2932-4540-9344-d38edaa12b22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d849a4d1f1646efb577167d41c713d6', 'request_id': 'req-498af07c-2932-4540-9344-d38edaa12b22'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:49.783635 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-498af07c-2932-4540-9344-d38edaa12b22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d849a4d1f1646efb577167d41c713d6', 'request_id': 'req-498af07c-2932-4540-9344-d38edaa12b22'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:49.790835 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-498af07c-2932-4540-9344-d38edaa12b22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d849a4d1f1646efb577167d41c713d6', 'request_id': 'req-498af07c-2932-4540-9344-d38edaa12b22'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:49.802456 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-498af07c-2932-4540-9344-d38edaa12b22 admin admin] The token cache is being invalidate because project 9d849a4d1f1646efb577167d41c713d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:32:49.802808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-498af07c-2932-4540-9344-d38edaa12b22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:49.803637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-498af07c-2932-4540-9344-d38edaa12b22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:49.806898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 962/1910] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:32:49 2022] DELETE /identity/v3/projects/9d849a4d1f1646efb577167d41c713d6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:49.810775 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f58b8-d6f1-4b22-99d9-107428715da4 service neutron] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:49.821337 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f58b8-d6f1-4b22-99d9-107428715da4 service neutron] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:49.885671 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1195ee-ad1e-4f3d-b01e-7ffb51469a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:49.886482 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1195ee-ad1e-4f3d-b01e-7ffb51469a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:49.886757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1195ee-ad1e-4f3d-b01e-7ffb51469a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:49.887055 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1195ee-ad1e-4f3d-b01e-7ffb51469a71 admin admin] PATH_INFO: `/v3/users/d41026ed0deb4ab0a42bcc16152a2d44` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:49.888332 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1195ee-ad1e-4f3d-b01e-7ffb51469a71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d41026ed0deb4ab0a42bcc16152a2d44)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:49.890282 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1195ee-ad1e-4f3d-b01e-7ffb51469a71 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:49.949528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-9b1195ee-ad1e-4f3d-b01e-7ffb51469a71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd41026ed0deb4ab0a42bcc16152a2d44'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:49.950359 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-9b1195ee-ad1e-4f3d-b01e-7ffb51469a71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd41026ed0deb4ab0a42bcc16152a2d44'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:49.958019 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-9b1195ee-ad1e-4f3d-b01e-7ffb51469a71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd41026ed0deb4ab0a42bcc16152a2d44'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:49.958750 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-9b1195ee-ad1e-4f3d-b01e-7ffb51469a71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd41026ed0deb4ab0a42bcc16152a2d44'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:49.970265 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-9b1195ee-ad1e-4f3d-b01e-7ffb51469a71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd41026ed0deb4ab0a42bcc16152a2d44'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:49.994091 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 949/1911] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:32:49 2022] DELETE /identity/v3/users/d41026ed0deb4ab0a42bcc16152a2d44 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:50.285995 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498af07c-2932-4540-9344-d38edaa12b22 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:50.287833 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-498af07c-2932-4540-9344-d38edaa12b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:50.313091 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498af07c-2932-4540-9344-d38edaa12b22 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:50.432372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267f226-b0c0-4565-906a-d0bbadebbcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:50.433318 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267f226-b0c0-4565-906a-d0bbadebbcd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:50.433784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267f226-b0c0-4565-906a-d0bbadebbcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:50.434197 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267f226-b0c0-4565-906a-d0bbadebbcd6 admin admin] PATH_INFO: `/v3/projects/ea6bc2e28e5c4aeb8e7b2f254985d98c` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:50.435719 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267f226-b0c0-4565-906a-d0bbadebbcd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea6bc2e28e5c4aeb8e7b2f254985d98c)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:50.438174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267f226-b0c0-4565-906a-d0bbadebbcd6 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:50.450089 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:50.519039 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-9267f226-b0c0-4565-906a-d0bbadebbcd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea6bc2e28e5c4aeb8e7b2f254985d98c', 'request_id': 'req-9267f226-b0c0-4565-906a-d0bbadebbcd6'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:50.551949 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-9267f226-b0c0-4565-906a-d0bbadebbcd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea6bc2e28e5c4aeb8e7b2f254985d98c', 'request_id': 'req-9267f226-b0c0-4565-906a-d0bbadebbcd6'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:50.573119 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-9267f226-b0c0-4565-906a-d0bbadebbcd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea6bc2e28e5c4aeb8e7b2f254985d98c', 'request_id': 'req-9267f226-b0c0-4565-906a-d0bbadebbcd6'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:50.595520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-9267f226-b0c0-4565-906a-d0bbadebbcd6 admin admin] The token cache is being invalidate because project ea6bc2e28e5c4aeb8e7b2f254985d98c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:32:50.596164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-9267f226-b0c0-4565-906a-d0bbadebbcd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:50.597053 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-9267f226-b0c0-4565-906a-d0bbadebbcd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:50.599154 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 963/1912] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:32:50 2022] DELETE /identity/v3/projects/ea6bc2e28e5c4aeb8e7b2f254985d98c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:50.602833 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1195ee-ad1e-4f3d-b01e-7ffb51469a71 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:50.605343 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-9b1195ee-ad1e-4f3d-b01e-7ffb51469a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:50.622652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1195ee-ad1e-4f3d-b01e-7ffb51469a71 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:50.713885 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ccc23f-cf26-413a-8114-17389ae96c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:50.714685 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccc23f-cf26-413a-8114-17389ae96c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:50.715003 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccc23f-cf26-413a-8114-17389ae96c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:50.716168 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccc23f-cf26-413a-8114-17389ae96c14 admin admin] PATH_INFO: `/v3/users/b3331767166d44279d42b3fd99b3e06a` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:50.716609 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ccc23f-cf26-413a-8114-17389ae96c14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3331767166d44279d42b3fd99b3e06a)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:50.719490 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ccc23f-cf26-413a-8114-17389ae96c14 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:50.747305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:50.797443 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-a7ccc23f-cf26-413a-8114-17389ae96c14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3331767166d44279d42b3fd99b3e06a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:50.800036 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-a7ccc23f-cf26-413a-8114-17389ae96c14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3331767166d44279d42b3fd99b3e06a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:50.822884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-a7ccc23f-cf26-413a-8114-17389ae96c14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3331767166d44279d42b3fd99b3e06a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:50.822884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-a7ccc23f-cf26-413a-8114-17389ae96c14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3331767166d44279d42b3fd99b3e06a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:50.827681 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-a7ccc23f-cf26-413a-8114-17389ae96c14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3331767166d44279d42b3fd99b3e06a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:50.849371 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 950/1913] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:32:50 2022] DELETE /identity/v3/users/b3331767166d44279d42b3fd99b3e06a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:32:51.327805 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267f226-b0c0-4565-906a-d0bbadebbcd6 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:51.329407 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-9267f226-b0c0-4565-906a-d0bbadebbcd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:51.355662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267f226-b0c0-4565-906a-d0bbadebbcd6 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:51.442497 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37403dcc-3768-407a-8668-f4a8a79f3ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:51.443582 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37403dcc-3768-407a-8668-f4a8a79f3ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:51.444041 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37403dcc-3768-407a-8668-f4a8a79f3ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:51.444936 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37403dcc-3768-407a-8668-f4a8a79f3ad7 admin admin] PATH_INFO: `/v3/projects/b8791b9d0c744482a6e5741aed06bf03` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:51.446099 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37403dcc-3768-407a-8668-f4a8a79f3ad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8791b9d0c744482a6e5741aed06bf03)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:51.448693 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37403dcc-3768-407a-8668-f4a8a79f3ad7 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:51.513938 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-37403dcc-3768-407a-8668-f4a8a79f3ad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8791b9d0c744482a6e5741aed06bf03', 'request_id': 'req-37403dcc-3768-407a-8668-f4a8a79f3ad7'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:51.523803 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-37403dcc-3768-407a-8668-f4a8a79f3ad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8791b9d0c744482a6e5741aed06bf03', 'request_id': 'req-37403dcc-3768-407a-8668-f4a8a79f3ad7'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:51.532811 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-37403dcc-3768-407a-8668-f4a8a79f3ad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8791b9d0c744482a6e5741aed06bf03', 'request_id': 'req-37403dcc-3768-407a-8668-f4a8a79f3ad7'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:51.548113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-37403dcc-3768-407a-8668-f4a8a79f3ad7 admin admin] The token cache is being invalidate because project b8791b9d0c744482a6e5741aed06bf03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:32:51.548405 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-37403dcc-3768-407a-8668-f4a8a79f3ad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:51.551812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-37403dcc-3768-407a-8668-f4a8a79f3ad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:51.554437 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 964/1914] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:32:51 2022] DELETE /identity/v3/projects/b8791b9d0c744482a6e5741aed06bf03 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:51.560513 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4eb9ef-3a99-44c4-8056-9a43f595f2c8 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:51.561640 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4eb9ef-3a99-44c4-8056-9a43f595f2c8 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:51.562145 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4eb9ef-3a99-44c4-8056-9a43f595f2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:51.596480 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-ac4eb9ef-3a99-44c4-8056-9a43f595f2c8 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:51.597680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ac4eb9ef-3a99-44c4-8056-9a43f595f2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:51.676823 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 951/1915] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:32:51.685529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d9f77-2224-4ef2-9bf5-bb9207f80943 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:51.685809 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d9f77-2224-4ef2-9bf5-bb9207f80943 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:51.686083 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d9f77-2224-4ef2-9bf5-bb9207f80943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:51.707066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-895d9f77-2224-4ef2-9bf5-bb9207f80943 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:51.708271 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-895d9f77-2224-4ef2-9bf5-bb9207f80943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:51.719581 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 965/1916] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:51.722028 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4eb9ef-3a99-44c4-8056-9a43f595f2c8 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:51.732671 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4eb9ef-3a99-44c4-8056-9a43f595f2c8 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:51.738445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0e451-a130-40b8-96d8-6672890e348c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:51.739095 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0e451-a130-40b8-96d8-6672890e348c admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:51.739363 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0e451-a130-40b8-96d8-6672890e348c admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:51.739628 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0e451-a130-40b8-96d8-6672890e348c admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:51.740411 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0e451-a130-40b8-96d8-6672890e348c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:32:51.740708 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0e451-a130-40b8-96d8-6672890e348c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:51.742468 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0e451-a130-40b8-96d8-6672890e348c admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:51.758367 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 952/1917] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:32:51.759322 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d9f77-2224-4ef2-9bf5-bb9207f80943 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:51.769562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d9f77-2224-4ef2-9bf5-bb9207f80943 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:51.775456 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d88fc-b458-460e-a96c-d927a69a708e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:51.776331 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d88fc-b458-460e-a96c-d927a69a708e admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:51.776609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d88fc-b458-460e-a96c-d927a69a708e admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:51.776873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d88fc-b458-460e-a96c-d927a69a708e admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:51.777602 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d88fc-b458-460e-a96c-d927a69a708e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:51.779527 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d88fc-b458-460e-a96c-d927a69a708e admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:51.806884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:51.845044 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 966/1918] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:51 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:32:51.849393 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0e451-a130-40b8-96d8-6672890e348c admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:51.870138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0e451-a130-40b8-96d8-6672890e348c admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:51.990838 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94af192-89a3-43fe-bf2b-bf070428a9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:51.992020 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94af192-89a3-43fe-bf2b-bf070428a9e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:51.992559 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94af192-89a3-43fe-bf2b-bf070428a9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:51.992981 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94af192-89a3-43fe-bf2b-bf070428a9e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:51.994001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94af192-89a3-43fe-bf2b-bf070428a9e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:51.998572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94af192-89a3-43fe-bf2b-bf070428a9e7 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:52.072456 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 953/1919] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:51 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:52.072919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d88fc-b458-460e-a96c-d927a69a708e admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:52.086050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d88fc-b458-460e-a96c-d927a69a708e admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:52.098349 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871b8fc-0053-402d-b150-73eef2d9b581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:52.100285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871b8fc-0053-402d-b150-73eef2d9b581 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:52.100665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871b8fc-0053-402d-b150-73eef2d9b581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:52.101038 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871b8fc-0053-402d-b150-73eef2d9b581 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:52.101875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871b8fc-0053-402d-b150-73eef2d9b581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:52.106467 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871b8fc-0053-402d-b150-73eef2d9b581 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:52.137155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 967/1920] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:32:52.138619 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94af192-89a3-43fe-bf2b-bf070428a9e7 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:52.150899 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94af192-89a3-43fe-bf2b-bf070428a9e7 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:52.156008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855693d5-d99b-49b8-a83c-8e708514d6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:52.156555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855693d5-d99b-49b8-a83c-8e708514d6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:52.156827 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855693d5-d99b-49b8-a83c-8e708514d6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:52.157094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855693d5-d99b-49b8-a83c-8e708514d6b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:52.157932 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855693d5-d99b-49b8-a83c-8e708514d6b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:52.159846 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855693d5-d99b-49b8-a83c-8e708514d6b9 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:52.180267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871b8fc-0053-402d-b150-73eef2d9b581 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:52.181577 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 954/1921] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:52.197850 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871b8fc-0053-402d-b150-73eef2d9b581 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:52.210044 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb978d-c097-409c-8b46-b8782b81930e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:52.213246 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb978d-c097-409c-8b46-b8782b81930e admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:52.213983 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb978d-c097-409c-8b46-b8782b81930e admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:52.214561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb978d-c097-409c-8b46-b8782b81930e admin admin] PATH_INFO: `/v3/projects/ea992f5b5567495dbda91e572d2814f1/users/5f912a5479b24b908db0bfd644e924c2/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:52.258744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb978d-c097-409c-8b46-b8782b81930e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea992f5b5567495dbda91e572d2814f1, user_id=5f912a5479b24b908db0bfd644e924c2, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:52.262925 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb978d-c097-409c-8b46-b8782b81930e admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:52.297110 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 968/1922] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:52 2022] PUT /identity/v3/projects/ea992f5b5567495dbda91e572d2814f1/users/5f912a5479b24b908db0bfd644e924c2/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:32:52.311508 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fb01d-4e94-4cf9-b064-c530fb03309f None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:52.311920 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fb01d-4e94-4cf9-b064-c530fb03309f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:52.312193 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fb01d-4e94-4cf9-b064-c530fb03309f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:52.321008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:52.374506 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-118fb01d-4e94-4cf9-b064-c530fb03309f None None] MFA Rules not processed for user `5f912a5479b24b908db0bfd644e924c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:52.375995 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-118fb01d-4e94-4cf9-b064-c530fb03309f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:52.548441 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 955/1923] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:52.549235 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb978d-c097-409c-8b46-b8782b81930e admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:52.686350 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb978d-c097-409c-8b46-b8782b81930e admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:52.699977 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffb90a-824c-4a6b-9177-b463128758ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:52.700857 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffb90a-824c-4a6b-9177-b463128758ef admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:52.701212 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffb90a-824c-4a6b-9177-b463128758ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:52.701554 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffb90a-824c-4a6b-9177-b463128758ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:52.702265 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffb90a-824c-4a6b-9177-b463128758ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:52.704500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffb90a-824c-4a6b-9177-b463128758ef admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:52.745521 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 969/1924] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:52 2022] POST /identity/v3/projects => generated 383 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:52.749062 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fb01d-4e94-4cf9-b064-c530fb03309f None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:52.771186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fb01d-4e94-4cf9-b064-c530fb03309f None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:52.832385 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e3d91-d8a0-4f79-a681-3445480340eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:52.833019 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e3d91-d8a0-4f79-a681-3445480340eb admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:52.833301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e3d91-d8a0-4f79-a681-3445480340eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:52.833573 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e3d91-d8a0-4f79-a681-3445480340eb admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:52.834218 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e3d91-d8a0-4f79-a681-3445480340eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:52.836370 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e3d91-d8a0-4f79-a681-3445480340eb admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:52.864742 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 956/1925] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:52 2022] POST /identity/v3/users => generated 298 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:52.870747 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffb90a-824c-4a6b-9177-b463128758ef admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:52.892284 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffb90a-824c-4a6b-9177-b463128758ef admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:52.898909 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebc685-5808-40c6-84b9-38c0e801274d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:52.900036 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebc685-5808-40c6-84b9-38c0e801274d admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:52.900392 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebc685-5808-40c6-84b9-38c0e801274d admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:52.900846 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebc685-5808-40c6-84b9-38c0e801274d admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:52.901677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ebc685-5808-40c6-84b9-38c0e801274d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:52.903811 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ebc685-5808-40c6-84b9-38c0e801274d admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:52.917120 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 970/1926] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:52.921764 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e3d91-d8a0-4f79-a681-3445480340eb admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:52.935323 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e3d91-d8a0-4f79-a681-3445480340eb admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:52.941200 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552d923-d609-48d0-b5e1-8324557326a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:52.942152 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552d923-d609-48d0-b5e1-8324557326a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:52.942496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552d923-d609-48d0-b5e1-8324557326a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:52.942827 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552d923-d609-48d0-b5e1-8324557326a3 admin admin] PATH_INFO: `/v3/projects/202647e9dde94265a1a7d31771e7bb74/users/ee124d3794b341f583efe8825b4dac24/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:52.960407 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552d923-d609-48d0-b5e1-8324557326a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=202647e9dde94265a1a7d31771e7bb74, user_id=ee124d3794b341f583efe8825b4dac24, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:52.963757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552d923-d609-48d0-b5e1-8324557326a3 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:52.978441 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 957/1927] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:52 2022] PUT /identity/v3/projects/202647e9dde94265a1a7d31771e7bb74/users/ee124d3794b341f583efe8825b4dac24/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:52.982536 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebc685-5808-40c6-84b9-38c0e801274d admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:52.993546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebc685-5808-40c6-84b9-38c0e801274d admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:53.091220 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ddf46-1800-4943-bbe0-0d64ba09c906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:53.091953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ddf46-1800-4943-bbe0-0d64ba09c906 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:53.092276 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ddf46-1800-4943-bbe0-0d64ba09c906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:53.092711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ddf46-1800-4943-bbe0-0d64ba09c906 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:53.093651 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ddf46-1800-4943-bbe0-0d64ba09c906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:53.095360 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ddf46-1800-4943-bbe0-0d64ba09c906 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:53.110929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 971/1928] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:53.112577 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552d923-d609-48d0-b5e1-8324557326a3 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:53.126061 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552d923-d609-48d0-b5e1-8324557326a3 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:53.135752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519fc8e-679f-4d8d-aea3-c6013bcfb287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:53.136601 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519fc8e-679f-4d8d-aea3-c6013bcfb287 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:53.136886 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519fc8e-679f-4d8d-aea3-c6013bcfb287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:53.137212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519fc8e-679f-4d8d-aea3-c6013bcfb287 admin admin] PATH_INFO: `/v3/projects/202647e9dde94265a1a7d31771e7bb74/users/ee124d3794b341f583efe8825b4dac24/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:53.140059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519fc8e-679f-4d8d-aea3-c6013bcfb287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=202647e9dde94265a1a7d31771e7bb74, user_id=ee124d3794b341f583efe8825b4dac24, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:53.145243 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519fc8e-679f-4d8d-aea3-c6013bcfb287 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:53.157858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 958/1929] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:53 2022] PUT /identity/v3/projects/202647e9dde94265a1a7d31771e7bb74/users/ee124d3794b341f583efe8825b4dac24/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:53.168792 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8be79-13f6-4b9d-989d-30927fc589c5 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:53.169084 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8be79-13f6-4b9d-989d-30927fc589c5 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:53.169353 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8be79-13f6-4b9d-989d-30927fc589c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:53.203008 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-58c8be79-13f6-4b9d-989d-30927fc589c5 None None] MFA Rules not processed for user `ee124d3794b341f583efe8825b4dac24`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:53.204392 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-58c8be79-13f6-4b9d-989d-30927fc589c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:53.225858 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:53.284164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 972/1930] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:53.295860 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519fc8e-679f-4d8d-aea3-c6013bcfb287 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:53.298490 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a519fc8e-679f-4d8d-aea3-c6013bcfb287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:53.398005 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:53.446373 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519fc8e-679f-4d8d-aea3-c6013bcfb287 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:53.464236 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a443aa8-827a-49dc-835d-5aca2cab02a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:53.465090 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a443aa8-827a-49dc-835d-5aca2cab02a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:53.465497 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a443aa8-827a-49dc-835d-5aca2cab02a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:53.465903 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a443aa8-827a-49dc-835d-5aca2cab02a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:53.481560 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a443aa8-827a-49dc-835d-5aca2cab02a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:53.483467 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a443aa8-827a-49dc-835d-5aca2cab02a2 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:53.496561 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 959/1931] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:54.346827 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8be79-13f6-4b9d-989d-30927fc589c5 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:54.440954 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8be79-13f6-4b9d-989d-30927fc589c5 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:54.447167 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93f988-5f91-45f2-93d9-da15f7a5d94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:54.448037 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93f988-5f91-45f2-93d9-da15f7a5d94d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:54.448493 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93f988-5f91-45f2-93d9-da15f7a5d94d admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:54.448909 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93f988-5f91-45f2-93d9-da15f7a5d94d admin admin] PATH_INFO: `/v3/users/5f912a5479b24b908db0bfd644e924c2` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:54.450321 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93f988-5f91-45f2-93d9-da15f7a5d94d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f912a5479b24b908db0bfd644e924c2)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:54.453798 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93f988-5f91-45f2-93d9-da15f7a5d94d admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:54.518509 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-ed93f988-5f91-45f2-93d9-da15f7a5d94d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f912a5479b24b908db0bfd644e924c2'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:54.519768 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-ed93f988-5f91-45f2-93d9-da15f7a5d94d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f912a5479b24b908db0bfd644e924c2'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:54.530355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-ed93f988-5f91-45f2-93d9-da15f7a5d94d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f912a5479b24b908db0bfd644e924c2'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:54.540617 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-ed93f988-5f91-45f2-93d9-da15f7a5d94d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f912a5479b24b908db0bfd644e924c2'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:54.542101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-ed93f988-5f91-45f2-93d9-da15f7a5d94d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f912a5479b24b908db0bfd644e924c2'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:54.565599 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 973/1932] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:32:54 2022] DELETE /identity/v3/users/5f912a5479b24b908db0bfd644e924c2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:54.570635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d2246-2488-4e72-8caa-8d8336743500 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:54.572404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d2246-2488-4e72-8caa-8d8336743500 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:54.572817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d2246-2488-4e72-8caa-8d8336743500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:54.603363 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-7d8d2246-2488-4e72-8caa-8d8336743500 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:54.604994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-7d8d2246-2488-4e72-8caa-8d8336743500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:54.683046 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 960/1933] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:54.695167 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93f988-5f91-45f2-93d9-da15f7a5d94d admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:54.696639 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ed93f988-5f91-45f2-93d9-da15f7a5d94d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:54.789050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:54.818859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93f988-5f91-45f2-93d9-da15f7a5d94d admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:54.823985 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61744840-72dd-47de-a85c-22245e5e57d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:54.824656 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61744840-72dd-47de-a85c-22245e5e57d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:54.825002 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61744840-72dd-47de-a85c-22245e5e57d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:54.825405 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61744840-72dd-47de-a85c-22245e5e57d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:54.836033 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61744840-72dd-47de-a85c-22245e5e57d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:54.837645 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61744840-72dd-47de-a85c-22245e5e57d0 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:54.848191 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 974/1934] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:55.365146 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d2246-2488-4e72-8caa-8d8336743500 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:55.366628 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-7d8d2246-2488-4e72-8caa-8d8336743500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:55.381958 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d2246-2488-4e72-8caa-8d8336743500 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:55.394795 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3490c-22a7-4435-ad75-3434299aed03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:55.396395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3490c-22a7-4435-ad75-3434299aed03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:55.397268 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3490c-22a7-4435-ad75-3434299aed03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:55.398136 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3490c-22a7-4435-ad75-3434299aed03 admin admin] PATH_INFO: `/v3/projects/ea992f5b5567495dbda91e572d2814f1` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:55.400753 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3490c-22a7-4435-ad75-3434299aed03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea992f5b5567495dbda91e572d2814f1)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:55.416923 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3490c-22a7-4435-ad75-3434299aed03 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:55.502196 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-66d3490c-22a7-4435-ad75-3434299aed03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea992f5b5567495dbda91e572d2814f1', 'request_id': 'req-66d3490c-22a7-4435-ad75-3434299aed03'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:55.512895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-66d3490c-22a7-4435-ad75-3434299aed03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea992f5b5567495dbda91e572d2814f1', 'request_id': 'req-66d3490c-22a7-4435-ad75-3434299aed03'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:55.521453 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-66d3490c-22a7-4435-ad75-3434299aed03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea992f5b5567495dbda91e572d2814f1', 'request_id': 'req-66d3490c-22a7-4435-ad75-3434299aed03'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:55.543488 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-66d3490c-22a7-4435-ad75-3434299aed03 admin admin] The token cache is being invalidate because project ea992f5b5567495dbda91e572d2814f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:32:55.549077 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-66d3490c-22a7-4435-ad75-3434299aed03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:55.549077 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-66d3490c-22a7-4435-ad75-3434299aed03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:55.550709 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 961/1935] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:32:55 2022] DELETE /identity/v3/projects/ea992f5b5567495dbda91e572d2814f1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:55.552243 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61744840-72dd-47de-a85c-22245e5e57d0 service neutron] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:55.570153 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61744840-72dd-47de-a85c-22245e5e57d0 service neutron] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:55.637996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046cf79-341c-40fa-9c60-c6017969839c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:55.638693 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046cf79-341c-40fa-9c60-c6017969839c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:55.639068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046cf79-341c-40fa-9c60-c6017969839c admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:55.639415 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046cf79-341c-40fa-9c60-c6017969839c admin admin] PATH_INFO: `/v3/users/ee124d3794b341f583efe8825b4dac24` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:55.640931 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046cf79-341c-40fa-9c60-c6017969839c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee124d3794b341f583efe8825b4dac24)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:55.643015 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046cf79-341c-40fa-9c60-c6017969839c admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:55.678245 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3490c-22a7-4435-ad75-3434299aed03 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:55.679882 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-66d3490c-22a7-4435-ad75-3434299aed03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:55.694853 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3490c-22a7-4435-ad75-3434299aed03 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:55.699204 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e046cf79-341c-40fa-9c60-c6017969839c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee124d3794b341f583efe8825b4dac24'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:55.699944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e046cf79-341c-40fa-9c60-c6017969839c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee124d3794b341f583efe8825b4dac24'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:55.700532 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337d87b-6d34-481f-9f68-85e77daa1ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:55.701256 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337d87b-6d34-481f-9f68-85e77daa1ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:55.701537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337d87b-6d34-481f-9f68-85e77daa1ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:55.701806 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337d87b-6d34-481f-9f68-85e77daa1ba5 admin admin] PATH_INFO: `/v3/users/dec540640d8a4cccb0b0fff42c8ac172` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:55.703621 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337d87b-6d34-481f-9f68-85e77daa1ba5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dec540640d8a4cccb0b0fff42c8ac172)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:55.705998 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337d87b-6d34-481f-9f68-85e77daa1ba5 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:55.708863 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e046cf79-341c-40fa-9c60-c6017969839c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee124d3794b341f583efe8825b4dac24'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:55.717849 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e046cf79-341c-40fa-9c60-c6017969839c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee124d3794b341f583efe8825b4dac24'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:55.718534 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e046cf79-341c-40fa-9c60-c6017969839c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee124d3794b341f583efe8825b4dac24'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:55.739914 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 975/1936] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:32:55 2022] DELETE /identity/v3/users/ee124d3794b341f583efe8825b4dac24 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:32:55.760516 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-3337d87b-6d34-481f-9f68-85e77daa1ba5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dec540640d8a4cccb0b0fff42c8ac172'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:55.761201 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-3337d87b-6d34-481f-9f68-85e77daa1ba5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dec540640d8a4cccb0b0fff42c8ac172'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:55.768798 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-3337d87b-6d34-481f-9f68-85e77daa1ba5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dec540640d8a4cccb0b0fff42c8ac172'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:55.769457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-3337d87b-6d34-481f-9f68-85e77daa1ba5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dec540640d8a4cccb0b0fff42c8ac172'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:55.794314 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-3337d87b-6d34-481f-9f68-85e77daa1ba5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dec540640d8a4cccb0b0fff42c8ac172'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:55.798096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:55.830543 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 962/1937] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:32:55 2022] DELETE /identity/v3/users/dec540640d8a4cccb0b0fff42c8ac172 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:55.835443 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13573914-8bbb-40c3-aa28-2376d0b947bd None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:55.835771 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13573914-8bbb-40c3-aa28-2376d0b947bd None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:55.836031 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13573914-8bbb-40c3-aa28-2376d0b947bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:55.860781 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-13573914-8bbb-40c3-aa28-2376d0b947bd None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:55.862095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-13573914-8bbb-40c3-aa28-2376d0b947bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:55.949173 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:55.974080 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 976/1938] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:55.984305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337d87b-6d34-481f-9f68-85e77daa1ba5 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:55.985786 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-3337d87b-6d34-481f-9f68-85e77daa1ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:56.082890 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337d87b-6d34-481f-9f68-85e77daa1ba5 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:56.095315 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8adfa4-1ad9-422a-8f23-671e077f5eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:56.096232 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8adfa4-1ad9-422a-8f23-671e077f5eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:56.096714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8adfa4-1ad9-422a-8f23-671e077f5eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:56.097162 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8adfa4-1ad9-422a-8f23-671e077f5eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:56.118253 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8adfa4-1ad9-422a-8f23-671e077f5eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:56.120279 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8adfa4-1ad9-422a-8f23-671e077f5eb4 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:56.130940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13573914-8bbb-40c3-aa28-2376d0b947bd None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:56.137062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-13573914-8bbb-40c3-aa28-2376d0b947bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:56.137251 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 963/1939] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:56.167038 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13573914-8bbb-40c3-aa28-2376d0b947bd None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:56.184632 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0dc86-589e-4892-982c-070a0ba3c90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:56.185274 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0dc86-589e-4892-982c-070a0ba3c90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:56.185550 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0dc86-589e-4892-982c-070a0ba3c90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:56.185848 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0dc86-589e-4892-982c-070a0ba3c90e admin admin] PATH_INFO: `/v3/projects/202647e9dde94265a1a7d31771e7bb74` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:56.189060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0dc86-589e-4892-982c-070a0ba3c90e admin admin] RBAC: Authorizing `identity:delete_project(project_id=202647e9dde94265a1a7d31771e7bb74)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:56.191732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0dc86-589e-4892-982c-070a0ba3c90e admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:56.295149 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3bd0dc86-589e-4892-982c-070a0ba3c90e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '202647e9dde94265a1a7d31771e7bb74', 'request_id': 'req-3bd0dc86-589e-4892-982c-070a0ba3c90e'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:56.308573 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3bd0dc86-589e-4892-982c-070a0ba3c90e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '202647e9dde94265a1a7d31771e7bb74', 'request_id': 'req-3bd0dc86-589e-4892-982c-070a0ba3c90e'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:56.316167 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3bd0dc86-589e-4892-982c-070a0ba3c90e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '202647e9dde94265a1a7d31771e7bb74', 'request_id': 'req-3bd0dc86-589e-4892-982c-070a0ba3c90e'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:56.328616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3bd0dc86-589e-4892-982c-070a0ba3c90e admin admin] The token cache is being invalidate because project 202647e9dde94265a1a7d31771e7bb74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:32:56.329835 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3bd0dc86-589e-4892-982c-070a0ba3c90e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:56.330743 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3bd0dc86-589e-4892-982c-070a0ba3c90e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:56.336550 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 977/1940] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:32:56 2022] DELETE /identity/v3/projects/202647e9dde94265a1a7d31771e7bb74 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:56.338892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af3ff7-29c3-4ad0-90cb-12160c89651e None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:56.339206 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af3ff7-29c3-4ad0-90cb-12160c89651e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:56.339481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af3ff7-29c3-4ad0-90cb-12160c89651e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:56.360889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-30af3ff7-29c3-4ad0-90cb-12160c89651e None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:56.362097 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-30af3ff7-29c3-4ad0-90cb-12160c89651e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:56.447426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 964/1941] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:56.449770 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfacfe1-3a47-4d8a-a823-2cca25dde487 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:56.450353 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfacfe1-3a47-4d8a-a823-2cca25dde487 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:56.450764 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfacfe1-3a47-4d8a-a823-2cca25dde487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:56.474852 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-fbfacfe1-3a47-4d8a-a823-2cca25dde487 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:56.476428 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-fbfacfe1-3a47-4d8a-a823-2cca25dde487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:56.487789 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 978/1942] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:32:56.492258 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af3ff7-29c3-4ad0-90cb-12160c89651e None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:56.507479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af3ff7-29c3-4ad0-90cb-12160c89651e None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:56.515452 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46959a0-1fcc-48cc-a54e-2764751dd584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:56.515699 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46959a0-1fcc-48cc-a54e-2764751dd584 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:56.515976 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46959a0-1fcc-48cc-a54e-2764751dd584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:56.516243 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46959a0-1fcc-48cc-a54e-2764751dd584 admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:56.517012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46959a0-1fcc-48cc-a54e-2764751dd584 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:32:56.517316 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46959a0-1fcc-48cc-a54e-2764751dd584 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:56.518958 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46959a0-1fcc-48cc-a54e-2764751dd584 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:56.536223 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 965/1943] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:32:56.537450 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfacfe1-3a47-4d8a-a823-2cca25dde487 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:56.548143 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfacfe1-3a47-4d8a-a823-2cca25dde487 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:56.558486 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202e289-173c-4b4b-92a0-472c3a1f4827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:56.560381 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202e289-173c-4b4b-92a0-472c3a1f4827 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:56.560837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202e289-173c-4b4b-92a0-472c3a1f4827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:56.561249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202e289-173c-4b4b-92a0-472c3a1f4827 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:56.562724 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202e289-173c-4b4b-92a0-472c3a1f4827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:56.564949 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202e289-173c-4b4b-92a0-472c3a1f4827 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:56.617718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46959a0-1fcc-48cc-a54e-2764751dd584 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:56.619963 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c46959a0-1fcc-48cc-a54e-2764751dd584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:56.624344 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 979/1944] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:56 2022] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:56.625845 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202e289-173c-4b4b-92a0-472c3a1f4827 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:56.649824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46959a0-1fcc-48cc-a54e-2764751dd584 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:56.723370 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202e289-173c-4b4b-92a0-472c3a1f4827 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:56.728842 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c92603-6c47-40aa-a59c-46b86fd2b69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:56.729713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c92603-6c47-40aa-a59c-46b86fd2b69a admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:56.730125 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c92603-6c47-40aa-a59c-46b86fd2b69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:56.730498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c92603-6c47-40aa-a59c-46b86fd2b69a admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:56.731267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c92603-6c47-40aa-a59c-46b86fd2b69a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:56.733380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c92603-6c47-40aa-a59c-46b86fd2b69a admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:56.754584 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5a3b5-d45a-4309-8398-2380cc44556a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:56.755278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5a3b5-d45a-4309-8398-2380cc44556a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:56.755560 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5a3b5-d45a-4309-8398-2380cc44556a admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:56.755834 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5a3b5-d45a-4309-8398-2380cc44556a admin admin] PATH_INFO: `/v3/projects/d5b8f925e06e4cc292823308a2df234e` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:56.757321 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5a3b5-d45a-4309-8398-2380cc44556a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5b8f925e06e4cc292823308a2df234e)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:56.763057 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 980/1945] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:56 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:32:56.763207 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5a3b5-d45a-4309-8398-2380cc44556a admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:56.764426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c92603-6c47-40aa-a59c-46b86fd2b69a admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:56.776427 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c92603-6c47-40aa-a59c-46b86fd2b69a admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:56.783129 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42938ba5-d0e2-415a-aa00-ec24e86315c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:56.783291 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:56.784014 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42938ba5-d0e2-415a-aa00-ec24e86315c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:56.784406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42938ba5-d0e2-415a-aa00-ec24e86315c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:56.785044 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42938ba5-d0e2-415a-aa00-ec24e86315c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:56.785532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42938ba5-d0e2-415a-aa00-ec24e86315c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:56.787430 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42938ba5-d0e2-415a-aa00-ec24e86315c2 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:56.800851 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 981/1946] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:56.807516 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42938ba5-d0e2-415a-aa00-ec24e86315c2 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:56.833240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-73a5a3b5-d45a-4309-8398-2380cc44556a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5b8f925e06e4cc292823308a2df234e', 'request_id': 'req-73a5a3b5-d45a-4309-8398-2380cc44556a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:56.838098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42938ba5-d0e2-415a-aa00-ec24e86315c2 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:56.853803 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-73a5a3b5-d45a-4309-8398-2380cc44556a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5b8f925e06e4cc292823308a2df234e', 'request_id': 'req-73a5a3b5-d45a-4309-8398-2380cc44556a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:56.863089 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-73a5a3b5-d45a-4309-8398-2380cc44556a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5b8f925e06e4cc292823308a2df234e', 'request_id': 'req-73a5a3b5-d45a-4309-8398-2380cc44556a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:56.894597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:56.919404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-73a5a3b5-d45a-4309-8398-2380cc44556a admin admin] The token cache is being invalidate because project d5b8f925e06e4cc292823308a2df234e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:32:56.919593 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-73a5a3b5-d45a-4309-8398-2380cc44556a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:56.920746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-73a5a3b5-d45a-4309-8398-2380cc44556a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:56.924200 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 966/1947] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:32:56 2022] DELETE /identity/v3/projects/d5b8f925e06e4cc292823308a2df234e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:56.928153 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5a3b5-d45a-4309-8398-2380cc44556a admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:56.931727 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-73a5a3b5-d45a-4309-8398-2380cc44556a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:56.937255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03afbb9-2343-4544-aa57-a4ff9c82a01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:56.938085 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03afbb9-2343-4544-aa57-a4ff9c82a01f admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:56.938504 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03afbb9-2343-4544-aa57-a4ff9c82a01f admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:56.938914 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03afbb9-2343-4544-aa57-a4ff9c82a01f admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:56.939784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03afbb9-2343-4544-aa57-a4ff9c82a01f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:56.942326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03afbb9-2343-4544-aa57-a4ff9c82a01f admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:56.947738 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5a3b5-d45a-4309-8398-2380cc44556a admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:56.955613 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ebb1f-76b7-42e1-aece-0fa2b416497e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:56.956434 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ebb1f-76b7-42e1-aece-0fa2b416497e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:56.958536 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ebb1f-76b7-42e1-aece-0fa2b416497e admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:56.958944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ebb1f-76b7-42e1-aece-0fa2b416497e admin admin] PATH_INFO: `/v3/users/6dbfc26b7bb74bf1b58ed506d988bb7a` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:56.963629 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 982/1948] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:56.963786 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ebb1f-76b7-42e1-aece-0fa2b416497e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dbfc26b7bb74bf1b58ed506d988bb7a)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:56.963786 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ebb1f-76b7-42e1-aece-0fa2b416497e admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:56.965584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03afbb9-2343-4544-aa57-a4ff9c82a01f admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:56.968583 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-c03afbb9-2343-4544-aa57-a4ff9c82a01f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:57.005857 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03afbb9-2343-4544-aa57-a4ff9c82a01f admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:57.013150 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201fd96-9729-49f4-97f1-5e853882e148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:57.013901 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201fd96-9729-49f4-97f1-5e853882e148 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:57.014311 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201fd96-9729-49f4-97f1-5e853882e148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:57.014588 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201fd96-9729-49f4-97f1-5e853882e148 admin admin] PATH_INFO: `/v3/projects/bdc370a54f5e4a679a868018fddbd525/users/bcade6ffae7748a190e32e9753b6bcc2/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:57.045075 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201fd96-9729-49f4-97f1-5e853882e148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdc370a54f5e4a679a868018fddbd525, user_id=bcade6ffae7748a190e32e9753b6bcc2, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:57.049434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201fd96-9729-49f4-97f1-5e853882e148 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:57.083056 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 983/1949] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:56 2022] PUT /identity/v3/projects/bdc370a54f5e4a679a868018fddbd525/users/bcade6ffae7748a190e32e9753b6bcc2/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:57.088821 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705806ba-abfc-4a37-a297-705e88834793 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:57.089268 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705806ba-abfc-4a37-a297-705e88834793 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:57.089776 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705806ba-abfc-4a37-a297-705e88834793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:57.122363 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-147ebb1f-76b7-42e1-aece-0fa2b416497e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dbfc26b7bb74bf1b58ed506d988bb7a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:57.123281 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-147ebb1f-76b7-42e1-aece-0fa2b416497e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dbfc26b7bb74bf1b58ed506d988bb7a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:57.132344 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-147ebb1f-76b7-42e1-aece-0fa2b416497e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dbfc26b7bb74bf1b58ed506d988bb7a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:57.133322 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-147ebb1f-76b7-42e1-aece-0fa2b416497e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dbfc26b7bb74bf1b58ed506d988bb7a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:57.149426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-147ebb1f-76b7-42e1-aece-0fa2b416497e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dbfc26b7bb74bf1b58ed506d988bb7a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:57.160328 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-705806ba-abfc-4a37-a297-705e88834793 None None] MFA Rules not processed for user `bcade6ffae7748a190e32e9753b6bcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:57.161664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-705806ba-abfc-4a37-a297-705e88834793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:57.206072 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 967/1950] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:32:56 2022] DELETE /identity/v3/users/6dbfc26b7bb74bf1b58ed506d988bb7a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:32:57.285814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 984/1951] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:57.299401 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ebb1f-76b7-42e1-aece-0fa2b416497e admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:57.300880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-147ebb1f-76b7-42e1-aece-0fa2b416497e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:57.427356 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ebb1f-76b7-42e1-aece-0fa2b416497e admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:57.462494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d68df4-0737-4ce3-af2c-5abe00644176 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74b3e45a14bd4b539974e9e5e278ee62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:57.462494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d68df4-0737-4ce3-af2c-5abe00644176 service glance] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:57.462494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d68df4-0737-4ce3-af2c-5abe00644176 service glance] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:57.462494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d68df4-0737-4ce3-af2c-5abe00644176 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:57.472500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:57.536451 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d68df4-0737-4ce3-af2c-5abe00644176 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:57.538698 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d68df4-0737-4ce3-af2c-5abe00644176 service glance] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:57.550677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 968/1952] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:32:57.701426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705806ba-abfc-4a37-a297-705e88834793 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:57.703222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-705806ba-abfc-4a37-a297-705e88834793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:57.862690 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705806ba-abfc-4a37-a297-705e88834793 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:57.906612 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:57.937768 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74476ca7-06a8-4102-9d1c-3170afb4ec1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:57.937768 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74476ca7-06a8-4102-9d1c-3170afb4ec1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:57.938217 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74476ca7-06a8-4102-9d1c-3170afb4ec1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:57.939088 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74476ca7-06a8-4102-9d1c-3170afb4ec1f admin admin] PATH_INFO: `/v3/projects/99faebdb9f034e7a897604e950c17797` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:57.940031 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74476ca7-06a8-4102-9d1c-3170afb4ec1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=99faebdb9f034e7a897604e950c17797)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:57.942113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74476ca7-06a8-4102-9d1c-3170afb4ec1f admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:58.004836 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-74476ca7-06a8-4102-9d1c-3170afb4ec1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99faebdb9f034e7a897604e950c17797', 'request_id': 'req-74476ca7-06a8-4102-9d1c-3170afb4ec1f'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:58.014256 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-74476ca7-06a8-4102-9d1c-3170afb4ec1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99faebdb9f034e7a897604e950c17797', 'request_id': 'req-74476ca7-06a8-4102-9d1c-3170afb4ec1f'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:58.021938 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-74476ca7-06a8-4102-9d1c-3170afb4ec1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99faebdb9f034e7a897604e950c17797', 'request_id': 'req-74476ca7-06a8-4102-9d1c-3170afb4ec1f'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:58.033535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-74476ca7-06a8-4102-9d1c-3170afb4ec1f admin admin] The token cache is being invalidate because project 99faebdb9f034e7a897604e950c17797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:32:58.033836 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-74476ca7-06a8-4102-9d1c-3170afb4ec1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:58.034482 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-74476ca7-06a8-4102-9d1c-3170afb4ec1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:32:58.039018 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 985/1953] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:32:57 2022] DELETE /identity/v3/projects/99faebdb9f034e7a897604e950c17797 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:58.042155 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3a6a1-8c01-43eb-a936-f4daa321d2c4 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:58.042645 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3a6a1-8c01-43eb-a936-f4daa321d2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:58.042733 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3a6a1-8c01-43eb-a936-f4daa321d2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:58.063036 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-bee3a6a1-8c01-43eb-a936-f4daa321d2c4 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:58.064408 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-bee3a6a1-8c01-43eb-a936-f4daa321d2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:58.139092 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 969/1954] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:58.148232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5df40-7c03-4661-9f13-c828d746e1f6 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:58.149456 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5df40-7c03-4661-9f13-c828d746e1f6 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:58.149696 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5df40-7c03-4661-9f13-c828d746e1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:58.171849 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-36f5df40-7c03-4661-9f13-c828d746e1f6 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:58.173093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-36f5df40-7c03-4661-9f13-c828d746e1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:58.183108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 986/1955] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:58.186648 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3a6a1-8c01-43eb-a936-f4daa321d2c4 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:58.200517 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3a6a1-8c01-43eb-a936-f4daa321d2c4 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:58.208931 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aedae6-a9ac-4e0b-86f7-4e228443b27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:58.209565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aedae6-a9ac-4e0b-86f7-4e228443b27f admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:58.209842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aedae6-a9ac-4e0b-86f7-4e228443b27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:58.210110 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aedae6-a9ac-4e0b-86f7-4e228443b27f admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:58.211163 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aedae6-a9ac-4e0b-86f7-4e228443b27f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:32:58.211473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aedae6-a9ac-4e0b-86f7-4e228443b27f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:58.213195 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aedae6-a9ac-4e0b-86f7-4e228443b27f admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:58.235920 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 970/1956] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:32:58.242103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5df40-7c03-4661-9f13-c828d746e1f6 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:58.254512 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5df40-7c03-4661-9f13-c828d746e1f6 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:58.261813 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220313d7-d90f-408a-87d4-0310cc137627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:58.262695 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220313d7-d90f-408a-87d4-0310cc137627 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:58.263177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220313d7-d90f-408a-87d4-0310cc137627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:58.263616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220313d7-d90f-408a-87d4-0310cc137627 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:58.264522 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220313d7-d90f-408a-87d4-0310cc137627 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:58.266919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220313d7-d90f-408a-87d4-0310cc137627 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:58.311258 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 987/1957] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:58 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:32:58.317718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aedae6-a9ac-4e0b-86f7-4e228443b27f admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:58.331979 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aedae6-a9ac-4e0b-86f7-4e228443b27f admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:58.419508 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d8e08-3212-4ffc-b449-92dd7269c6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:58.420133 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d8e08-3212-4ffc-b449-92dd7269c6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:58.420415 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d8e08-3212-4ffc-b449-92dd7269c6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:58.420832 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d8e08-3212-4ffc-b449-92dd7269c6a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:58.421338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d8e08-3212-4ffc-b449-92dd7269c6a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:58.423308 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d8e08-3212-4ffc-b449-92dd7269c6a2 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:58.455161 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 971/1958] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:58 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:58.456200 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220313d7-d90f-408a-87d4-0310cc137627 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:58.467015 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220313d7-d90f-408a-87d4-0310cc137627 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:58.474575 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2604eb-d8de-4900-b14a-9735dd09b121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:58.475689 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2604eb-d8de-4900-b14a-9735dd09b121 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:58.476043 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2604eb-d8de-4900-b14a-9735dd09b121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:58.476407 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2604eb-d8de-4900-b14a-9735dd09b121 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:58.477239 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2604eb-d8de-4900-b14a-9735dd09b121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:58.479104 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2604eb-d8de-4900-b14a-9735dd09b121 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:58.508787 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 988/1959] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:58.519746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d8e08-3212-4ffc-b449-92dd7269c6a2 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:58.539291 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d8e08-3212-4ffc-b449-92dd7269c6a2 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:58.545581 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44426d78-990c-498f-952a-d5058f5986bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:58.546782 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44426d78-990c-498f-952a-d5058f5986bd admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:58.547407 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44426d78-990c-498f-952a-d5058f5986bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:58.547918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44426d78-990c-498f-952a-d5058f5986bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:58.549757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44426d78-990c-498f-952a-d5058f5986bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:58.552336 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44426d78-990c-498f-952a-d5058f5986bd admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:58.567997 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 972/1960] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:58.569694 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2604eb-d8de-4900-b14a-9735dd09b121 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:58.583488 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2604eb-d8de-4900-b14a-9735dd09b121 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:58.589726 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20e2b2-8867-445d-a54f-457c2b091ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:58.590667 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20e2b2-8867-445d-a54f-457c2b091ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:58.591042 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20e2b2-8867-445d-a54f-457c2b091ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:58.591411 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20e2b2-8867-445d-a54f-457c2b091ef7 admin admin] PATH_INFO: `/v3/projects/d509341ce6cd4305b91d3ad38f284c0a/users/b1e09b4227984e9892e9206b999b86cc/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:58.609728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20e2b2-8867-445d-a54f-457c2b091ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d509341ce6cd4305b91d3ad38f284c0a, user_id=b1e09b4227984e9892e9206b999b86cc, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:58.614004 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20e2b2-8867-445d-a54f-457c2b091ef7 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:58.641924 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 989/1961] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:58 2022] PUT /identity/v3/projects/d509341ce6cd4305b91d3ad38f284c0a/users/b1e09b4227984e9892e9206b999b86cc/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:32:58.644244 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0dd2d-10bf-473d-8130-286461f248a2 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:58.644531 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0dd2d-10bf-473d-8130-286461f248a2 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:58.644800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0dd2d-10bf-473d-8130-286461f248a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:58.693752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-97d0dd2d-10bf-473d-8130-286461f248a2 None None] MFA Rules not processed for user `b1e09b4227984e9892e9206b999b86cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:58.695574 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-97d0dd2d-10bf-473d-8130-286461f248a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:58.701666 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:58.787043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 973/1962] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:58.791662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20e2b2-8867-445d-a54f-457c2b091ef7 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:58.890190 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20e2b2-8867-445d-a54f-457c2b091ef7 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:58.896487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ea9e9-3ba3-4a78-bb62-df754808bd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:58.897541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ea9e9-3ba3-4a78-bb62-df754808bd11 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:58.898226 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ea9e9-3ba3-4a78-bb62-df754808bd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:58.898523 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ea9e9-3ba3-4a78-bb62-df754808bd11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:58.901354 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ea9e9-3ba3-4a78-bb62-df754808bd11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:58.901354 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ea9e9-3ba3-4a78-bb62-df754808bd11 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:58.917041 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:58.948340 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 990/1963] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:32:58 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:32:58.950017 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0dd2d-10bf-473d-8130-286461f248a2 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:58.976432 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0dd2d-10bf-473d-8130-286461f248a2 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:59.054113 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92def636-cb63-4fbe-9255-fd62d60d42d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:59.055063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92def636-cb63-4fbe-9255-fd62d60d42d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:59.055406 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92def636-cb63-4fbe-9255-fd62d60d42d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:59.055679 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92def636-cb63-4fbe-9255-fd62d60d42d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:59.056429 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92def636-cb63-4fbe-9255-fd62d60d42d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:59.058657 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92def636-cb63-4fbe-9255-fd62d60d42d4 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:59.083680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 974/1964] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:32:58 2022] POST /identity/v3/users => generated 295 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:32:59.087604 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ea9e9-3ba3-4a78-bb62-df754808bd11 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:59.099007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ea9e9-3ba3-4a78-bb62-df754808bd11 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:59.103808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6ddc8-6ef6-4203-942e-d2995ed25d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:59.104420 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6ddc8-6ef6-4203-942e-d2995ed25d91 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:59.104699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6ddc8-6ef6-4203-942e-d2995ed25d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:59.104971 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6ddc8-6ef6-4203-942e-d2995ed25d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:59.105860 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6ddc8-6ef6-4203-942e-d2995ed25d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:59.107454 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6ddc8-6ef6-4203-942e-d2995ed25d91 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:59.121643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 991/1965] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:32:59.132108 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92def636-cb63-4fbe-9255-fd62d60d42d4 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:59.143151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92def636-cb63-4fbe-9255-fd62d60d42d4 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:59.149487 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42f6f6-306a-40eb-935c-fc86eddddf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:59.150200 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42f6f6-306a-40eb-935c-fc86eddddf9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:59.150477 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42f6f6-306a-40eb-935c-fc86eddddf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:59.150945 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42f6f6-306a-40eb-935c-fc86eddddf9d admin admin] PATH_INFO: `/v3/projects/4ee941606005423b9ff5ea472f4e4f4e/users/cb2741d10b2f480e98823329beef5c7d/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:59.170085 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42f6f6-306a-40eb-935c-fc86eddddf9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee941606005423b9ff5ea472f4e4f4e, user_id=cb2741d10b2f480e98823329beef5c7d, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:59.172933 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42f6f6-306a-40eb-935c-fc86eddddf9d admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:59.192406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6ddc8-6ef6-4203-942e-d2995ed25d91 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:59.193180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 975/1966] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:59 2022] PUT /identity/v3/projects/4ee941606005423b9ff5ea472f4e4f4e/users/cb2741d10b2f480e98823329beef5c7d/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:32:59.204490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6ddc8-6ef6-4203-942e-d2995ed25d91 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:59.272545 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed00593-0ac6-47a8-b2a9-2638a499fdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:59.273234 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed00593-0ac6-47a8-b2a9-2638a499fdd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:59.273434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed00593-0ac6-47a8-b2a9-2638a499fdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:59.273699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed00593-0ac6-47a8-b2a9-2638a499fdd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:59.277511 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed00593-0ac6-47a8-b2a9-2638a499fdd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:59.277511 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed00593-0ac6-47a8-b2a9-2638a499fdd7 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:59.290725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 992/1967] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:32:59.292434 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42f6f6-306a-40eb-935c-fc86eddddf9d admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:59.304440 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42f6f6-306a-40eb-935c-fc86eddddf9d admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:59.309669 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bcf6f-7882-4984-b3c7-307dc9f81de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:59.310334 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bcf6f-7882-4984-b3c7-307dc9f81de8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:59.310623 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bcf6f-7882-4984-b3c7-307dc9f81de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:59.310899 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bcf6f-7882-4984-b3c7-307dc9f81de8 admin admin] PATH_INFO: `/v3/projects/4ee941606005423b9ff5ea472f4e4f4e/users/cb2741d10b2f480e98823329beef5c7d/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:59.313011 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bcf6f-7882-4984-b3c7-307dc9f81de8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee941606005423b9ff5ea472f4e4f4e, user_id=cb2741d10b2f480e98823329beef5c7d, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:59.315889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bcf6f-7882-4984-b3c7-307dc9f81de8 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:59.327900 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 976/1968] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:32:59 2022] PUT /identity/v3/projects/4ee941606005423b9ff5ea472f4e4f4e/users/cb2741d10b2f480e98823329beef5c7d/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:32:59.338538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882ce64-07ec-47b1-8e53-188fb8bf414e None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:59.338836 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882ce64-07ec-47b1-8e53-188fb8bf414e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:59.339143 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882ce64-07ec-47b1-8e53-188fb8bf414e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:59.373095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-0882ce64-07ec-47b1-8e53-188fb8bf414e None None] MFA Rules not processed for user `cb2741d10b2f480e98823329beef5c7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:32:59.374361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-0882ce64-07ec-47b1-8e53-188fb8bf414e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:59.452661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 993/1969] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:32:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:32:59.463413 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bcf6f-7882-4984-b3c7-307dc9f81de8 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:32:59.465196 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ca7bcf6f-7882-4984-b3c7-307dc9f81de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:32:59.527679 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bcf6f-7882-4984-b3c7-307dc9f81de8 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:32:59.532098 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e195218-e354-4aa3-81d4-4014c59ffa58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:32:59.532742 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e195218-e354-4aa3-81d4-4014c59ffa58 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:32:59.533044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e195218-e354-4aa3-81d4-4014c59ffa58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:32:59.533316 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e195218-e354-4aa3-81d4-4014c59ffa58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:32:59.544018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:32:59.606719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e195218-e354-4aa3-81d4-4014c59ffa58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:32:59.608283 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e195218-e354-4aa3-81d4-4014c59ffa58 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:32:59.618284 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 977/1970] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:32:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:33:00.669263 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882ce64-07ec-47b1-8e53-188fb8bf414e None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:00.670822 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-0882ce64-07ec-47b1-8e53-188fb8bf414e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:00.746194 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882ce64-07ec-47b1-8e53-188fb8bf414e None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:00.751816 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93383d5d-62c4-4fb2-a266-f93f26c85d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:00.752556 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93383d5d-62c4-4fb2-a266-f93f26c85d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:00.752829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93383d5d-62c4-4fb2-a266-f93f26c85d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:00.753174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93383d5d-62c4-4fb2-a266-f93f26c85d47 admin admin] PATH_INFO: `/v3/users/610d434525c24338b405e9f93bd96db3` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:00.754351 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93383d5d-62c4-4fb2-a266-f93f26c85d47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=610d434525c24338b405e9f93bd96db3)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:00.757123 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93383d5d-62c4-4fb2-a266-f93f26c85d47 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:00.758729 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:00.810674 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-93383d5d-62c4-4fb2-a266-f93f26c85d47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '610d434525c24338b405e9f93bd96db3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:00.811352 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-93383d5d-62c4-4fb2-a266-f93f26c85d47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '610d434525c24338b405e9f93bd96db3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:00.819660 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-93383d5d-62c4-4fb2-a266-f93f26c85d47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '610d434525c24338b405e9f93bd96db3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:00.828559 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-93383d5d-62c4-4fb2-a266-f93f26c85d47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '610d434525c24338b405e9f93bd96db3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:00.829204 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-93383d5d-62c4-4fb2-a266-f93f26c85d47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '610d434525c24338b405e9f93bd96db3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:00.847381 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 994/1971] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:33:00 2022] DELETE /identity/v3/users/610d434525c24338b405e9f93bd96db3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:00.852136 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca7082-400b-44ff-8662-f065222d6077 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:00.852732 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca7082-400b-44ff-8662-f065222d6077 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:00.852732 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca7082-400b-44ff-8662-f065222d6077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:00.873411 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-afca7082-400b-44ff-8662-f065222d6077 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:00.874882 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-afca7082-400b-44ff-8662-f065222d6077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:00.947066 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 978/1972] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:00.961857 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93383d5d-62c4-4fb2-a266-f93f26c85d47 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:00.961857 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-93383d5d-62c4-4fb2-a266-f93f26c85d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:01.043465 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93383d5d-62c4-4fb2-a266-f93f26c85d47 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:01.047654 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfa87b-8f77-4873-bed5-5d8c5e612514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:01.048346 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfa87b-8f77-4873-bed5-5d8c5e612514 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:01.048687 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfa87b-8f77-4873-bed5-5d8c5e612514 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:01.049024 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfa87b-8f77-4873-bed5-5d8c5e612514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:01.060866 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdfa87b-8f77-4873-bed5-5d8c5e612514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:01.062316 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdfa87b-8f77-4873-bed5-5d8c5e612514 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:01.073210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 995/1973] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:33:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:33:01.403847 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca7082-400b-44ff-8662-f065222d6077 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:01.405438 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-afca7082-400b-44ff-8662-f065222d6077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:01.418703 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca7082-400b-44ff-8662-f065222d6077 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:01.424371 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb241ba4-bab6-4cea-8388-f15d1d13d524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:01.425121 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb241ba4-bab6-4cea-8388-f15d1d13d524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:01.425459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb241ba4-bab6-4cea-8388-f15d1d13d524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:01.425865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb241ba4-bab6-4cea-8388-f15d1d13d524 admin admin] PATH_INFO: `/v3/projects/a71d4ff6433e4b25b1d0991b8440b909` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:01.427215 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb241ba4-bab6-4cea-8388-f15d1d13d524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a71d4ff6433e4b25b1d0991b8440b909)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:01.429348 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb241ba4-bab6-4cea-8388-f15d1d13d524 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:01.479337 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-fb241ba4-bab6-4cea-8388-f15d1d13d524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a71d4ff6433e4b25b1d0991b8440b909', 'request_id': 'req-fb241ba4-bab6-4cea-8388-f15d1d13d524'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:01.488425 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-fb241ba4-bab6-4cea-8388-f15d1d13d524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a71d4ff6433e4b25b1d0991b8440b909', 'request_id': 'req-fb241ba4-bab6-4cea-8388-f15d1d13d524'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:01.494895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-fb241ba4-bab6-4cea-8388-f15d1d13d524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a71d4ff6433e4b25b1d0991b8440b909', 'request_id': 'req-fb241ba4-bab6-4cea-8388-f15d1d13d524'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:01.505081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-fb241ba4-bab6-4cea-8388-f15d1d13d524 admin admin] The token cache is being invalidate because project a71d4ff6433e4b25b1d0991b8440b909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:33:01.505366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-fb241ba4-bab6-4cea-8388-f15d1d13d524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:01.506004 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-fb241ba4-bab6-4cea-8388-f15d1d13d524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:01.507584 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 979/1974] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:33:01 2022] DELETE /identity/v3/projects/a71d4ff6433e4b25b1d0991b8440b909 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:01.511825 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfa87b-8f77-4873-bed5-5d8c5e612514 service neutron] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:01.523026 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfa87b-8f77-4873-bed5-5d8c5e612514 service neutron] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:01.586418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b739f5-8bee-4779-92b1-d129e279ba79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:01.587111 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b739f5-8bee-4779-92b1-d129e279ba79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:01.587525 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b739f5-8bee-4779-92b1-d129e279ba79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:01.587808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b739f5-8bee-4779-92b1-d129e279ba79 admin admin] PATH_INFO: `/v3/users/0b0982ddb5a14fd08553ed2aa37d572c` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:01.588952 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b739f5-8bee-4779-92b1-d129e279ba79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b0982ddb5a14fd08553ed2aa37d572c)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:01.590924 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b739f5-8bee-4779-92b1-d129e279ba79 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:01.616955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:01.641549 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-87b739f5-8bee-4779-92b1-d129e279ba79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b0982ddb5a14fd08553ed2aa37d572c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:01.642205 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-87b739f5-8bee-4779-92b1-d129e279ba79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b0982ddb5a14fd08553ed2aa37d572c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:01.650111 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-87b739f5-8bee-4779-92b1-d129e279ba79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b0982ddb5a14fd08553ed2aa37d572c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:01.658401 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-87b739f5-8bee-4779-92b1-d129e279ba79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b0982ddb5a14fd08553ed2aa37d572c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:01.659187 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-87b739f5-8bee-4779-92b1-d129e279ba79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b0982ddb5a14fd08553ed2aa37d572c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:01.680766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 996/1975] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:33:01 2022] DELETE /identity/v3/users/0b0982ddb5a14fd08553ed2aa37d572c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:01.964344 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb241ba4-bab6-4cea-8388-f15d1d13d524 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:01.967851 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-fb241ba4-bab6-4cea-8388-f15d1d13d524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:01.982957 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb241ba4-bab6-4cea-8388-f15d1d13d524 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:02.025293 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:02.060097 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afe7ef-c29c-4a07-b633-77c3a9c34ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:02.060772 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afe7ef-c29c-4a07-b633-77c3a9c34ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:02.061233 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afe7ef-c29c-4a07-b633-77c3a9c34ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:02.061506 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afe7ef-c29c-4a07-b633-77c3a9c34ae8 admin admin] PATH_INFO: `/v3/projects/e2a94422e488441fbc9a2b7ee7991240` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:02.063841 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5afe7ef-c29c-4a07-b633-77c3a9c34ae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2a94422e488441fbc9a2b7ee7991240)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:02.065821 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5afe7ef-c29c-4a07-b633-77c3a9c34ae8 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:02.136465 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-e5afe7ef-c29c-4a07-b633-77c3a9c34ae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2a94422e488441fbc9a2b7ee7991240', 'request_id': 'req-e5afe7ef-c29c-4a07-b633-77c3a9c34ae8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:02.145811 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-e5afe7ef-c29c-4a07-b633-77c3a9c34ae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2a94422e488441fbc9a2b7ee7991240', 'request_id': 'req-e5afe7ef-c29c-4a07-b633-77c3a9c34ae8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:02.153715 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-e5afe7ef-c29c-4a07-b633-77c3a9c34ae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2a94422e488441fbc9a2b7ee7991240', 'request_id': 'req-e5afe7ef-c29c-4a07-b633-77c3a9c34ae8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:02.165128 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-e5afe7ef-c29c-4a07-b633-77c3a9c34ae8 admin admin] The token cache is being invalidate because project e2a94422e488441fbc9a2b7ee7991240 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:33:02.165532 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-e5afe7ef-c29c-4a07-b633-77c3a9c34ae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:02.166194 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-e5afe7ef-c29c-4a07-b633-77c3a9c34ae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:02.167738 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 980/1976] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:33:01 2022] DELETE /identity/v3/projects/e2a94422e488441fbc9a2b7ee7991240 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:02.172852 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64889e03-9b17-4a33-af9f-d2ee34a2f7c1 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:02.173142 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64889e03-9b17-4a33-af9f-d2ee34a2f7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:02.179493 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64889e03-9b17-4a33-af9f-d2ee34a2f7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:02.211720 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-64889e03-9b17-4a33-af9f-d2ee34a2f7c1 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:02.213045 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-64889e03-9b17-4a33-af9f-d2ee34a2f7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:02.265747 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afe7ef-c29c-4a07-b633-77c3a9c34ae8 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:02.267519 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-e5afe7ef-c29c-4a07-b633-77c3a9c34ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:02.321515 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 997/1977] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:02.330526 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7adfec-0ccc-4d8b-845a-be765d322268 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:02.331351 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7adfec-0ccc-4d8b-845a-be765d322268 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:02.331714 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7adfec-0ccc-4d8b-845a-be765d322268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:02.359240 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-ca7adfec-0ccc-4d8b-845a-be765d322268 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:02.360772 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ca7adfec-0ccc-4d8b-845a-be765d322268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:02.370555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afe7ef-c29c-4a07-b633-77c3a9c34ae8 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:02.372928 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 998/1978] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:33:02.377528 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7adfec-0ccc-4d8b-845a-be765d322268 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:02.378220 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511cb08-f51c-4026-a28c-a67f1a520fea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:02.378941 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511cb08-f51c-4026-a28c-a67f1a520fea service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:02.379255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511cb08-f51c-4026-a28c-a67f1a520fea service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:02.379527 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511cb08-f51c-4026-a28c-a67f1a520fea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:02.381834 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-3511cb08-f51c-4026-a28c-a67f1a520fea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:02.406557 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7adfec-0ccc-4d8b-845a-be765d322268 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:02.412380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db43a4f-05e3-46fa-b4c4-6786f815115e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:02.413016 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db43a4f-05e3-46fa-b4c4-6786f815115e admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:02.413288 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db43a4f-05e3-46fa-b4c4-6786f815115e admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:02.413554 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db43a4f-05e3-46fa-b4c4-6786f815115e admin admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:02.414660 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db43a4f-05e3-46fa-b4c4-6786f815115e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:33:02.414660 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db43a4f-05e3-46fa-b4c4-6786f815115e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:02.416624 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db43a4f-05e3-46fa-b4c4-6786f815115e admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:02.450372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 999/1979] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:33:02.453711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db43a4f-05e3-46fa-b4c4-6786f815115e admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:02.479128 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db43a4f-05e3-46fa-b4c4-6786f815115e admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:02.486580 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340adfcb-44e1-40c4-b370-abe915b88121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:02.486750 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511cb08-f51c-4026-a28c-a67f1a520fea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:02.487740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340adfcb-44e1-40c4-b370-abe915b88121 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:02.488331 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511cb08-f51c-4026-a28c-a67f1a520fea service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:02.488786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340adfcb-44e1-40c4-b370-abe915b88121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:02.489112 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340adfcb-44e1-40c4-b370-abe915b88121 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:02.489902 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340adfcb-44e1-40c4-b370-abe915b88121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:02.492316 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340adfcb-44e1-40c4-b370-abe915b88121 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:02.499747 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 981/1980] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:33:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:33:02.539752 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1000/1981] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:33:02 2022] POST /identity/v3/projects => generated 393 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:33:02.544109 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511cb08-f51c-4026-a28c-a67f1a520fea service cinder] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:02.555967 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511cb08-f51c-4026-a28c-a67f1a520fea service cinder] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:02.577338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:02.639622 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a18b8-ed97-488f-b866-d12e039c5ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:02.640381 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a18b8-ed97-488f-b866-d12e039c5ebb admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:02.640702 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a18b8-ed97-488f-b866-d12e039c5ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:02.641049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a18b8-ed97-488f-b866-d12e039c5ebb admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:02.641784 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a18b8-ed97-488f-b866-d12e039c5ebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:02.643883 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a18b8-ed97-488f-b866-d12e039c5ebb admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:02.669016 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 982/1982] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:33:02 2022] POST /identity/v3/users => generated 297 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:33:02.673212 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340adfcb-44e1-40c4-b370-abe915b88121 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:02.684372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340adfcb-44e1-40c4-b370-abe915b88121 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:02.689208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b90b8-4ea6-42b7-b6f1-2a24f39ed845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:02.689818 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b90b8-4ea6-42b7-b6f1-2a24f39ed845 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:02.690093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b90b8-4ea6-42b7-b6f1-2a24f39ed845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:02.690358 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b90b8-4ea6-42b7-b6f1-2a24f39ed845 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:02.691019 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b90b8-4ea6-42b7-b6f1-2a24f39ed845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:02.692637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b90b8-4ea6-42b7-b6f1-2a24f39ed845 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:02.708524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1001/1983] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:33:02.709831 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a18b8-ed97-488f-b866-d12e039c5ebb admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:02.721621 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a18b8-ed97-488f-b866-d12e039c5ebb admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:02.727949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6dbe7-ab89-4c70-857a-cca044e21455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:02.733545 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6dbe7-ab89-4c70-857a-cca044e21455 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:02.733974 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6dbe7-ab89-4c70-857a-cca044e21455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:02.734377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6dbe7-ab89-4c70-857a-cca044e21455 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:02.735366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6dbe7-ab89-4c70-857a-cca044e21455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:02.737278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6dbe7-ab89-4c70-857a-cca044e21455 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:02.750370 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 983/1984] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:33:02.754837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b90b8-4ea6-42b7-b6f1-2a24f39ed845 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:02.768253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b90b8-4ea6-42b7-b6f1-2a24f39ed845 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:02.779147 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97d79a-765f-4e57-8ca3-7d3182d33062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:02.783318 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97d79a-765f-4e57-8ca3-7d3182d33062 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:02.783515 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97d79a-765f-4e57-8ca3-7d3182d33062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:02.783766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97d79a-765f-4e57-8ca3-7d3182d33062 admin admin] PATH_INFO: `/v3/projects/c336f5bb9fc84e318161fbb522838652/users/ae354ab7345844afb3a46482c00b9ab7/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:02.821076 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97d79a-765f-4e57-8ca3-7d3182d33062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c336f5bb9fc84e318161fbb522838652, user_id=ae354ab7345844afb3a46482c00b9ab7, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:02.827531 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97d79a-765f-4e57-8ca3-7d3182d33062 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:02.855022 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1002/1985] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:33:02 2022] PUT /identity/v3/projects/c336f5bb9fc84e318161fbb522838652/users/ae354ab7345844afb3a46482c00b9ab7/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:02.865538 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921390a-faf1-4717-9db8-08a0129407b5 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:02.865829 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921390a-faf1-4717-9db8-08a0129407b5 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:02.866133 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921390a-faf1-4717-9db8-08a0129407b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:02.917245 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-e921390a-faf1-4717-9db8-08a0129407b5 None None] MFA Rules not processed for user `ae354ab7345844afb3a46482c00b9ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:02.918750 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-e921390a-faf1-4717-9db8-08a0129407b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:03.053888 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 984/1986] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:33:03.055972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97d79a-765f-4e57-8ca3-7d3182d33062 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:03.094761 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:03.153859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97d79a-765f-4e57-8ca3-7d3182d33062 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:03.160163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9588470-ab4a-4740-995a-f39a2c357def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:03.160875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9588470-ab4a-4740-995a-f39a2c357def admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:03.161169 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9588470-ab4a-4740-995a-f39a2c357def admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:03.161632 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9588470-ab4a-4740-995a-f39a2c357def admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:03.162087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9588470-ab4a-4740-995a-f39a2c357def admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:03.164201 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9588470-ab4a-4740-995a-f39a2c357def admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:03.197876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1003/1987] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:33:03 2022] POST /identity/v3/projects => generated 393 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:33:03.199502 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921390a-faf1-4717-9db8-08a0129407b5 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:03.214545 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921390a-faf1-4717-9db8-08a0129407b5 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:03.286262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc7012-a3fb-4484-a896-e15c91bc985f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:03.286893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc7012-a3fb-4484-a896-e15c91bc985f admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:03.287209 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc7012-a3fb-4484-a896-e15c91bc985f admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:03.287479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc7012-a3fb-4484-a896-e15c91bc985f admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:03.288164 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc7012-a3fb-4484-a896-e15c91bc985f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:03.290091 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc7012-a3fb-4484-a896-e15c91bc985f admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:03.328394 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 985/1988] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:33:03 2022] POST /identity/v3/users => generated 303 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:33:03.332783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9588470-ab4a-4740-995a-f39a2c357def admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:03.344231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9588470-ab4a-4740-995a-f39a2c357def admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:03.349093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe65eaf-93cb-4778-982a-cd0a973b8ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:03.349607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe65eaf-93cb-4778-982a-cd0a973b8ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:03.349887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe65eaf-93cb-4778-982a-cd0a973b8ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:03.350158 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe65eaf-93cb-4778-982a-cd0a973b8ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:03.350933 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe65eaf-93cb-4778-982a-cd0a973b8ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:03.352604 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe65eaf-93cb-4778-982a-cd0a973b8ca5 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:03.366119 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1004/1989] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:33:03.370772 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc7012-a3fb-4484-a896-e15c91bc985f admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:03.384340 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc7012-a3fb-4484-a896-e15c91bc985f admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:03.389690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437979d-0286-4987-bf8c-8855cfd2bedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:03.390438 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437979d-0286-4987-bf8c-8855cfd2bedb admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:03.390740 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437979d-0286-4987-bf8c-8855cfd2bedb admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:03.391189 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437979d-0286-4987-bf8c-8855cfd2bedb admin admin] PATH_INFO: `/v3/projects/c3372e458c1140e88b108813558c7976/users/59f6565789ae4cdfb70b125a0dc4ea6d/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:03.409582 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:03.414341 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437979d-0286-4987-bf8c-8855cfd2bedb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3372e458c1140e88b108813558c7976, user_id=59f6565789ae4cdfb70b125a0dc4ea6d, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:03.417495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437979d-0286-4987-bf8c-8855cfd2bedb admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:03.433997 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 986/1990] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:33:03 2022] PUT /identity/v3/projects/c3372e458c1140e88b108813558c7976/users/59f6565789ae4cdfb70b125a0dc4ea6d/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:03.438348 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe65eaf-93cb-4778-982a-cd0a973b8ca5 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:03.449363 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe65eaf-93cb-4778-982a-cd0a973b8ca5 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:03.535893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530b88b-05a7-4949-b96a-0b0135b79fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:03.536634 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530b88b-05a7-4949-b96a-0b0135b79fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:03.537014 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530b88b-05a7-4949-b96a-0b0135b79fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:03.537379 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530b88b-05a7-4949-b96a-0b0135b79fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:03.538108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530b88b-05a7-4949-b96a-0b0135b79fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:03.539833 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530b88b-05a7-4949-b96a-0b0135b79fb5 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:03.555562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1005/1991] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:33:03.556967 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437979d-0286-4987-bf8c-8855cfd2bedb admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:03.570920 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437979d-0286-4987-bf8c-8855cfd2bedb admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:03.577514 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c32d65-81ae-41b2-a234-07b6778cbb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:03.578205 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c32d65-81ae-41b2-a234-07b6778cbb54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:03.578546 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c32d65-81ae-41b2-a234-07b6778cbb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:03.578772 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c32d65-81ae-41b2-a234-07b6778cbb54 admin admin] PATH_INFO: `/v3/projects/c3372e458c1140e88b108813558c7976/users/59f6565789ae4cdfb70b125a0dc4ea6d/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:03.583722 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c32d65-81ae-41b2-a234-07b6778cbb54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3372e458c1140e88b108813558c7976, user_id=59f6565789ae4cdfb70b125a0dc4ea6d, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:03.586477 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c32d65-81ae-41b2-a234-07b6778cbb54 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:03.605151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 987/1992] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:33:03 2022] PUT /identity/v3/projects/c3372e458c1140e88b108813558c7976/users/59f6565789ae4cdfb70b125a0dc4ea6d/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:03.616326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e619f-3181-4437-b1b7-41a36136c91c None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:03.616630 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e619f-3181-4437-b1b7-41a36136c91c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:03.616890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e619f-3181-4437-b1b7-41a36136c91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:03.652088 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-8f9e619f-3181-4437-b1b7-41a36136c91c None None] MFA Rules not processed for user `59f6565789ae4cdfb70b125a0dc4ea6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:03.653371 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8f9e619f-3181-4437-b1b7-41a36136c91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:03.739982 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1006/1993] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:03 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:03.751795 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c32d65-81ae-41b2-a234-07b6778cbb54 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:03.753564 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-b6c32d65-81ae-41b2-a234-07b6778cbb54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:03.845834 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c32d65-81ae-41b2-a234-07b6778cbb54 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:03.850022 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e83d1-0566-4edf-9950-a7cfd255232b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:03.850660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e83d1-0566-4edf-9950-a7cfd255232b service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:03.851254 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e83d1-0566-4edf-9950-a7cfd255232b service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:03.851515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e83d1-0566-4edf-9950-a7cfd255232b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:03.862302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e83d1-0566-4edf-9950-a7cfd255232b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:03.863934 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e83d1-0566-4edf-9950-a7cfd255232b service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:03.875050 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 988/1994] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:33:03 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:33:03.938595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e619f-3181-4437-b1b7-41a36136c91c None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:03.948270 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e619f-3181-4437-b1b7-41a36136c91c None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:03.951873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b87cb-6ef3-497a-9cd4-3e887487112f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:03.952481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b87cb-6ef3-497a-9cd4-3e887487112f service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:03.952760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b87cb-6ef3-497a-9cd4-3e887487112f service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:03.953028 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b87cb-6ef3-497a-9cd4-3e887487112f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:03.970045 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:04.012905 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b87cb-6ef3-497a-9cd4-3e887487112f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:04.014434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b87cb-6ef3-497a-9cd4-3e887487112f service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:04.026087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1007/1995] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:33:03 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:33:07.805512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e83d1-0566-4edf-9950-a7cfd255232b service cinder] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:07.878165 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e83d1-0566-4edf-9950-a7cfd255232b service cinder] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:07.886104 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240dea8-d94a-4d81-a988-277c7dbc7ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:07.886881 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240dea8-d94a-4d81-a988-277c7dbc7ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:07.887239 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240dea8-d94a-4d81-a988-277c7dbc7ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:07.887603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240dea8-d94a-4d81-a988-277c7dbc7ab6 admin admin] PATH_INFO: `/v3/users/ae354ab7345844afb3a46482c00b9ab7` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:07.889205 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240dea8-d94a-4d81-a988-277c7dbc7ab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae354ab7345844afb3a46482c00b9ab7)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:07.892443 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240dea8-d94a-4d81-a988-277c7dbc7ab6 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:07.948404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-5240dea8-d94a-4d81-a988-277c7dbc7ab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae354ab7345844afb3a46482c00b9ab7'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:07.949124 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-5240dea8-d94a-4d81-a988-277c7dbc7ab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae354ab7345844afb3a46482c00b9ab7'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:07.959619 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-5240dea8-d94a-4d81-a988-277c7dbc7ab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae354ab7345844afb3a46482c00b9ab7'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:07.960690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-5240dea8-d94a-4d81-a988-277c7dbc7ab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae354ab7345844afb3a46482c00b9ab7'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:07.973420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-5240dea8-d94a-4d81-a988-277c7dbc7ab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae354ab7345844afb3a46482c00b9ab7'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:07.995957 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:08.005840 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 989/1996] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:33:07 2022] DELETE /identity/v3/users/ae354ab7345844afb3a46482c00b9ab7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:08.010631 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181039f-44c2-4097-8a0a-b2bbd0cb0faf None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:08.012253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181039f-44c2-4097-8a0a-b2bbd0cb0faf None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:08.012697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181039f-44c2-4097-8a0a-b2bbd0cb0faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:08.052285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-0181039f-44c2-4097-8a0a-b2bbd0cb0faf None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:08.054542 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-0181039f-44c2-4097-8a0a-b2bbd0cb0faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:08.156729 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1008/1997] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:08.168412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240dea8-d94a-4d81-a988-277c7dbc7ab6 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:08.174523 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-5240dea8-d94a-4d81-a988-277c7dbc7ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:08.267485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240dea8-d94a-4d81-a988-277c7dbc7ab6 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:08.272186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d00032-e70f-4fe0-948d-ba8dfdd460fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:08.272857 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d00032-e70f-4fe0-948d-ba8dfdd460fa service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:08.273083 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d00032-e70f-4fe0-948d-ba8dfdd460fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:08.273349 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d00032-e70f-4fe0-948d-ba8dfdd460fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:08.283806 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d00032-e70f-4fe0-948d-ba8dfdd460fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:08.285244 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d00032-e70f-4fe0-948d-ba8dfdd460fa service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:08.296106 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 990/1998] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:33:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:33:08.845480 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181039f-44c2-4097-8a0a-b2bbd0cb0faf None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:08.847980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-0181039f-44c2-4097-8a0a-b2bbd0cb0faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:08.867101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181039f-44c2-4097-8a0a-b2bbd0cb0faf None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:08.880370 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726ce46-1416-4da4-88a1-1aa11b784c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:08.881201 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726ce46-1416-4da4-88a1-1aa11b784c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:08.881575 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726ce46-1416-4da4-88a1-1aa11b784c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:08.881950 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726ce46-1416-4da4-88a1-1aa11b784c95 admin admin] PATH_INFO: `/v3/projects/c336f5bb9fc84e318161fbb522838652` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:08.883301 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726ce46-1416-4da4-88a1-1aa11b784c95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c336f5bb9fc84e318161fbb522838652)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:08.885574 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726ce46-1416-4da4-88a1-1aa11b784c95 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:08.990844 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e726ce46-1416-4da4-88a1-1aa11b784c95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c336f5bb9fc84e318161fbb522838652', 'request_id': 'req-e726ce46-1416-4da4-88a1-1aa11b784c95'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:09.004245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e726ce46-1416-4da4-88a1-1aa11b784c95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c336f5bb9fc84e318161fbb522838652', 'request_id': 'req-e726ce46-1416-4da4-88a1-1aa11b784c95'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:09.016258 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e726ce46-1416-4da4-88a1-1aa11b784c95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c336f5bb9fc84e318161fbb522838652', 'request_id': 'req-e726ce46-1416-4da4-88a1-1aa11b784c95'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:09.037603 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e726ce46-1416-4da4-88a1-1aa11b784c95 admin admin] The token cache is being invalidate because project c336f5bb9fc84e318161fbb522838652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:33:09.038258 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e726ce46-1416-4da4-88a1-1aa11b784c95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:09.039393 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e726ce46-1416-4da4-88a1-1aa11b784c95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:09.041242 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1009/1999] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:33:08 2022] DELETE /identity/v3/projects/c336f5bb9fc84e318161fbb522838652 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:09.046123 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d00032-e70f-4fe0-948d-ba8dfdd460fa service neutron] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:09.056580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d00032-e70f-4fe0-948d-ba8dfdd460fa service neutron] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:09.122846 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcb978-6ebe-41bf-866c-9c0c7770be06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:09.123865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcb978-6ebe-41bf-866c-9c0c7770be06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:09.124153 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcb978-6ebe-41bf-866c-9c0c7770be06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:09.124428 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcb978-6ebe-41bf-866c-9c0c7770be06 admin admin] PATH_INFO: `/v3/users/59f6565789ae4cdfb70b125a0dc4ea6d` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:09.125662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dcb978-6ebe-41bf-866c-9c0c7770be06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59f6565789ae4cdfb70b125a0dc4ea6d)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:09.127697 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dcb978-6ebe-41bf-866c-9c0c7770be06 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:09.189417 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b0dcb978-6ebe-41bf-866c-9c0c7770be06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59f6565789ae4cdfb70b125a0dc4ea6d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:09.190132 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b0dcb978-6ebe-41bf-866c-9c0c7770be06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59f6565789ae4cdfb70b125a0dc4ea6d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:09.198124 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b0dcb978-6ebe-41bf-866c-9c0c7770be06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59f6565789ae4cdfb70b125a0dc4ea6d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:09.199197 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b0dcb978-6ebe-41bf-866c-9c0c7770be06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59f6565789ae4cdfb70b125a0dc4ea6d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:09.209353 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b0dcb978-6ebe-41bf-866c-9c0c7770be06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59f6565789ae4cdfb70b125a0dc4ea6d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:09.230049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 991/2000] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:33:09 2022] DELETE /identity/v3/users/59f6565789ae4cdfb70b125a0dc4ea6d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:09.590673 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726ce46-1416-4da4-88a1-1aa11b784c95 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:09.592341 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-e726ce46-1416-4da4-88a1-1aa11b784c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:09.612415 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726ce46-1416-4da4-88a1-1aa11b784c95 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:09.666245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:09.692819 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf3701-b5b5-457f-b616-f13d63313d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:09.693474 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf3701-b5b5-457f-b616-f13d63313d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:09.693801 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf3701-b5b5-457f-b616-f13d63313d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:09.694076 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf3701-b5b5-457f-b616-f13d63313d81 admin admin] PATH_INFO: `/v3/projects/c3372e458c1140e88b108813558c7976` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:09.695256 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf3701-b5b5-457f-b616-f13d63313d81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3372e458c1140e88b108813558c7976)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:09.697251 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf3701-b5b5-457f-b616-f13d63313d81 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:09.785120 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5ccf3701-b5b5-457f-b616-f13d63313d81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3372e458c1140e88b108813558c7976', 'request_id': 'req-5ccf3701-b5b5-457f-b616-f13d63313d81'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:09.794009 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5ccf3701-b5b5-457f-b616-f13d63313d81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3372e458c1140e88b108813558c7976', 'request_id': 'req-5ccf3701-b5b5-457f-b616-f13d63313d81'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:09.801420 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5ccf3701-b5b5-457f-b616-f13d63313d81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3372e458c1140e88b108813558c7976', 'request_id': 'req-5ccf3701-b5b5-457f-b616-f13d63313d81'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:09.814513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5ccf3701-b5b5-457f-b616-f13d63313d81 admin admin] The token cache is being invalidate because project c3372e458c1140e88b108813558c7976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:33:09.814513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5ccf3701-b5b5-457f-b616-f13d63313d81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:09.815112 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5ccf3701-b5b5-457f-b616-f13d63313d81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:09.816793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1010/2001] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:33:09 2022] DELETE /identity/v3/projects/c3372e458c1140e88b108813558c7976 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:33:09.822016 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1e81f-c5f9-4ece-8447-5a32c740bf29 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:09.822446 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1e81f-c5f9-4ece-8447-5a32c740bf29 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:09.822735 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1e81f-c5f9-4ece-8447-5a32c740bf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:09.847712 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-32e1e81f-c5f9-4ece-8447-5a32c740bf29 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:09.849880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-32e1e81f-c5f9-4ece-8447-5a32c740bf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:09.870429 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:09.964893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 992/2002] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:09.980006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82737d-cf49-4cb2-94ab-89687b42dc97 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:09.980006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82737d-cf49-4cb2-94ab-89687b42dc97 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:09.980006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82737d-cf49-4cb2-94ab-89687b42dc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:10.008030 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-8b82737d-cf49-4cb2-94ab-89687b42dc97 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:10.010127 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8b82737d-cf49-4cb2-94ab-89687b42dc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:10.027993 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1011/2003] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:10.032435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1e81f-c5f9-4ece-8447-5a32c740bf29 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:10.045227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1e81f-c5f9-4ece-8447-5a32c740bf29 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:10.053636 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320af58e-992e-451f-a909-b47e99688a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:10.055320 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320af58e-992e-451f-a909-b47e99688a33 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:10.055748 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320af58e-992e-451f-a909-b47e99688a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:10.056222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320af58e-992e-451f-a909-b47e99688a33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:10.057590 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320af58e-992e-451f-a909-b47e99688a33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:33:10.058068 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320af58e-992e-451f-a909-b47e99688a33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:10.060690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320af58e-992e-451f-a909-b47e99688a33 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:10.080316 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 993/2004] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:33:10.084474 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82737d-cf49-4cb2-94ab-89687b42dc97 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:10.095597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82737d-cf49-4cb2-94ab-89687b42dc97 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:10.101169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320af58e-992e-451f-a909-b47e99688a33 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:10.101814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace9d78-14df-4adf-a979-5882d7d68352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:10.102467 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace9d78-14df-4adf-a979-5882d7d68352 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:10.102973 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace9d78-14df-4adf-a979-5882d7d68352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:10.103646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace9d78-14df-4adf-a979-5882d7d68352 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:10.104326 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-320af58e-992e-451f-a909-b47e99688a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:10.104640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace9d78-14df-4adf-a979-5882d7d68352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:10.106847 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace9d78-14df-4adf-a979-5882d7d68352 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:10.149274 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1012/2005] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:33:10 2022] POST /identity/v3/projects => generated 361 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:33:10.155175 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace9d78-14df-4adf-a979-5882d7d68352 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:10.190439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320af58e-992e-451f-a909-b47e99688a33 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:10.246214 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace9d78-14df-4adf-a979-5882d7d68352 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:10.253364 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44870a52-9ae3-4512-bbdc-beec0cc957ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:10.254228 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44870a52-9ae3-4512-bbdc-beec0cc957ae admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:10.255052 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44870a52-9ae3-4512-bbdc-beec0cc957ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:10.255606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44870a52-9ae3-4512-bbdc-beec0cc957ae admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:10.257419 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44870a52-9ae3-4512-bbdc-beec0cc957ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:10.259836 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44870a52-9ae3-4512-bbdc-beec0cc957ae admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:10.286025 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40173d-3007-4437-b9e9-ef27fffb5925 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:10.287576 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40173d-3007-4437-b9e9-ef27fffb5925 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:10.288251 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40173d-3007-4437-b9e9-ef27fffb5925 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:10.288866 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40173d-3007-4437-b9e9-ef27fffb5925 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:10.291760 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-1d40173d-3007-4437-b9e9-ef27fffb5925 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:10.295943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1013/2006] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:33:10 2022] POST /identity/v3/users => generated 281 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:33:10.299720 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44870a52-9ae3-4512-bbdc-beec0cc957ae admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:10.313617 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44870a52-9ae3-4512-bbdc-beec0cc957ae admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:10.320994 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea46d3-aae7-44b6-9b25-f0f73784582c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:10.321937 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea46d3-aae7-44b6-9b25-f0f73784582c admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:10.323008 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea46d3-aae7-44b6-9b25-f0f73784582c admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:10.323476 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea46d3-aae7-44b6-9b25-f0f73784582c admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:10.324999 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea46d3-aae7-44b6-9b25-f0f73784582c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:10.327536 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea46d3-aae7-44b6-9b25-f0f73784582c admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:10.341639 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1014/2007] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:33:10.346228 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea46d3-aae7-44b6-9b25-f0f73784582c admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:10.357133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea46d3-aae7-44b6-9b25-f0f73784582c admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:10.363053 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51094d-ca1c-4db3-9a5f-9baff92ee21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:10.363679 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51094d-ca1c-4db3-9a5f-9baff92ee21b admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:10.363958 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51094d-ca1c-4db3-9a5f-9baff92ee21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:10.364924 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51094d-ca1c-4db3-9a5f-9baff92ee21b admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:10.366233 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed51094d-ca1c-4db3-9a5f-9baff92ee21b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:10.368744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed51094d-ca1c-4db3-9a5f-9baff92ee21b admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:10.390074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1015/2008] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:33:10.391180 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51094d-ca1c-4db3-9a5f-9baff92ee21b admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:10.400299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40173d-3007-4437-b9e9-ef27fffb5925 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:10.402704 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40173d-3007-4437-b9e9-ef27fffb5925 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:10.403312 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51094d-ca1c-4db3-9a5f-9baff92ee21b admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:10.413306 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555fda1-c4ad-4d82-b681-8c2de7582dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:10.414000 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555fda1-c4ad-4d82-b681-8c2de7582dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:10.414278 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555fda1-c4ad-4d82-b681-8c2de7582dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:10.414547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555fda1-c4ad-4d82-b681-8c2de7582dd4 admin admin] PATH_INFO: `/v3/projects/dbebcade92ca4da383f1ca15c377fe9b/users/d94b74f67a084d19a841ea568d390a37/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:10.422344 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 994/2009] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:33:10 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:33:10.431848 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:10.448362 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555fda1-c4ad-4d82-b681-8c2de7582dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbebcade92ca4da383f1ca15c377fe9b, user_id=d94b74f67a084d19a841ea568d390a37, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:10.451299 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555fda1-c4ad-4d82-b681-8c2de7582dd4 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:10.475473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1016/2010] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:33:10 2022] PUT /identity/v3/projects/dbebcade92ca4da383f1ca15c377fe9b/users/d94b74f67a084d19a841ea568d390a37/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:10.491608 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f961bc-6d8c-433c-921d-9e1a4aea6c4d None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:10.492399 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f961bc-6d8c-433c-921d-9e1a4aea6c4d None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:10.492683 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f961bc-6d8c-433c-921d-9e1a4aea6c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:10.534001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:10.538078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-42f961bc-6d8c-433c-921d-9e1a4aea6c4d None None] MFA Rules not processed for user `d94b74f67a084d19a841ea568d390a37`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:10.539668 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-42f961bc-6d8c-433c-921d-9e1a4aea6c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:10.684622 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 995/2011] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:10.903531 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555fda1-c4ad-4d82-b681-8c2de7582dd4 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:10.964151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555fda1-c4ad-4d82-b681-8c2de7582dd4 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:10.967935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bd7fd-ec67-4a26-9dce-05ba787182e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:10.968580 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bd7fd-ec67-4a26-9dce-05ba787182e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:10.968825 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bd7fd-ec67-4a26-9dce-05ba787182e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:10.969075 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bd7fd-ec67-4a26-9dce-05ba787182e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:10.986621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5bd7fd-ec67-4a26-9dce-05ba787182e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:10.988760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5bd7fd-ec67-4a26-9dce-05ba787182e1 service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:11.002948 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1017/2012] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:33:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:33:11.021035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f961bc-6d8c-433c-921d-9e1a4aea6c4d None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:11.191966 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f961bc-6d8c-433c-921d-9e1a4aea6c4d None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:11.199009 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e94b98-e1e6-47fe-8411-de380937386c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:11.199843 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e94b98-e1e6-47fe-8411-de380937386c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:11.200128 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e94b98-e1e6-47fe-8411-de380937386c admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:11.200808 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e94b98-e1e6-47fe-8411-de380937386c admin admin] PATH_INFO: `/v3/users/d94b74f67a084d19a841ea568d390a37` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:11.202880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e94b98-e1e6-47fe-8411-de380937386c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d94b74f67a084d19a841ea568d390a37)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:11.210024 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e94b98-e1e6-47fe-8411-de380937386c admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:11.308667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-a8e94b98-e1e6-47fe-8411-de380937386c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd94b74f67a084d19a841ea568d390a37'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:11.309395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-a8e94b98-e1e6-47fe-8411-de380937386c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd94b74f67a084d19a841ea568d390a37'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:11.318734 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-a8e94b98-e1e6-47fe-8411-de380937386c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd94b74f67a084d19a841ea568d390a37'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:11.319265 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-a8e94b98-e1e6-47fe-8411-de380937386c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd94b74f67a084d19a841ea568d390a37'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:11.331655 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-a8e94b98-e1e6-47fe-8411-de380937386c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd94b74f67a084d19a841ea568d390a37'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:11.354375 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 996/2013] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:33:11 2022] DELETE /identity/v3/users/d94b74f67a084d19a841ea568d390a37 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:11.358605 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502e713-05cb-4cfb-854a-6ca63d68e2cd None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:11.359259 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502e713-05cb-4cfb-854a-6ca63d68e2cd None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:11.359259 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502e713-05cb-4cfb-854a-6ca63d68e2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:11.383583 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-a502e713-05cb-4cfb-854a-6ca63d68e2cd None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:11.385562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-a502e713-05cb-4cfb-854a-6ca63d68e2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:11.508797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1018/2014] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:33:11.519748 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e94b98-e1e6-47fe-8411-de380937386c admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:11.522101 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a8e94b98-e1e6-47fe-8411-de380937386c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:11.566709 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:11.644662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e94b98-e1e6-47fe-8411-de380937386c admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:11.654109 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c34ab-56d1-40bf-8613-ead4dbaf8c64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:11.654950 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c34ab-56d1-40bf-8613-ead4dbaf8c64 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:11.663706 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c34ab-56d1-40bf-8613-ead4dbaf8c64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:11.664293 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c34ab-56d1-40bf-8613-ead4dbaf8c64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:11.680682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c34ab-56d1-40bf-8613-ead4dbaf8c64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:11.686525 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c34ab-56d1-40bf-8613-ead4dbaf8c64 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:11.718857 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 997/2015] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:33:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:33:12.053095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1a09b-403f-4e18-b5db-f893c386bb5e None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:12.053450 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1a09b-403f-4e18-b5db-f893c386bb5e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:12.053855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1a09b-403f-4e18-b5db-f893c386bb5e None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:12.055384 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1019/2016] 10.222.0.55 () {54 vars in 921 bytes} [Tue Oct 4 16:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:33:12.069495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496e991-4e89-451b-a422-78466d214778 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:12.069852 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496e991-4e89-451b-a422-78466d214778 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:12.070174 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496e991-4e89-451b-a422-78466d214778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:12.100278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-a496e991-4e89-451b-a422-78466d214778 None None] MFA Rules not processed for user `8cd59eac06e347ee9432185b24fdf773`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:12.101680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a496e991-4e89-451b-a422-78466d214778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:12.181994 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1a09b-403f-4e18-b5db-f893c386bb5e None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:12.184612 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-d7b1a09b-403f-4e18-b5db-f893c386bb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:12.196907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 998/2017] 10.222.0.55 () {58 vars in 1018 bytes} [Tue Oct 4 16:33:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:12.200552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1a09b-403f-4e18-b5db-f893c386bb5e None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:12.205944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093f23a-a519-4b38-92f8-7efe9eddcec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:12.206585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093f23a-a519-4b38-92f8-7efe9eddcec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:12.206901 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093f23a-a519-4b38-92f8-7efe9eddcec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:12.207698 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093f23a-a519-4b38-92f8-7efe9eddcec7 admin admin] PATH_INFO: `/v3/users/ca1807ed523647849b30021b0f309fcc` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:12.208652 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093f23a-a519-4b38-92f8-7efe9eddcec7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca1807ed523647849b30021b0f309fcc)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:12.213035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093f23a-a519-4b38-92f8-7efe9eddcec7 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:12.213312 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496e991-4e89-451b-a422-78466d214778 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:12.215088 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a496e991-4e89-451b-a422-78466d214778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:12.231643 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496e991-4e89-451b-a422-78466d214778 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:12.237851 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac192a10-0d98-4097-b0e2-9c55953b5563 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd59eac06e347ee9432185b24fdf773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:12.238912 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac192a10-0d98-4097-b0e2-9c55953b5563 service placement] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:12.239352 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac192a10-0d98-4097-b0e2-9c55953b5563 service placement] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:12.239690 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac192a10-0d98-4097-b0e2-9c55953b5563 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:12.250046 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac192a10-0d98-4097-b0e2-9c55953b5563 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:12.251772 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac192a10-0d98-4097-b0e2-9c55953b5563 service placement] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:12.265637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 999/2018] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:33:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:33:12.266944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac192a10-0d98-4097-b0e2-9c55953b5563 service placement] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:12.267853 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ac192a10-0d98-4097-b0e2-9c55953b5563 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:12.283215 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac192a10-0d98-4097-b0e2-9c55953b5563 service placement] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:12.283376 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8093f23a-a519-4b38-92f8-7efe9eddcec7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca1807ed523647849b30021b0f309fcc'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:12.285436 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8093f23a-a519-4b38-92f8-7efe9eddcec7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca1807ed523647849b30021b0f309fcc'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:12.288385 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b37215-b739-4f78-b79e-18a4116e6837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:12.289249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b37215-b739-4f78-b79e-18a4116e6837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:12.289705 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b37215-b739-4f78-b79e-18a4116e6837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:12.290185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b37215-b739-4f78-b79e-18a4116e6837 admin admin] PATH_INFO: `/v3/projects/dbebcade92ca4da383f1ca15c377fe9b` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:12.291381 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b37215-b739-4f78-b79e-18a4116e6837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbebcade92ca4da383f1ca15c377fe9b)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:12.293300 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b37215-b739-4f78-b79e-18a4116e6837 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:12.315637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8093f23a-a519-4b38-92f8-7efe9eddcec7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca1807ed523647849b30021b0f309fcc'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:12.327541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8093f23a-a519-4b38-92f8-7efe9eddcec7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca1807ed523647849b30021b0f309fcc'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:12.328323 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8093f23a-a519-4b38-92f8-7efe9eddcec7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca1807ed523647849b30021b0f309fcc'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:12.348876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1020/2019] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:33:12 2022] DELETE /identity/v3/users/ca1807ed523647849b30021b0f309fcc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:33:12.352971 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-75b37215-b739-4f78-b79e-18a4116e6837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbebcade92ca4da383f1ca15c377fe9b', 'request_id': 'req-75b37215-b739-4f78-b79e-18a4116e6837'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:12.363221 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-75b37215-b739-4f78-b79e-18a4116e6837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbebcade92ca4da383f1ca15c377fe9b', 'request_id': 'req-75b37215-b739-4f78-b79e-18a4116e6837'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:12.370366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-75b37215-b739-4f78-b79e-18a4116e6837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbebcade92ca4da383f1ca15c377fe9b', 'request_id': 'req-75b37215-b739-4f78-b79e-18a4116e6837'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:12.381937 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-75b37215-b739-4f78-b79e-18a4116e6837 admin admin] The token cache is being invalidate because project dbebcade92ca4da383f1ca15c377fe9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:33:12.382300 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-75b37215-b739-4f78-b79e-18a4116e6837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:12.383454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-75b37215-b739-4f78-b79e-18a4116e6837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:12.384745 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1000/2020] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:33:12 2022] DELETE /identity/v3/projects/dbebcade92ca4da383f1ca15c377fe9b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:12.390387 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e41eaf-61f7-4d18-851e-c0a9e232c8fc None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:12.391293 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e41eaf-61f7-4d18-851e-c0a9e232c8fc None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:12.391838 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e41eaf-61f7-4d18-851e-c0a9e232c8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:12.402822 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:12.418707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-23e41eaf-61f7-4d18-851e-c0a9e232c8fc None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:12.420260 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-23e41eaf-61f7-4d18-851e-c0a9e232c8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:12.500294 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1021/2021] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:12.509784 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e24a6-fc26-45d0-b837-d20322cd881c None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:12.510069 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e24a6-fc26-45d0-b837-d20322cd881c None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:12.510427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e24a6-fc26-45d0-b837-d20322cd881c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:12.540526 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-9c5e24a6-fc26-45d0-b837-d20322cd881c None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:12.541755 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-9c5e24a6-fc26-45d0-b837-d20322cd881c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:12.550138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1001/2022] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:12.554776 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e41eaf-61f7-4d18-851e-c0a9e232c8fc None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:12.565178 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e41eaf-61f7-4d18-851e-c0a9e232c8fc None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:12.570475 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4437d2b-a201-4c4a-b0ae-5035bf6dc55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:12.571126 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4437d2b-a201-4c4a-b0ae-5035bf6dc55f admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:12.571485 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4437d2b-a201-4c4a-b0ae-5035bf6dc55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:12.571759 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4437d2b-a201-4c4a-b0ae-5035bf6dc55f admin admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:12.572527 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4437d2b-a201-4c4a-b0ae-5035bf6dc55f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:33:12.572836 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4437d2b-a201-4c4a-b0ae-5035bf6dc55f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:12.574522 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4437d2b-a201-4c4a-b0ae-5035bf6dc55f admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:12.587030 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1022/2023] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:33:12.591606 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e24a6-fc26-45d0-b837-d20322cd881c None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:12.600542 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4437d2b-a201-4c4a-b0ae-5035bf6dc55f admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:12.601490 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e24a6-fc26-45d0-b837-d20322cd881c None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:12.602498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-e4437d2b-a201-4c4a-b0ae-5035bf6dc55f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:12.606368 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7eb7d6-0a6e-495a-a109-39ec1ae6fe57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:12.607182 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7eb7d6-0a6e-495a-a109-39ec1ae6fe57 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:12.607459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7eb7d6-0a6e-495a-a109-39ec1ae6fe57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:12.607863 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7eb7d6-0a6e-495a-a109-39ec1ae6fe57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:12.608509 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7eb7d6-0a6e-495a-a109-39ec1ae6fe57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:12.610464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7eb7d6-0a6e-495a-a109-39ec1ae6fe57 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:12.619812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4437d2b-a201-4c4a-b0ae-5035bf6dc55f admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:12.625643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13c8fc-2dbb-4816-b6ee-e7c4add138a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:12.626595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13c8fc-2dbb-4816-b6ee-e7c4add138a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:12.626975 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13c8fc-2dbb-4816-b6ee-e7c4add138a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:12.627399 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13c8fc-2dbb-4816-b6ee-e7c4add138a1 admin admin] PATH_INFO: `/v3/projects/1d100b2e119a45d58e8eef860e64ff04` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:12.630203 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13c8fc-2dbb-4816-b6ee-e7c4add138a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d100b2e119a45d58e8eef860e64ff04)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:12.630769 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13c8fc-2dbb-4816-b6ee-e7c4add138a1 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:12.647030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1002/2024] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:33:12 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:33:12.651283 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7eb7d6-0a6e-495a-a109-39ec1ae6fe57 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:12.655496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:12.686924 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-9f13c8fc-2dbb-4816-b6ee-e7c4add138a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d100b2e119a45d58e8eef860e64ff04', 'request_id': 'req-9f13c8fc-2dbb-4816-b6ee-e7c4add138a1'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:12.695900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-9f13c8fc-2dbb-4816-b6ee-e7c4add138a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d100b2e119a45d58e8eef860e64ff04', 'request_id': 'req-9f13c8fc-2dbb-4816-b6ee-e7c4add138a1'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:12.703803 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-9f13c8fc-2dbb-4816-b6ee-e7c4add138a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d100b2e119a45d58e8eef860e64ff04', 'request_id': 'req-9f13c8fc-2dbb-4816-b6ee-e7c4add138a1'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:12.714736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-9f13c8fc-2dbb-4816-b6ee-e7c4add138a1 admin admin] The token cache is being invalidate because project 1d100b2e119a45d58e8eef860e64ff04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:33:12.715053 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-9f13c8fc-2dbb-4816-b6ee-e7c4add138a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:12.715717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-9f13c8fc-2dbb-4816-b6ee-e7c4add138a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:12.717272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1023/2025] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:33:12 2022] DELETE /identity/v3/projects/1d100b2e119a45d58e8eef860e64ff04 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:12.721930 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7eb7d6-0a6e-495a-a109-39ec1ae6fe57 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:12.722492 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66347d-6a66-4753-a528-44c164143448 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:12.722776 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66347d-6a66-4753-a528-44c164143448 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:12.723091 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66347d-6a66-4753-a528-44c164143448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:12.742532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-bf66347d-6a66-4753-a528-44c164143448 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:12.743837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-bf66347d-6a66-4753-a528-44c164143448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:12.780260 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a41b4-d75f-47a7-bccb-31655eee97c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:12.780888 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a41b4-d75f-47a7-bccb-31655eee97c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:12.781169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a41b4-d75f-47a7-bccb-31655eee97c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:12.781443 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a41b4-d75f-47a7-bccb-31655eee97c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:12.782080 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a41b4-d75f-47a7-bccb-31655eee97c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:12.784070 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a41b4-d75f-47a7-bccb-31655eee97c0 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:12.809837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1024/2026] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:33:12.814478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1003/2027] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:33:12 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:33:12.815912 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66347d-6a66-4753-a528-44c164143448 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:12.817352 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-bf66347d-6a66-4753-a528-44c164143448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:12.817589 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c0669-bb0f-40a7-a5e7-8e8f71c7d976 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:12.817874 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c0669-bb0f-40a7-a5e7-8e8f71c7d976 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:12.818146 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c0669-bb0f-40a7-a5e7-8e8f71c7d976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:12.829733 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66347d-6a66-4753-a528-44c164143448 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:12.835305 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec768d9b-d3bc-4700-8c60-6d62ff590207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:12.835907 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec768d9b-d3bc-4700-8c60-6d62ff590207 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:12.836183 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec768d9b-d3bc-4700-8c60-6d62ff590207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:12.836452 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec768d9b-d3bc-4700-8c60-6d62ff590207 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:12.837345 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec768d9b-d3bc-4700-8c60-6d62ff590207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:12.837560 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-398c0669-bb0f-40a7-a5e7-8e8f71c7d976 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:12.838817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-398c0669-bb0f-40a7-a5e7-8e8f71c7d976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:12.838944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec768d9b-d3bc-4700-8c60-6d62ff590207 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:12.849138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1004/2028] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:33:12.850133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1025/2029] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:33:12.853672 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c0669-bb0f-40a7-a5e7-8e8f71c7d976 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:12.853888 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec768d9b-d3bc-4700-8c60-6d62ff590207 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:12.859006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:12.863116 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c0669-bb0f-40a7-a5e7-8e8f71c7d976 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:12.865274 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec768d9b-d3bc-4700-8c60-6d62ff590207 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:12.868342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646278fe-e5aa-4ce5-8eac-26574d37a9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:12.868932 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646278fe-e5aa-4ce5-8eac-26574d37a9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:12.869237 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646278fe-e5aa-4ce5-8eac-26574d37a9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:12.869511 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646278fe-e5aa-4ce5-8eac-26574d37a9f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:12.870289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646278fe-e5aa-4ce5-8eac-26574d37a9f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:33:12.870592 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646278fe-e5aa-4ce5-8eac-26574d37a9f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:12.871611 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daff6ab-7ae1-4bc7-919a-324fdf87501e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:12.872218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daff6ab-7ae1-4bc7-919a-324fdf87501e admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:12.872343 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646278fe-e5aa-4ce5-8eac-26574d37a9f9 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:12.872510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daff6ab-7ae1-4bc7-919a-324fdf87501e admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:12.872791 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daff6ab-7ae1-4bc7-919a-324fdf87501e admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:12.873425 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daff6ab-7ae1-4bc7-919a-324fdf87501e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:12.875013 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daff6ab-7ae1-4bc7-919a-324fdf87501e admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:12.884880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1005/2030] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:33:12.891032 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1026/2031] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:33:12.891191 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646278fe-e5aa-4ce5-8eac-26574d37a9f9 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:12.892850 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daff6ab-7ae1-4bc7-919a-324fdf87501e admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:12.902550 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646278fe-e5aa-4ce5-8eac-26574d37a9f9 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:12.904031 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daff6ab-7ae1-4bc7-919a-324fdf87501e admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:12.907266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832120f8-653c-4f13-a283-a559aca93b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:12.907888 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832120f8-653c-4f13-a283-a559aca93b6d admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:12.908164 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832120f8-653c-4f13-a283-a559aca93b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:12.908429 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832120f8-653c-4f13-a283-a559aca93b6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:12.909059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832120f8-653c-4f13-a283-a559aca93b6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:12.909160 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0eab5-ee94-4d9f-9102-0f22414d0657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:12.909792 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0eab5-ee94-4d9f-9102-0f22414d0657 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:12.910068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0eab5-ee94-4d9f-9102-0f22414d0657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:12.910338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0eab5-ee94-4d9f-9102-0f22414d0657 admin admin] PATH_INFO: `/v3/projects/042a09853624426c89fcd03b557168ab/users/1162a7b971974650baa2c1bdea03dfc1/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:12.910971 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832120f8-653c-4f13-a283-a559aca93b6d admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:12.926026 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0eab5-ee94-4d9f-9102-0f22414d0657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=042a09853624426c89fcd03b557168ab, user_id=1162a7b971974650baa2c1bdea03dfc1, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:12.928800 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0eab5-ee94-4d9f-9102-0f22414d0657 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:12.941994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1006/2032] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:33:12 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:33:12.942777 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1027/2033] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:33:12 2022] PUT /identity/v3/projects/042a09853624426c89fcd03b557168ab/users/1162a7b971974650baa2c1bdea03dfc1/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:33:12.946114 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832120f8-653c-4f13-a283-a559aca93b6d admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:12.947762 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e837c68-65ca-43f2-8ce5-42dd5ceef839 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:12.948232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e837c68-65ca-43f2-8ce5-42dd5ceef839 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:12.948510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e837c68-65ca-43f2-8ce5-42dd5ceef839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:12.968155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-7e837c68-65ca-43f2-8ce5-42dd5ceef839 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:12.969364 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-7e837c68-65ca-43f2-8ce5-42dd5ceef839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:13.012725 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:13.023050 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832120f8-653c-4f13-a283-a559aca93b6d admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:13.029547 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40bb20-f375-4d18-9fd8-1994849df6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:13.030176 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40bb20-f375-4d18-9fd8-1994849df6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:13.030450 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40bb20-f375-4d18-9fd8-1994849df6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:13.030904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40bb20-f375-4d18-9fd8-1994849df6b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:13.031602 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40bb20-f375-4d18-9fd8-1994849df6b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:13.033704 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40bb20-f375-4d18-9fd8-1994849df6b4 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:13.046208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1028/2034] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:33:13.052554 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e837c68-65ca-43f2-8ce5-42dd5ceef839 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:13.054358 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-7e837c68-65ca-43f2-8ce5-42dd5ceef839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:13.059542 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1007/2035] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:33:12 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:33:13.063306 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40bb20-f375-4d18-9fd8-1994849df6b4 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:13.075958 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40bb20-f375-4d18-9fd8-1994849df6b4 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:13.080682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf5ed7-f5ec-49be-9611-757e2b349c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:13.081463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf5ed7-f5ec-49be-9611-757e2b349c36 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:13.081743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf5ed7-f5ec-49be-9611-757e2b349c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:13.082183 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf5ed7-f5ec-49be-9611-757e2b349c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:13.082845 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf5ed7-f5ec-49be-9611-757e2b349c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:13.084547 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf5ed7-f5ec-49be-9611-757e2b349c36 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:13.099551 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1008/2036] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:33:13.101562 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf5ed7-f5ec-49be-9611-757e2b349c36 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:13.116884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf5ed7-f5ec-49be-9611-757e2b349c36 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:13.121658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc436c1d-7807-4ece-94a1-91975340448a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:13.122426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc436c1d-7807-4ece-94a1-91975340448a admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:13.122702 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc436c1d-7807-4ece-94a1-91975340448a admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:13.122998 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc436c1d-7807-4ece-94a1-91975340448a admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:13.123660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc436c1d-7807-4ece-94a1-91975340448a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:13.125293 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc436c1d-7807-4ece-94a1-91975340448a admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:13.127122 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e837c68-65ca-43f2-8ce5-42dd5ceef839 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:13.130753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9467c0-5971-4a24-a215-8af76e93bcf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:13.131403 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9467c0-5971-4a24-a215-8af76e93bcf3 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:13.131691 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9467c0-5971-4a24-a215-8af76e93bcf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:13.131948 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9467c0-5971-4a24-a215-8af76e93bcf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:13.146057 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1009/2037] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:33:13.146474 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9467c0-5971-4a24-a215-8af76e93bcf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:13.148734 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc436c1d-7807-4ece-94a1-91975340448a admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:13.149842 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9467c0-5971-4a24-a215-8af76e93bcf3 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:13.162097 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1029/2038] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:33:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:33:13.164900 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc436c1d-7807-4ece-94a1-91975340448a admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:13.175661 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64fddb-635a-47be-aa39-d71115cc7bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:13.176480 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64fddb-635a-47be-aa39-d71115cc7bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:13.176856 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64fddb-635a-47be-aa39-d71115cc7bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:13.177216 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64fddb-635a-47be-aa39-d71115cc7bcf admin admin] PATH_INFO: `/v3/projects/0beaa85de66441c99013ce7272184149/users/66d63b0fb3514e7984e698afd21f2095/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:13.199600 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64fddb-635a-47be-aa39-d71115cc7bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0beaa85de66441c99013ce7272184149, user_id=66d63b0fb3514e7984e698afd21f2095, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:13.202711 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64fddb-635a-47be-aa39-d71115cc7bcf admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:13.228755 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1010/2039] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:33:13 2022] PUT /identity/v3/projects/0beaa85de66441c99013ce7272184149/users/66d63b0fb3514e7984e698afd21f2095/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:13.234530 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1a365-e7a0-49ad-b05b-97f012daba24 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:13.235045 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1a365-e7a0-49ad-b05b-97f012daba24 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:13.235393 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1a365-e7a0-49ad-b05b-97f012daba24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:13.257387 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-ced1a365-e7a0-49ad-b05b-97f012daba24 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:13.258614 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ced1a365-e7a0-49ad-b05b-97f012daba24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:13.332880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1030/2040] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:13.343135 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64fddb-635a-47be-aa39-d71115cc7bcf admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:13.345925 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-8a64fddb-635a-47be-aa39-d71115cc7bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:13.436991 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64fddb-635a-47be-aa39-d71115cc7bcf admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:13.441626 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6afdf-292d-4c05-bb97-9c30eae17572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:13.442142 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6afdf-292d-4c05-bb97-9c30eae17572 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:13.442426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6afdf-292d-4c05-bb97-9c30eae17572 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:13.442695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6afdf-292d-4c05-bb97-9c30eae17572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:13.457523 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6afdf-292d-4c05-bb97-9c30eae17572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:13.459714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6afdf-292d-4c05-bb97-9c30eae17572 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:13.483155 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1011/2041] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:33:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:33:14.295133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20259c3f-ff80-45bd-a943-eb8edddafdd9 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:14.296740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20259c3f-ff80-45bd-a943-eb8edddafdd9 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:14.297190 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20259c3f-ff80-45bd-a943-eb8edddafdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:14.331469 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:14.342587 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-20259c3f-ff80-45bd-a943-eb8edddafdd9 None None] MFA Rules not processed for user `1162a7b971974650baa2c1bdea03dfc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:14.344846 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-20259c3f-ff80-45bd-a943-eb8edddafdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:14.473338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1031/2042] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:14.487093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6afdf-292d-4c05-bb97-9c30eae17572 service neutron] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:14.489152 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-e4b6afdf-292d-4c05-bb97-9c30eae17572 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:14.620120 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6afdf-292d-4c05-bb97-9c30eae17572 service neutron] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:14.625110 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc627a-9e4b-4506-879d-ef78dddfc174 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:14.625968 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc627a-9e4b-4506-879d-ef78dddfc174 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:14.626434 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc627a-9e4b-4506-879d-ef78dddfc174 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:14.626846 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc627a-9e4b-4506-879d-ef78dddfc174 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:14.642458 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc627a-9e4b-4506-879d-ef78dddfc174 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:14.645235 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc627a-9e4b-4506-879d-ef78dddfc174 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:14.659128 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1012/2043] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:33:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:33:16.131840 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdcbf5-e1fa-478c-80e4-e7ea81ea276f None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:16.132415 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdcbf5-e1fa-478c-80e4-e7ea81ea276f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:16.132415 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdcbf5-e1fa-478c-80e4-e7ea81ea276f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:16.157540 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-a4bdcbf5-e1fa-478c-80e4-e7ea81ea276f None None] MFA Rules not processed for user `1162a7b971974650baa2c1bdea03dfc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:16.158884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-a4bdcbf5-e1fa-478c-80e4-e7ea81ea276f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:16.184417 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1032/2044] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:17.230060 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc627a-9e4b-4506-879d-ef78dddfc174 service cinder] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:17.234613 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-77cc627a-9e4b-4506-879d-ef78dddfc174 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:17.263134 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc627a-9e4b-4506-879d-ef78dddfc174 service cinder] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:17.272457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a5859-cb77-4b6f-b295-3657fb439d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:17.273278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a5859-cb77-4b6f-b295-3657fb439d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:17.277977 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a5859-cb77-4b6f-b295-3657fb439d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:17.278340 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a5859-cb77-4b6f-b295-3657fb439d2f admin admin] PATH_INFO: `/v3/users/b1e09b4227984e9892e9206b999b86cc` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:17.280083 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a5859-cb77-4b6f-b295-3657fb439d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1e09b4227984e9892e9206b999b86cc)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:17.282119 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a5859-cb77-4b6f-b295-3657fb439d2f admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:17.387623 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:17.402232 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-850a5859-cb77-4b6f-b295-3657fb439d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1e09b4227984e9892e9206b999b86cc'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:17.404686 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-850a5859-cb77-4b6f-b295-3657fb439d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1e09b4227984e9892e9206b999b86cc'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:17.416215 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-850a5859-cb77-4b6f-b295-3657fb439d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1e09b4227984e9892e9206b999b86cc'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:17.417234 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-850a5859-cb77-4b6f-b295-3657fb439d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1e09b4227984e9892e9206b999b86cc'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:17.434410 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-850a5859-cb77-4b6f-b295-3657fb439d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1e09b4227984e9892e9206b999b86cc'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:17.460073 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1013/2045] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:33:17 2022] DELETE /identity/v3/users/b1e09b4227984e9892e9206b999b86cc => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:17.464516 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0631bfe-2af2-4dde-85c6-1ad84e2251cb None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:17.464993 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0631bfe-2af2-4dde-85c6-1ad84e2251cb None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:17.465068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0631bfe-2af2-4dde-85c6-1ad84e2251cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:17.514690 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-f0631bfe-2af2-4dde-85c6-1ad84e2251cb None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:17.519038 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-f0631bfe-2af2-4dde-85c6-1ad84e2251cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:17.642761 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1033/2046] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:17.660547 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a5859-cb77-4b6f-b295-3657fb439d2f admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:17.664516 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-850a5859-cb77-4b6f-b295-3657fb439d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:17.798594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a5859-cb77-4b6f-b295-3657fb439d2f admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:17.810707 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971feea3-bda2-4dd6-8058-527808cdbfc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:17.812319 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971feea3-bda2-4dd6-8058-527808cdbfc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:17.812751 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971feea3-bda2-4dd6-8058-527808cdbfc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:17.813209 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971feea3-bda2-4dd6-8058-527808cdbfc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:17.828479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971feea3-bda2-4dd6-8058-527808cdbfc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:17.830656 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971feea3-bda2-4dd6-8058-527808cdbfc5 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:17.845765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1014/2047] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:33:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:33:18.561591 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0631bfe-2af2-4dde-85c6-1ad84e2251cb None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:18.564746 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-f0631bfe-2af2-4dde-85c6-1ad84e2251cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:18.583481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0631bfe-2af2-4dde-85c6-1ad84e2251cb None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:18.600699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ec1b3-da7d-4ea0-b044-98140accb5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:18.601366 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ec1b3-da7d-4ea0-b044-98140accb5ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:18.601642 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ec1b3-da7d-4ea0-b044-98140accb5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:18.601922 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ec1b3-da7d-4ea0-b044-98140accb5ec admin admin] PATH_INFO: `/v3/projects/d509341ce6cd4305b91d3ad38f284c0a` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:18.603663 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ec1b3-da7d-4ea0-b044-98140accb5ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=d509341ce6cd4305b91d3ad38f284c0a)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:18.606033 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ec1b3-da7d-4ea0-b044-98140accb5ec admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:18.709218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-999ec1b3-da7d-4ea0-b044-98140accb5ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd509341ce6cd4305b91d3ad38f284c0a', 'request_id': 'req-999ec1b3-da7d-4ea0-b044-98140accb5ec'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:18.722035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-999ec1b3-da7d-4ea0-b044-98140accb5ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd509341ce6cd4305b91d3ad38f284c0a', 'request_id': 'req-999ec1b3-da7d-4ea0-b044-98140accb5ec'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:18.735718 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-999ec1b3-da7d-4ea0-b044-98140accb5ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd509341ce6cd4305b91d3ad38f284c0a', 'request_id': 'req-999ec1b3-da7d-4ea0-b044-98140accb5ec'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:18.772288 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-999ec1b3-da7d-4ea0-b044-98140accb5ec admin admin] The token cache is being invalidate because project d509341ce6cd4305b91d3ad38f284c0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:33:18.774510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-999ec1b3-da7d-4ea0-b044-98140accb5ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:18.777304 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-999ec1b3-da7d-4ea0-b044-98140accb5ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:18.782311 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1034/2048] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:33:18 2022] DELETE /identity/v3/projects/d509341ce6cd4305b91d3ad38f284c0a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:18.787151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971feea3-bda2-4dd6-8058-527808cdbfc5 service neutron] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:18.803130 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971feea3-bda2-4dd6-8058-527808cdbfc5 service neutron] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:18.975913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4d793-37eb-4074-8a43-773c26df2c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:18.977135 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4d793-37eb-4074-8a43-773c26df2c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:18.977741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4d793-37eb-4074-8a43-773c26df2c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:18.978494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4d793-37eb-4074-8a43-773c26df2c78 admin admin] PATH_INFO: `/v3/users/cb2741d10b2f480e98823329beef5c7d` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:18.982065 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4d793-37eb-4074-8a43-773c26df2c78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb2741d10b2f480e98823329beef5c7d)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:18.984270 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4d793-37eb-4074-8a43-773c26df2c78 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:19.167813 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ded4d793-37eb-4074-8a43-773c26df2c78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb2741d10b2f480e98823329beef5c7d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:19.168624 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ded4d793-37eb-4074-8a43-773c26df2c78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb2741d10b2f480e98823329beef5c7d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:19.214850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ded4d793-37eb-4074-8a43-773c26df2c78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb2741d10b2f480e98823329beef5c7d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:19.218264 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ded4d793-37eb-4074-8a43-773c26df2c78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb2741d10b2f480e98823329beef5c7d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:19.238631 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ded4d793-37eb-4074-8a43-773c26df2c78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb2741d10b2f480e98823329beef5c7d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:19.240763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:19.297390 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1015/2049] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:33:18 2022] DELETE /identity/v3/users/cb2741d10b2f480e98823329beef5c7d => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:19.345671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a5ab2-2bee-4700-b0c1-437438c3eb6c None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:19.346049 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a5ab2-2bee-4700-b0c1-437438c3eb6c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:19.346457 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a5ab2-2bee-4700-b0c1-437438c3eb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:19.390967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-790a5ab2-2bee-4700-b0c1-437438c3eb6c None None] MFA Rules not processed for user `66d63b0fb3514e7984e698afd21f2095`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:19.392684 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-790a5ab2-2bee-4700-b0c1-437438c3eb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:19.399660 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:19.488616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1035/2050] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:19.529158 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4d793-37eb-4074-8a43-773c26df2c78 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:19.531880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ded4d793-37eb-4074-8a43-773c26df2c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:19.659988 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4d793-37eb-4074-8a43-773c26df2c78 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:19.669539 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87059285-d70f-4ebd-83f8-5b8232147522 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:19.670391 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87059285-d70f-4ebd-83f8-5b8232147522 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:19.670666 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87059285-d70f-4ebd-83f8-5b8232147522 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:19.670955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87059285-d70f-4ebd-83f8-5b8232147522 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:19.684983 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87059285-d70f-4ebd-83f8-5b8232147522 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:19.686799 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87059285-d70f-4ebd-83f8-5b8232147522 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:19.697143 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1016/2051] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:33:19 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:33:19.829965 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a5ab2-2bee-4700-b0c1-437438c3eb6c None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:19.834324 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-790a5ab2-2bee-4700-b0c1-437438c3eb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:19.983363 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a5ab2-2bee-4700-b0c1-437438c3eb6c None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:19.988803 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c788c69-e383-4412-b70b-2575e31cc89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:19.989776 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c788c69-e383-4412-b70b-2575e31cc89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:19.990031 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c788c69-e383-4412-b70b-2575e31cc89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:19.991046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c788c69-e383-4412-b70b-2575e31cc89a admin admin] PATH_INFO: `/v3/projects/4ee941606005423b9ff5ea472f4e4f4e` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:19.991815 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c788c69-e383-4412-b70b-2575e31cc89a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee941606005423b9ff5ea472f4e4f4e)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:19.994152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c788c69-e383-4412-b70b-2575e31cc89a admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:20.080779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-0c788c69-e383-4412-b70b-2575e31cc89a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee941606005423b9ff5ea472f4e4f4e', 'request_id': 'req-0c788c69-e383-4412-b70b-2575e31cc89a'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:20.090046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-0c788c69-e383-4412-b70b-2575e31cc89a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee941606005423b9ff5ea472f4e4f4e', 'request_id': 'req-0c788c69-e383-4412-b70b-2575e31cc89a'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:20.116409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-0c788c69-e383-4412-b70b-2575e31cc89a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee941606005423b9ff5ea472f4e4f4e', 'request_id': 'req-0c788c69-e383-4412-b70b-2575e31cc89a'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:20.142622 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-0c788c69-e383-4412-b70b-2575e31cc89a admin admin] The token cache is being invalidate because project 4ee941606005423b9ff5ea472f4e4f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:33:20.145434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-0c788c69-e383-4412-b70b-2575e31cc89a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:20.147454 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-0c788c69-e383-4412-b70b-2575e31cc89a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:20.149978 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1036/2052] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:33:19 2022] DELETE /identity/v3/projects/4ee941606005423b9ff5ea472f4e4f4e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:20.156702 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f087f-c90f-48ea-be16-b69c3c6c4a76 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:20.157241 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f087f-c90f-48ea-be16-b69c3c6c4a76 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:20.157241 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f087f-c90f-48ea-be16-b69c3c6c4a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:20.195960 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-dc9f087f-c90f-48ea-be16-b69c3c6c4a76 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:20.197396 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-dc9f087f-c90f-48ea-be16-b69c3c6c4a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:20.333012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1017/2053] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:20.341544 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdd399-012a-4c68-aea8-51193ffc2824 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:20.342226 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdd399-012a-4c68-aea8-51193ffc2824 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:20.342718 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdd399-012a-4c68-aea8-51193ffc2824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:20.374246 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-21fdd399-012a-4c68-aea8-51193ffc2824 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:20.375524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-21fdd399-012a-4c68-aea8-51193ffc2824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:20.388585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1037/2054] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:20.389758 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f087f-c90f-48ea-be16-b69c3c6c4a76 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:20.404389 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f087f-c90f-48ea-be16-b69c3c6c4a76 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:20.412796 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a291c-0e44-4aed-b021-4ba664a868ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:20.413435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a291c-0e44-4aed-b021-4ba664a868ac admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:20.413713 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a291c-0e44-4aed-b021-4ba664a868ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:20.413980 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a291c-0e44-4aed-b021-4ba664a868ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:20.414642 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a291c-0e44-4aed-b021-4ba664a868ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:33:20.417846 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a291c-0e44-4aed-b021-4ba664a868ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:20.421197 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a291c-0e44-4aed-b021-4ba664a868ac admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:20.471323 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1018/2055] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:33:20.474960 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdd399-012a-4c68-aea8-51193ffc2824 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:20.486372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdd399-012a-4c68-aea8-51193ffc2824 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:20.491751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b37bd1-91e4-40c0-bf3c-7efef0f7e1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:20.492498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b37bd1-91e4-40c0-bf3c-7efef0f7e1ea admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:20.492851 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b37bd1-91e4-40c0-bf3c-7efef0f7e1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:20.493290 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b37bd1-91e4-40c0-bf3c-7efef0f7e1ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:20.505209 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b37bd1-91e4-40c0-bf3c-7efef0f7e1ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:20.507356 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b37bd1-91e4-40c0-bf3c-7efef0f7e1ea admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:20.582036 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a291c-0e44-4aed-b021-4ba664a868ac admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:20.588949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ca6a291c-0e44-4aed-b021-4ba664a868ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:20.617271 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a291c-0e44-4aed-b021-4ba664a868ac admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:20.626970 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1038/2056] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:33:20 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:33:20.629802 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c7db9-5744-4b0e-a1b5-e71e6cebb775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:20.630475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c7db9-5744-4b0e-a1b5-e71e6cebb775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:20.630754 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c7db9-5744-4b0e-a1b5-e71e6cebb775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:20.631316 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b37bd1-91e4-40c0-bf3c-7efef0f7e1ea admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:20.632701 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c7db9-5744-4b0e-a1b5-e71e6cebb775 admin admin] PATH_INFO: `/v3/users/bcade6ffae7748a190e32e9753b6bcc2` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:20.635736 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c7db9-5744-4b0e-a1b5-e71e6cebb775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcade6ffae7748a190e32e9753b6bcc2)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:20.641119 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c7db9-5744-4b0e-a1b5-e71e6cebb775 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:20.645467 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:20.737158 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-e17c7db9-5744-4b0e-a1b5-e71e6cebb775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcade6ffae7748a190e32e9753b6bcc2'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:20.738482 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-e17c7db9-5744-4b0e-a1b5-e71e6cebb775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcade6ffae7748a190e32e9753b6bcc2'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:20.740141 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:20.763869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-e17c7db9-5744-4b0e-a1b5-e71e6cebb775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcade6ffae7748a190e32e9753b6bcc2'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:20.764895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-e17c7db9-5744-4b0e-a1b5-e71e6cebb775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcade6ffae7748a190e32e9753b6bcc2'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:20.776426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b37bd1-91e4-40c0-bf3c-7efef0f7e1ea admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:20.790420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-e17c7db9-5744-4b0e-a1b5-e71e6cebb775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcade6ffae7748a190e32e9753b6bcc2'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:20.791313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e025c9-227c-4086-b1bc-593e658960e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:20.792063 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e025c9-227c-4086-b1bc-593e658960e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:20.792482 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e025c9-227c-4086-b1bc-593e658960e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:20.793159 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e025c9-227c-4086-b1bc-593e658960e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:20.793682 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e025c9-227c-4086-b1bc-593e658960e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:20.798676 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e025c9-227c-4086-b1bc-593e658960e7 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:20.821751 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1019/2057] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:33:20 2022] DELETE /identity/v3/users/bcade6ffae7748a190e32e9753b6bcc2 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:20.824289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcbfd2-d6a0-4f53-b986-010c9b7b9d25 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:20.824633 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcbfd2-d6a0-4f53-b986-010c9b7b9d25 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:20.824916 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcbfd2-d6a0-4f53-b986-010c9b7b9d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:20.854190 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1039/2058] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:33:20 2022] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:33:20.855257 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e025c9-227c-4086-b1bc-593e658960e7 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:20.858084 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-96e025c9-227c-4086-b1bc-593e658960e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:20.880980 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-53bcbfd2-d6a0-4f53-b986-010c9b7b9d25 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:20.882593 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-53bcbfd2-d6a0-4f53-b986-010c9b7b9d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:20.885158 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e025c9-227c-4086-b1bc-593e658960e7 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:20.995912 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1020/2059] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:21.002008 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e54df-2dde-4efc-9c23-7cabf99949cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:21.002911 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e54df-2dde-4efc-9c23-7cabf99949cf admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:21.003356 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e54df-2dde-4efc-9c23-7cabf99949cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:21.003952 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e54df-2dde-4efc-9c23-7cabf99949cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:21.004799 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e54df-2dde-4efc-9c23-7cabf99949cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:21.007226 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e54df-2dde-4efc-9c23-7cabf99949cf admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:21.026254 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1040/2060] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:33:21.030547 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcbfd2-d6a0-4f53-b986-010c9b7b9d25 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:21.033326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e54df-2dde-4efc-9c23-7cabf99949cf admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:21.035669 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b20e54df-2dde-4efc-9c23-7cabf99949cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:21.043110 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcbfd2-d6a0-4f53-b986-010c9b7b9d25 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:21.049271 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed39bca-24a2-4ff7-83c5-599d5d94e6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:21.050256 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed39bca-24a2-4ff7-83c5-599d5d94e6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:21.050688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed39bca-24a2-4ff7-83c5-599d5d94e6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:21.050957 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed39bca-24a2-4ff7-83c5-599d5d94e6b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:21.051651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed39bca-24a2-4ff7-83c5-599d5d94e6b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:21.053277 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed39bca-24a2-4ff7-83c5-599d5d94e6b5 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:21.075066 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1021/2061] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:33:21.078563 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed39bca-24a2-4ff7-83c5-599d5d94e6b5 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:21.092409 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed39bca-24a2-4ff7-83c5-599d5d94e6b5 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:21.099546 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45582f94-5fd6-40e0-8975-e6e6d924ebf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:21.100249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45582f94-5fd6-40e0-8975-e6e6d924ebf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:21.100525 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45582f94-5fd6-40e0-8975-e6e6d924ebf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:21.100895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45582f94-5fd6-40e0-8975-e6e6d924ebf5 admin admin] PATH_INFO: `/v3/projects/78c5beaf837e46b3abcb0b89ba84ea63/users/25adb7481d2e4426b830e7b37724c67c/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:21.121794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45582f94-5fd6-40e0-8975-e6e6d924ebf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c5beaf837e46b3abcb0b89ba84ea63, user_id=25adb7481d2e4426b830e7b37724c67c, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:21.125916 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45582f94-5fd6-40e0-8975-e6e6d924ebf5 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:21.136076 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e54df-2dde-4efc-9c23-7cabf99949cf admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:21.144170 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1022/2062] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:33:21 2022] PUT /identity/v3/projects/78c5beaf837e46b3abcb0b89ba84ea63/users/25adb7481d2e4426b830e7b37724c67c/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:21.156703 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94ca1d-c93d-4dde-b347-5afa76b32cc5 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:21.157361 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94ca1d-c93d-4dde-b347-5afa76b32cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:21.157651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94ca1d-c93d-4dde-b347-5afa76b32cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:21.191416 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-8e94ca1d-c93d-4dde-b347-5afa76b32cc5 None None] MFA Rules not processed for user `25adb7481d2e4426b830e7b37724c67c`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:21.193009 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-8e94ca1d-c93d-4dde-b347-5afa76b32cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:21.225827 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28121ab-1e49-4464-a145-0190259b7cb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:21.226454 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28121ab-1e49-4464-a145-0190259b7cb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:21.227534 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28121ab-1e49-4464-a145-0190259b7cb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:21.227966 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28121ab-1e49-4464-a145-0190259b7cb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:21.232987 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:21.292272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1023/2063] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:33:21.307080 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94ca1d-c93d-4dde-b347-5afa76b32cc5 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:21.309443 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-8e94ca1d-c93d-4dde-b347-5afa76b32cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:21.328848 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28121ab-1e49-4464-a145-0190259b7cb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:21.330158 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28121ab-1e49-4464-a145-0190259b7cb7 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:21.338182 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:21.341592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1041/2064] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:33:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:33:21.378878 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94ca1d-c93d-4dde-b347-5afa76b32cc5 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:21.382751 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199ca6b-63ca-41d4-adf4-49514c978263 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74b3e45a14bd4b539974e9e5e278ee62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:21.383420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199ca6b-63ca-41d4-adf4-49514c978263 service glance] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:21.383760 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199ca6b-63ca-41d4-adf4-49514c978263 service glance] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:21.384035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199ca6b-63ca-41d4-adf4-49514c978263 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:21.393433 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199ca6b-63ca-41d4-adf4-49514c978263 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:21.395268 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199ca6b-63ca-41d4-adf4-49514c978263 service glance] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:21.407775 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1024/2065] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:33:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:33:22.355107 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28121ab-1e49-4464-a145-0190259b7cb7 service neutron] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:22.357177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-d28121ab-1e49-4464-a145-0190259b7cb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:22.376978 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28121ab-1e49-4464-a145-0190259b7cb7 service neutron] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:22.392777 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f1000-7c58-45c1-b27b-a098985e3aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:22.393479 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f1000-7c58-45c1-b27b-a098985e3aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:22.393758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f1000-7c58-45c1-b27b-a098985e3aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:22.394016 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f1000-7c58-45c1-b27b-a098985e3aae admin admin] PATH_INFO: `/v3/projects/bdc370a54f5e4a679a868018fddbd525` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:22.396445 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f1000-7c58-45c1-b27b-a098985e3aae admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdc370a54f5e4a679a868018fddbd525)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:22.398519 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f1000-7c58-45c1-b27b-a098985e3aae admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:22.503666 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-165f1000-7c58-45c1-b27b-a098985e3aae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdc370a54f5e4a679a868018fddbd525', 'request_id': 'req-165f1000-7c58-45c1-b27b-a098985e3aae'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:22.520811 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-165f1000-7c58-45c1-b27b-a098985e3aae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdc370a54f5e4a679a868018fddbd525', 'request_id': 'req-165f1000-7c58-45c1-b27b-a098985e3aae'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:22.534244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-165f1000-7c58-45c1-b27b-a098985e3aae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdc370a54f5e4a679a868018fddbd525', 'request_id': 'req-165f1000-7c58-45c1-b27b-a098985e3aae'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:22.546054 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475dc61-e6d6-406f-8e6b-9284d13fca5f None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:22.546949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475dc61-e6d6-406f-8e6b-9284d13fca5f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:22.547498 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475dc61-e6d6-406f-8e6b-9284d13fca5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:22.581048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-2475dc61-e6d6-406f-8e6b-9284d13fca5f None None] MFA Rules not processed for user `66d63b0fb3514e7984e698afd21f2095`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:22.582824 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-165f1000-7c58-45c1-b27b-a098985e3aae admin admin] The token cache is being invalidate because project bdc370a54f5e4a679a868018fddbd525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:33:22.582824 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-165f1000-7c58-45c1-b27b-a098985e3aae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:22.584201 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-165f1000-7c58-45c1-b27b-a098985e3aae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:22.588723 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-2475dc61-e6d6-406f-8e6b-9284d13fca5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:22.590000 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1042/2066] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:33:22 2022] DELETE /identity/v3/projects/bdc370a54f5e4a679a868018fddbd525 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:22.592743 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee0341-cef0-4965-a38f-d962c276cb99 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:22.594793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee0341-cef0-4965-a38f-d962c276cb99 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:22.594793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee0341-cef0-4965-a38f-d962c276cb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:22.622504 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-b0ee0341-cef0-4965-a38f-d962c276cb99 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:22.624493 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b0ee0341-cef0-4965-a38f-d962c276cb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:22.701615 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1025/2067] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:33:22.705812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1043/2068] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:22.713704 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181fc98-724f-4654-9937-a89d16628b06 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:22.717142 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181fc98-724f-4654-9937-a89d16628b06 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:22.717142 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181fc98-724f-4654-9937-a89d16628b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:22.749051 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-5181fc98-724f-4654-9937-a89d16628b06 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:22.750288 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-5181fc98-724f-4654-9937-a89d16628b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:22.763626 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1026/2069] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:22.768140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee0341-cef0-4965-a38f-d962c276cb99 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:22.780941 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee0341-cef0-4965-a38f-d962c276cb99 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:22.787224 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8cac1-7834-45b7-953c-d1e46ba9887e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:22.788159 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8cac1-7834-45b7-953c-d1e46ba9887e admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:22.788441 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8cac1-7834-45b7-953c-d1e46ba9887e admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:22.788713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8cac1-7834-45b7-953c-d1e46ba9887e admin admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:22.789381 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8cac1-7834-45b7-953c-d1e46ba9887e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:33:22.789677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8cac1-7834-45b7-953c-d1e46ba9887e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:22.791407 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8cac1-7834-45b7-953c-d1e46ba9887e admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:22.811463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181fc98-724f-4654-9937-a89d16628b06 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:22.817311 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1044/2070] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:33:22.823508 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181fc98-724f-4654-9937-a89d16628b06 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:22.830915 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8abf37-e49c-49a9-9a86-e2a2bf045442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:22.832678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8abf37-e49c-49a9-9a86-e2a2bf045442 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:22.833028 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8abf37-e49c-49a9-9a86-e2a2bf045442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:22.833373 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8abf37-e49c-49a9-9a86-e2a2bf045442 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:22.834144 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8abf37-e49c-49a9-9a86-e2a2bf045442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:22.836871 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8abf37-e49c-49a9-9a86-e2a2bf045442 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:22.883347 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1027/2071] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:33:22 2022] POST /identity/v3/projects => generated 367 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:33:22.887521 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8cac1-7834-45b7-953c-d1e46ba9887e admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:22.899964 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8cac1-7834-45b7-953c-d1e46ba9887e admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:22.917233 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:22.996062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17940328-5d86-4815-91e4-6e9abc53b5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:22.996691 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17940328-5d86-4815-91e4-6e9abc53b5d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:22.996969 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17940328-5d86-4815-91e4-6e9abc53b5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:22.997778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17940328-5d86-4815-91e4-6e9abc53b5d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:22.998152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17940328-5d86-4815-91e4-6e9abc53b5d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:23.001832 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17940328-5d86-4815-91e4-6e9abc53b5d0 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:23.055186 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1045/2072] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:33:22 2022] POST /identity/v3/users => generated 284 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:33:23.056442 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8abf37-e49c-49a9-9a86-e2a2bf045442 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:23.075188 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8abf37-e49c-49a9-9a86-e2a2bf045442 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:23.081775 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59db11-9375-47b3-a0c5-2352e27a7ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:23.082818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59db11-9375-47b3-a0c5-2352e27a7ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:23.083414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59db11-9375-47b3-a0c5-2352e27a7ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:23.084618 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59db11-9375-47b3-a0c5-2352e27a7ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:23.085438 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59db11-9375-47b3-a0c5-2352e27a7ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:23.087377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59db11-9375-47b3-a0c5-2352e27a7ad0 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:23.116214 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1028/2073] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:33:23.116550 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17940328-5d86-4815-91e4-6e9abc53b5d0 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:23.139816 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17940328-5d86-4815-91e4-6e9abc53b5d0 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:23.146626 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec589195-a472-41f9-ab83-7ec99d78f9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:23.147294 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec589195-a472-41f9-ab83-7ec99d78f9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:23.147574 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec589195-a472-41f9-ab83-7ec99d78f9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:23.147848 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec589195-a472-41f9-ab83-7ec99d78f9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:23.149059 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec589195-a472-41f9-ab83-7ec99d78f9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:23.151219 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec589195-a472-41f9-ab83-7ec99d78f9f7 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:23.174064 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1046/2074] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:33:23.175084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59db11-9375-47b3-a0c5-2352e27a7ad0 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:23.192639 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59db11-9375-47b3-a0c5-2352e27a7ad0 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:23.202155 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc23787-0174-411e-ab55-c91b1b72f95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:23.203554 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc23787-0174-411e-ab55-c91b1b72f95e admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:23.204110 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc23787-0174-411e-ab55-c91b1b72f95e admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:23.204557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc23787-0174-411e-ab55-c91b1b72f95e admin admin] PATH_INFO: `/v3/projects/1561a7923d8244afab6d73e96f0f7339/users/c96a4b6c250646c1adec98c7d98026c1/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:23.222562 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc23787-0174-411e-ab55-c91b1b72f95e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1561a7923d8244afab6d73e96f0f7339, user_id=c96a4b6c250646c1adec98c7d98026c1, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:23.225744 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc23787-0174-411e-ab55-c91b1b72f95e admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:23.250410 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1029/2075] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:33:23 2022] PUT /identity/v3/projects/1561a7923d8244afab6d73e96f0f7339/users/c96a4b6c250646c1adec98c7d98026c1/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:33:23.260680 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370e8e8-fcb5-4d7b-a2ed-703f65eeebfc None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:23.261486 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370e8e8-fcb5-4d7b-a2ed-703f65eeebfc None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:23.261970 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370e8e8-fcb5-4d7b-a2ed-703f65eeebfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:23.326766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-f370e8e8-fcb5-4d7b-a2ed-703f65eeebfc None None] MFA Rules not processed for user `c96a4b6c250646c1adec98c7d98026c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:23.328295 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-f370e8e8-fcb5-4d7b-a2ed-703f65eeebfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:23.457182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1047/2076] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:23.479048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc23787-0174-411e-ab55-c91b1b72f95e admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:23.481340 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-9fc23787-0174-411e-ab55-c91b1b72f95e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:23.585107 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc23787-0174-411e-ab55-c91b1b72f95e admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:23.589585 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ad883-9bee-440f-85fb-77716541eac3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74b3e45a14bd4b539974e9e5e278ee62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:23.590209 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ad883-9bee-440f-85fb-77716541eac3 service glance] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:23.591360 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ad883-9bee-440f-85fb-77716541eac3 service glance] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:23.591474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ad883-9bee-440f-85fb-77716541eac3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:23.612782 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ad883-9bee-440f-85fb-77716541eac3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:23.614442 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ad883-9bee-440f-85fb-77716541eac3 service glance] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:23.638313 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1030/2077] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:33:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:33:26.255922 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc6143-3425-4824-b8b4-ba79e782f080 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:26.256496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc6143-3425-4824-b8b4-ba79e782f080 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:26.256496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc6143-3425-4824-b8b4-ba79e782f080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:26.277961 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-c9bc6143-3425-4824-b8b4-ba79e782f080 None None] MFA Rules not processed for user `fd7782e68436445395dd49bf7d8302e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:26.279230 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-c9bc6143-3425-4824-b8b4-ba79e782f080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:26.359211 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1048/2078] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:33.032119 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ad883-9bee-440f-85fb-77716541eac3 service glance] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:33.033836 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-387ad883-9bee-440f-85fb-77716541eac3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:33.049323 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:33.107853 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ad883-9bee-440f-85fb-77716541eac3 service glance] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:33.112506 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70832880-f119-40c1-9bd7-d96019c75401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:33.113140 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70832880-f119-40c1-9bd7-d96019c75401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:33.113412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70832880-f119-40c1-9bd7-d96019c75401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:33.113679 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70832880-f119-40c1-9bd7-d96019c75401 admin admin] PATH_INFO: `/v3/users/f9229da833ad4621866c5ee98c24c8f8` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:33.114833 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70832880-f119-40c1-9bd7-d96019c75401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9229da833ad4621866c5ee98c24c8f8)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:33.116762 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70832880-f119-40c1-9bd7-d96019c75401 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:33.170177 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-70832880-f119-40c1-9bd7-d96019c75401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9229da833ad4621866c5ee98c24c8f8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:33.170953 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-70832880-f119-40c1-9bd7-d96019c75401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9229da833ad4621866c5ee98c24c8f8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:33.178763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-70832880-f119-40c1-9bd7-d96019c75401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9229da833ad4621866c5ee98c24c8f8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:33.179500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-70832880-f119-40c1-9bd7-d96019c75401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9229da833ad4621866c5ee98c24c8f8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:33.188741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-70832880-f119-40c1-9bd7-d96019c75401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9229da833ad4621866c5ee98c24c8f8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:33.208273 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1031/2079] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:33:33 2022] DELETE /identity/v3/users/f9229da833ad4621866c5ee98c24c8f8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:33.393218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc6143-3425-4824-b8b4-ba79e782f080 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:33.411582 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc6143-3425-4824-b8b4-ba79e782f080 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:33.449380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:33.487828 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ed931-351e-42cd-8495-9124446eb909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:33.488391 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ed931-351e-42cd-8495-9124446eb909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:33.488673 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ed931-351e-42cd-8495-9124446eb909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:33.488943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ed931-351e-42cd-8495-9124446eb909 admin admin] PATH_INFO: `/v3/projects/70b9de8d8b5647f4bf2ff65849fce857` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:33.490110 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ed931-351e-42cd-8495-9124446eb909 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70b9de8d8b5647f4bf2ff65849fce857)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:33.492061 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ed931-351e-42cd-8495-9124446eb909 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:33.545092 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-042ed931-351e-42cd-8495-9124446eb909 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70b9de8d8b5647f4bf2ff65849fce857', 'request_id': 'req-042ed931-351e-42cd-8495-9124446eb909'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:33.553550 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-042ed931-351e-42cd-8495-9124446eb909 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70b9de8d8b5647f4bf2ff65849fce857', 'request_id': 'req-042ed931-351e-42cd-8495-9124446eb909'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:33.560177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-042ed931-351e-42cd-8495-9124446eb909 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70b9de8d8b5647f4bf2ff65849fce857', 'request_id': 'req-042ed931-351e-42cd-8495-9124446eb909'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:33.570957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-042ed931-351e-42cd-8495-9124446eb909 admin admin] The token cache is being invalidate because project 70b9de8d8b5647f4bf2ff65849fce857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:33:33.571408 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-042ed931-351e-42cd-8495-9124446eb909 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:33.572071 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-042ed931-351e-42cd-8495-9124446eb909 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:33.573584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1049/2080] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:33:33 2022] DELETE /identity/v3/projects/70b9de8d8b5647f4bf2ff65849fce857 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:33.577943 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70832880-f119-40c1-9bd7-d96019c75401 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:33.579503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-70832880-f119-40c1-9bd7-d96019c75401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:33.593229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70832880-f119-40c1-9bd7-d96019c75401 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:33.655234 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76aeb20-fb70-48b7-a26b-8b008970c6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:33.655887 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76aeb20-fb70-48b7-a26b-8b008970c6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:33.656165 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76aeb20-fb70-48b7-a26b-8b008970c6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:33.656436 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76aeb20-fb70-48b7-a26b-8b008970c6df admin admin] PATH_INFO: `/v3/users/b91f9343e5c54a9892203d16c52a4f40` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:33.657634 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76aeb20-fb70-48b7-a26b-8b008970c6df admin admin] RBAC: Authorizing `identity:delete_user(user_id=b91f9343e5c54a9892203d16c52a4f40)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:33.659671 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76aeb20-fb70-48b7-a26b-8b008970c6df admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:33.692248 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:33.714372 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b76aeb20-fb70-48b7-a26b-8b008970c6df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b91f9343e5c54a9892203d16c52a4f40'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:33.715097 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b76aeb20-fb70-48b7-a26b-8b008970c6df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b91f9343e5c54a9892203d16c52a4f40'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:33.722649 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b76aeb20-fb70-48b7-a26b-8b008970c6df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b91f9343e5c54a9892203d16c52a4f40'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:33.723288 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b76aeb20-fb70-48b7-a26b-8b008970c6df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b91f9343e5c54a9892203d16c52a4f40'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:33.734538 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b76aeb20-fb70-48b7-a26b-8b008970c6df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b91f9343e5c54a9892203d16c52a4f40'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:33.755544 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1032/2081] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:33:33 2022] DELETE /identity/v3/users/b91f9343e5c54a9892203d16c52a4f40 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:33.947382 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ed931-351e-42cd-8495-9124446eb909 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:33.949100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-042ed931-351e-42cd-8495-9124446eb909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:33.963040 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ed931-351e-42cd-8495-9124446eb909 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:34.028580 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c724a6-a802-4ef4-9cd7-5c3dfb22b033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:34.029357 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c724a6-a802-4ef4-9cd7-5c3dfb22b033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:34.029648 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c724a6-a802-4ef4-9cd7-5c3dfb22b033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:34.030204 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c724a6-a802-4ef4-9cd7-5c3dfb22b033 admin admin] PATH_INFO: `/v3/projects/cdf37ae4b6854e93a79c8d1dfce8a9a6` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:34.031533 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c724a6-a802-4ef4-9cd7-5c3dfb22b033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdf37ae4b6854e93a79c8d1dfce8a9a6)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:34.034147 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c724a6-a802-4ef4-9cd7-5c3dfb22b033 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:34.086660 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-12c724a6-a802-4ef4-9cd7-5c3dfb22b033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdf37ae4b6854e93a79c8d1dfce8a9a6', 'request_id': 'req-12c724a6-a802-4ef4-9cd7-5c3dfb22b033'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:34.097850 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-12c724a6-a802-4ef4-9cd7-5c3dfb22b033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdf37ae4b6854e93a79c8d1dfce8a9a6', 'request_id': 'req-12c724a6-a802-4ef4-9cd7-5c3dfb22b033'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:34.099568 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:34.111031 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-12c724a6-a802-4ef4-9cd7-5c3dfb22b033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdf37ae4b6854e93a79c8d1dfce8a9a6', 'request_id': 'req-12c724a6-a802-4ef4-9cd7-5c3dfb22b033'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:34.123128 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-12c724a6-a802-4ef4-9cd7-5c3dfb22b033 admin admin] The token cache is being invalidate because project cdf37ae4b6854e93a79c8d1dfce8a9a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:33:34.123420 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-12c724a6-a802-4ef4-9cd7-5c3dfb22b033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:34.124251 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-12c724a6-a802-4ef4-9cd7-5c3dfb22b033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:34.125880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1050/2082] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:33:33 2022] DELETE /identity/v3/projects/cdf37ae4b6854e93a79c8d1dfce8a9a6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:34.132683 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151b566-cb9b-4f76-b57a-d3b272548b70 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:34.133197 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151b566-cb9b-4f76-b57a-d3b272548b70 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:34.133335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151b566-cb9b-4f76-b57a-d3b272548b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:34.154582 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-5151b566-cb9b-4f76-b57a-d3b272548b70 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:34.155850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-5151b566-cb9b-4f76-b57a-d3b272548b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:34.220511 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1033/2083] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:34.228864 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce37a6-014e-44e4-b44e-0f845d1191ef None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:34.229148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce37a6-014e-44e4-b44e-0f845d1191ef None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:34.229411 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce37a6-014e-44e4-b44e-0f845d1191ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:34.250833 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-efce37a6-014e-44e4-b44e-0f845d1191ef None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:34.252099 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-efce37a6-014e-44e4-b44e-0f845d1191ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:34.260790 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1051/2084] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:34.265025 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151b566-cb9b-4f76-b57a-d3b272548b70 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:34.275994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151b566-cb9b-4f76-b57a-d3b272548b70 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:34.281400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d018c122-cb2c-4159-8787-395cb24b8062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:34.282015 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018c122-cb2c-4159-8787-395cb24b8062 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:34.282290 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018c122-cb2c-4159-8787-395cb24b8062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:34.282559 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018c122-cb2c-4159-8787-395cb24b8062 admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:34.283249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d018c122-cb2c-4159-8787-395cb24b8062 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:33:34.283550 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d018c122-cb2c-4159-8787-395cb24b8062 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:34.285185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d018c122-cb2c-4159-8787-395cb24b8062 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:34.297446 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1034/2085] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:33:34.302140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce37a6-014e-44e4-b44e-0f845d1191ef None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:34.312719 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce37a6-014e-44e4-b44e-0f845d1191ef None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:34.317745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339992ac-199d-4938-8024-1dd6a66ce4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:34.318363 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339992ac-199d-4938-8024-1dd6a66ce4e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:34.318684 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339992ac-199d-4938-8024-1dd6a66ce4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:34.318958 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339992ac-199d-4938-8024-1dd6a66ce4e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:34.319631 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339992ac-199d-4938-8024-1dd6a66ce4e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:34.321593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339992ac-199d-4938-8024-1dd6a66ce4e5 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:34.350994 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1052/2086] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:33:34 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:33:34.357086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d018c122-cb2c-4159-8787-395cb24b8062 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:34.368186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d018c122-cb2c-4159-8787-395cb24b8062 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:34.438187 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0762b2-5793-4ad2-812d-efebbb1bd3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:34.438828 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0762b2-5793-4ad2-812d-efebbb1bd3fd admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:34.439164 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0762b2-5793-4ad2-812d-efebbb1bd3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:34.439431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0762b2-5793-4ad2-812d-efebbb1bd3fd admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:34.440084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0762b2-5793-4ad2-812d-efebbb1bd3fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:34.442060 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0762b2-5793-4ad2-812d-efebbb1bd3fd admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:34.466656 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1035/2087] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:33:34 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:33:34.471528 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339992ac-199d-4938-8024-1dd6a66ce4e5 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:34.484696 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339992ac-199d-4938-8024-1dd6a66ce4e5 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:34.490543 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636fa76-c158-490c-8d06-267c2d4d22ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:34.491249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636fa76-c158-490c-8d06-267c2d4d22ed admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:34.491559 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636fa76-c158-490c-8d06-267c2d4d22ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:34.491824 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636fa76-c158-490c-8d06-267c2d4d22ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:34.492471 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636fa76-c158-490c-8d06-267c2d4d22ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:34.494424 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636fa76-c158-490c-8d06-267c2d4d22ed admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:34.505722 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1053/2088] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:33:34.510199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0762b2-5793-4ad2-812d-efebbb1bd3fd admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:34.521036 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0762b2-5793-4ad2-812d-efebbb1bd3fd admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:34.531632 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f20a57-6b9f-4a1c-a611-748a5c6fea13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:34.532275 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f20a57-6b9f-4a1c-a611-748a5c6fea13 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:34.532567 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f20a57-6b9f-4a1c-a611-748a5c6fea13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:34.533050 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f20a57-6b9f-4a1c-a611-748a5c6fea13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:34.533729 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f20a57-6b9f-4a1c-a611-748a5c6fea13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:34.535417 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f20a57-6b9f-4a1c-a611-748a5c6fea13 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:34.550940 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1036/2089] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:33:34.556255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636fa76-c158-490c-8d06-267c2d4d22ed admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:34.567009 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636fa76-c158-490c-8d06-267c2d4d22ed admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:34.574615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f48c33-67b3-4618-b197-1420b58b6670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:34.575308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f48c33-67b3-4618-b197-1420b58b6670 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:34.575587 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f48c33-67b3-4618-b197-1420b58b6670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:34.575855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f48c33-67b3-4618-b197-1420b58b6670 admin admin] PATH_INFO: `/v3/projects/9056b682cda1431c85ab26181e3f8e29/users/98183176743d4e21acd0d2330c6dbe7e/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:34.594384 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f48c33-67b3-4618-b197-1420b58b6670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9056b682cda1431c85ab26181e3f8e29, user_id=98183176743d4e21acd0d2330c6dbe7e, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:34.597594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f48c33-67b3-4618-b197-1420b58b6670 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:34.613268 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1054/2090] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:33:34 2022] PUT /identity/v3/projects/9056b682cda1431c85ab26181e3f8e29/users/98183176743d4e21acd0d2330c6dbe7e/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:34.624288 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef83b40-1293-4a9c-a489-fdf29422dcae None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:34.624576 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef83b40-1293-4a9c-a489-fdf29422dcae None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:34.624849 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef83b40-1293-4a9c-a489-fdf29422dcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:34.647093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:34.658373 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-3ef83b40-1293-4a9c-a489-fdf29422dcae None None] MFA Rules not processed for user `98183176743d4e21acd0d2330c6dbe7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:34.660711 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-3ef83b40-1293-4a9c-a489-fdf29422dcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:34.736995 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1037/2091] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:34.749080 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f48c33-67b3-4618-b197-1420b58b6670 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:34.751277 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-68f48c33-67b3-4618-b197-1420b58b6670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:34.816258 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f48c33-67b3-4618-b197-1420b58b6670 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:34.820581 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88230bbf-ab0e-45eb-86b9-8f398faa0465 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:34.821267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88230bbf-ab0e-45eb-86b9-8f398faa0465 service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:34.821543 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88230bbf-ab0e-45eb-86b9-8f398faa0465 service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:34.821782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88230bbf-ab0e-45eb-86b9-8f398faa0465 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:34.833805 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88230bbf-ab0e-45eb-86b9-8f398faa0465 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:34.837871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88230bbf-ab0e-45eb-86b9-8f398faa0465 service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:34.851202 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1055/2092] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:33:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:33:34.879091 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef83b40-1293-4a9c-a489-fdf29422dcae None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:34.958824 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef83b40-1293-4a9c-a489-fdf29422dcae None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:34.964248 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5157b-9601-412c-a40f-13c71d159fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:34.964899 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5157b-9601-412c-a40f-13c71d159fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:34.965154 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5157b-9601-412c-a40f-13c71d159fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:34.965447 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5157b-9601-412c-a40f-13c71d159fc3 admin admin] PATH_INFO: `/v3/users/98183176743d4e21acd0d2330c6dbe7e` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:34.966753 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5157b-9601-412c-a40f-13c71d159fc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98183176743d4e21acd0d2330c6dbe7e)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:34.968741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5157b-9601-412c-a40f-13c71d159fc3 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:35.021929 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-dec5157b-9601-412c-a40f-13c71d159fc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98183176743d4e21acd0d2330c6dbe7e'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:35.022673 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-dec5157b-9601-412c-a40f-13c71d159fc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98183176743d4e21acd0d2330c6dbe7e'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:35.031078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-dec5157b-9601-412c-a40f-13c71d159fc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98183176743d4e21acd0d2330c6dbe7e'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:35.031962 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-dec5157b-9601-412c-a40f-13c71d159fc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98183176743d4e21acd0d2330c6dbe7e'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:35.041337 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-dec5157b-9601-412c-a40f-13c71d159fc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98183176743d4e21acd0d2330c6dbe7e'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:35.059338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1038/2093] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:33:34 2022] DELETE /identity/v3/users/98183176743d4e21acd0d2330c6dbe7e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:35.063927 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c0fca-2ca4-413b-96eb-ee2f05d34731 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:35.064182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c0fca-2ca4-413b-96eb-ee2f05d34731 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:35.064462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c0fca-2ca4-413b-96eb-ee2f05d34731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:35.084966 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-908c0fca-2ca4-413b-96eb-ee2f05d34731 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:35.086153 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-908c0fca-2ca4-413b-96eb-ee2f05d34731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:35.162413 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1056/2094] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:33:35.172978 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5157b-9601-412c-a40f-13c71d159fc3 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:35.174867 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-dec5157b-9601-412c-a40f-13c71d159fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:35.197044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:35.236468 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5157b-9601-412c-a40f-13c71d159fc3 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:35.240297 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef8c66-1539-44aa-a995-c996dcd8c5f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:35.240798 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef8c66-1539-44aa-a995-c996dcd8c5f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:35.241091 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef8c66-1539-44aa-a995-c996dcd8c5f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:35.241339 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef8c66-1539-44aa-a995-c996dcd8c5f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:35.251679 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef8c66-1539-44aa-a995-c996dcd8c5f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:35.253118 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef8c66-1539-44aa-a995-c996dcd8c5f6 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:35.262806 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1039/2095] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:33:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:33:35.544249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c0fca-2ca4-413b-96eb-ee2f05d34731 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:35.545746 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-908c0fca-2ca4-413b-96eb-ee2f05d34731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:35.567503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c0fca-2ca4-413b-96eb-ee2f05d34731 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:35.572891 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe7f37-9b7b-46e1-ba99-6f71fe428b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:35.573500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe7f37-9b7b-46e1-ba99-6f71fe428b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:35.573765 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe7f37-9b7b-46e1-ba99-6f71fe428b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:35.574026 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe7f37-9b7b-46e1-ba99-6f71fe428b13 admin admin] PATH_INFO: `/v3/projects/9056b682cda1431c85ab26181e3f8e29` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:35.575248 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe7f37-9b7b-46e1-ba99-6f71fe428b13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9056b682cda1431c85ab26181e3f8e29)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:35.577204 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe7f37-9b7b-46e1-ba99-6f71fe428b13 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:35.600812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:35.627591 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-32fe7f37-9b7b-46e1-ba99-6f71fe428b13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9056b682cda1431c85ab26181e3f8e29', 'request_id': 'req-32fe7f37-9b7b-46e1-ba99-6f71fe428b13'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:35.635561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-32fe7f37-9b7b-46e1-ba99-6f71fe428b13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9056b682cda1431c85ab26181e3f8e29', 'request_id': 'req-32fe7f37-9b7b-46e1-ba99-6f71fe428b13'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:35.643693 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-32fe7f37-9b7b-46e1-ba99-6f71fe428b13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9056b682cda1431c85ab26181e3f8e29', 'request_id': 'req-32fe7f37-9b7b-46e1-ba99-6f71fe428b13'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:35.658699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-32fe7f37-9b7b-46e1-ba99-6f71fe428b13 admin admin] The token cache is being invalidate because project 9056b682cda1431c85ab26181e3f8e29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:33:35.658969 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-32fe7f37-9b7b-46e1-ba99-6f71fe428b13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:35.659657 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-32fe7f37-9b7b-46e1-ba99-6f71fe428b13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:35.661187 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1057/2096] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:33:35 2022] DELETE /identity/v3/projects/9056b682cda1431c85ab26181e3f8e29 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:35.667181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d240ebf-4e2e-42ec-8b34-422115177079 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:35.667562 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d240ebf-4e2e-42ec-8b34-422115177079 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:35.667905 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d240ebf-4e2e-42ec-8b34-422115177079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:35.690023 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-0d240ebf-4e2e-42ec-8b34-422115177079 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:35.691303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-0d240ebf-4e2e-42ec-8b34-422115177079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:35.754091 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1040/2097] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:33:35.763805 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb43f93-abab-43c5-a417-cf6821743128 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:35.764084 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb43f93-abab-43c5-a417-cf6821743128 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:35.764351 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb43f93-abab-43c5-a417-cf6821743128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:35.788378 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-ffb43f93-abab-43c5-a417-cf6821743128 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:35.789736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ffb43f93-abab-43c5-a417-cf6821743128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:35.797782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1058/2098] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:35.802452 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d240ebf-4e2e-42ec-8b34-422115177079 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:35.812487 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d240ebf-4e2e-42ec-8b34-422115177079 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:35.817324 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce0da7-8686-4bcf-a4cd-624c185d7e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:35.817927 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce0da7-8686-4bcf-a4cd-624c185d7e1e admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:35.818206 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce0da7-8686-4bcf-a4cd-624c185d7e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:35.818477 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce0da7-8686-4bcf-a4cd-624c185d7e1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:35.819166 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce0da7-8686-4bcf-a4cd-624c185d7e1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:33:35.819471 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce0da7-8686-4bcf-a4cd-624c185d7e1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:35.821126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce0da7-8686-4bcf-a4cd-624c185d7e1e admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:35.833666 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1041/2099] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:33:35.838251 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb43f93-abab-43c5-a417-cf6821743128 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:35.847712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb43f93-abab-43c5-a417-cf6821743128 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:35.852819 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d90ca-d516-477c-9517-205a5d6af503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:35.853415 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d90ca-d516-477c-9517-205a5d6af503 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:35.853674 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d90ca-d516-477c-9517-205a5d6af503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:35.853946 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d90ca-d516-477c-9517-205a5d6af503 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:35.854575 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d90ca-d516-477c-9517-205a5d6af503 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:35.857277 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d90ca-d516-477c-9517-205a5d6af503 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:35.891881 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1059/2100] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:33:35 2022] POST /identity/v3/projects => generated 391 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:33:35.896784 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce0da7-8686-4bcf-a4cd-624c185d7e1e admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:35.911614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce0da7-8686-4bcf-a4cd-624c185d7e1e admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:35.974169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49df5b-16da-404c-b8d8-41aa85ad728c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:35.974776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49df5b-16da-404c-b8d8-41aa85ad728c admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:35.975072 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49df5b-16da-404c-b8d8-41aa85ad728c admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:35.975357 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49df5b-16da-404c-b8d8-41aa85ad728c admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:35.976094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49df5b-16da-404c-b8d8-41aa85ad728c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:35.978405 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49df5b-16da-404c-b8d8-41aa85ad728c admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:36.004114 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1042/2101] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:33:35 2022] POST /identity/v3/users => generated 296 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:33:36.008344 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d90ca-d516-477c-9517-205a5d6af503 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:36.019117 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d90ca-d516-477c-9517-205a5d6af503 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:36.024691 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32579594-8962-4320-9204-4651f7dd3ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:36.025376 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32579594-8962-4320-9204-4651f7dd3ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:36.025669 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32579594-8962-4320-9204-4651f7dd3ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:36.025941 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32579594-8962-4320-9204-4651f7dd3ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:36.026589 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32579594-8962-4320-9204-4651f7dd3ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:36.028319 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32579594-8962-4320-9204-4651f7dd3ac0 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:36.038922 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1060/2102] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:33:36.043155 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49df5b-16da-404c-b8d8-41aa85ad728c admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:36.053765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49df5b-16da-404c-b8d8-41aa85ad728c admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:36.059403 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7512d7b-8653-4675-8afd-726c3d051c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:36.060012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7512d7b-8653-4675-8afd-726c3d051c0d admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:36.060285 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7512d7b-8653-4675-8afd-726c3d051c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:36.060557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7512d7b-8653-4675-8afd-726c3d051c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:36.061227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7512d7b-8653-4675-8afd-726c3d051c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:36.064495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7512d7b-8653-4675-8afd-726c3d051c0d admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:36.074355 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1043/2103] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:33:36.079177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32579594-8962-4320-9204-4651f7dd3ac0 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:36.092550 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32579594-8962-4320-9204-4651f7dd3ac0 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:36.098300 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cbab9-9987-4866-be65-2e73045646c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:36.098970 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cbab9-9987-4866-be65-2e73045646c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:36.099303 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cbab9-9987-4866-be65-2e73045646c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:36.099551 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cbab9-9987-4866-be65-2e73045646c0 admin admin] PATH_INFO: `/v3/projects/a675986dec5d41388e4a7c6cfb813a5e/users/eab67cd3655b40c89113b7a46456e1fd/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:36.117058 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629cbab9-9987-4866-be65-2e73045646c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a675986dec5d41388e4a7c6cfb813a5e, user_id=eab67cd3655b40c89113b7a46456e1fd, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:36.119917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629cbab9-9987-4866-be65-2e73045646c0 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:36.136066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1061/2104] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:33:36 2022] PUT /identity/v3/projects/a675986dec5d41388e4a7c6cfb813a5e/users/eab67cd3655b40c89113b7a46456e1fd/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:36.147152 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a54d35-32f2-463a-ac98-7d5f83713d63 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:36.147448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a54d35-32f2-463a-ac98-7d5f83713d63 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:36.147792 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a54d35-32f2-463a-ac98-7d5f83713d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:36.183125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-43a54d35-32f2-463a-ac98-7d5f83713d63 None None] MFA Rules not processed for user `eab67cd3655b40c89113b7a46456e1fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:36.184679 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-43a54d35-32f2-463a-ac98-7d5f83713d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:36.206304 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:36.255884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1044/2105] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:36.266657 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cbab9-9987-4866-be65-2e73045646c0 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:36.268654 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-629cbab9-9987-4866-be65-2e73045646c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:36.326459 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cbab9-9987-4866-be65-2e73045646c0 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:36.330178 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdb284-b70e-4107-9d43-2ac84e3f3f1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:36.330795 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdb284-b70e-4107-9d43-2ac84e3f3f1a service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:36.331110 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdb284-b70e-4107-9d43-2ac84e3f3f1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:36.331368 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdb284-b70e-4107-9d43-2ac84e3f3f1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:36.341150 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cdb284-b70e-4107-9d43-2ac84e3f3f1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:36.342611 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cdb284-b70e-4107-9d43-2ac84e3f3f1a service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:36.351657 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1062/2106] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:33:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:33:46.253024 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=19 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:46.347481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:46.808284 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a54d35-32f2-463a-ac98-7d5f83713d63 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:46.905028 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a54d35-32f2-463a-ac98-7d5f83713d63 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:46.911094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7238087-faaf-4aad-b579-f72c3c311589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:46.912153 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7238087-faaf-4aad-b579-f72c3c311589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:46.912153 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7238087-faaf-4aad-b579-f72c3c311589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:46.912465 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7238087-faaf-4aad-b579-f72c3c311589 admin admin] PATH_INFO: `/v3/users/eab67cd3655b40c89113b7a46456e1fd` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:46.915914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7238087-faaf-4aad-b579-f72c3c311589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eab67cd3655b40c89113b7a46456e1fd)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:46.918761 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7238087-faaf-4aad-b579-f72c3c311589 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:47.010054 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-a7238087-faaf-4aad-b579-f72c3c311589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eab67cd3655b40c89113b7a46456e1fd'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:47.011055 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-a7238087-faaf-4aad-b579-f72c3c311589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eab67cd3655b40c89113b7a46456e1fd'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:47.022212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-a7238087-faaf-4aad-b579-f72c3c311589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eab67cd3655b40c89113b7a46456e1fd'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:47.023114 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-a7238087-faaf-4aad-b579-f72c3c311589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eab67cd3655b40c89113b7a46456e1fd'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:47.042797 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-a7238087-faaf-4aad-b579-f72c3c311589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eab67cd3655b40c89113b7a46456e1fd'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:47.064621 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1045/2107] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:33:46 2022] DELETE /identity/v3/users/eab67cd3655b40c89113b7a46456e1fd => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:47.069033 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbf298-f8cd-48ba-afe2-4c82b0ff7203 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:47.069322 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbf298-f8cd-48ba-afe2-4c82b0ff7203 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:47.069594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbf298-f8cd-48ba-afe2-4c82b0ff7203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:47.094068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-23fbf298-f8cd-48ba-afe2-4c82b0ff7203 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:47.095763 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-23fbf298-f8cd-48ba-afe2-4c82b0ff7203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:47.174776 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1063/2108] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:47.185229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7238087-faaf-4aad-b579-f72c3c311589 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:47.186865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a7238087-faaf-4aad-b579-f72c3c311589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:47.251899 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7238087-faaf-4aad-b579-f72c3c311589 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:47.256862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199c30b-80e5-4823-b0e8-fd2fc29dc925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:47.257527 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199c30b-80e5-4823-b0e8-fd2fc29dc925 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:47.257844 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199c30b-80e5-4823-b0e8-fd2fc29dc925 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:47.258125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199c30b-80e5-4823-b0e8-fd2fc29dc925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:47.268901 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199c30b-80e5-4823-b0e8-fd2fc29dc925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:47.270789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199c30b-80e5-4823-b0e8-fd2fc29dc925 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:47.282639 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1046/2109] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:33:47.645573 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbf298-f8cd-48ba-afe2-4c82b0ff7203 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:47.647123 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-23fbf298-f8cd-48ba-afe2-4c82b0ff7203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:47.661048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbf298-f8cd-48ba-afe2-4c82b0ff7203 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:47.666240 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c075acc-49f9-4eb7-b54f-668d2b7b0b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:47.667104 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c075acc-49f9-4eb7-b54f-668d2b7b0b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:47.667511 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c075acc-49f9-4eb7-b54f-668d2b7b0b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:47.667641 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c075acc-49f9-4eb7-b54f-668d2b7b0b9e admin admin] PATH_INFO: `/v3/projects/a675986dec5d41388e4a7c6cfb813a5e` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:47.668825 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c075acc-49f9-4eb7-b54f-668d2b7b0b9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a675986dec5d41388e4a7c6cfb813a5e)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:47.671570 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c075acc-49f9-4eb7-b54f-668d2b7b0b9e admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:47.736066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5c075acc-49f9-4eb7-b54f-668d2b7b0b9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a675986dec5d41388e4a7c6cfb813a5e', 'request_id': 'req-5c075acc-49f9-4eb7-b54f-668d2b7b0b9e'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:47.745695 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5c075acc-49f9-4eb7-b54f-668d2b7b0b9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a675986dec5d41388e4a7c6cfb813a5e', 'request_id': 'req-5c075acc-49f9-4eb7-b54f-668d2b7b0b9e'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:47.753026 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5c075acc-49f9-4eb7-b54f-668d2b7b0b9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a675986dec5d41388e4a7c6cfb813a5e', 'request_id': 'req-5c075acc-49f9-4eb7-b54f-668d2b7b0b9e'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:47.766202 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5c075acc-49f9-4eb7-b54f-668d2b7b0b9e admin admin] The token cache is being invalidate because project a675986dec5d41388e4a7c6cfb813a5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:33:47.766560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5c075acc-49f9-4eb7-b54f-668d2b7b0b9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:47.767349 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5c075acc-49f9-4eb7-b54f-668d2b7b0b9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:47.773270 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1064/2110] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:33:47 2022] DELETE /identity/v3/projects/a675986dec5d41388e4a7c6cfb813a5e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:33:47.775536 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1534e-7470-4f33-a397-ea1c9bd1b057 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:47.775943 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1534e-7470-4f33-a397-ea1c9bd1b057 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:47.776362 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1534e-7470-4f33-a397-ea1c9bd1b057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:47.804609 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-a7d1534e-7470-4f33-a397-ea1c9bd1b057 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:47.805989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a7d1534e-7470-4f33-a397-ea1c9bd1b057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:47.830918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:47.885988 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1047/2111] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:47.895174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbafad-fb98-4384-a7d7-fa19657216b2 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:47.895174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbafad-fb98-4384-a7d7-fa19657216b2 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:47.895174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbafad-fb98-4384-a7d7-fa19657216b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:47.915167 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-14dbafad-fb98-4384-a7d7-fa19657216b2 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:47.916480 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-14dbafad-fb98-4384-a7d7-fa19657216b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:47.924979 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1065/2112] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:47.929603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1534e-7470-4f33-a397-ea1c9bd1b057 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:47.940392 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1534e-7470-4f33-a397-ea1c9bd1b057 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:47.945369 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bb205-1988-43c4-9fe9-fcb7c9df3985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:47.946193 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bb205-1988-43c4-9fe9-fcb7c9df3985 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:47.946585 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bb205-1988-43c4-9fe9-fcb7c9df3985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:47.946859 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bb205-1988-43c4-9fe9-fcb7c9df3985 admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:47.947550 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451bb205-1988-43c4-9fe9-fcb7c9df3985 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:33:47.947848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451bb205-1988-43c4-9fe9-fcb7c9df3985 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:47.949454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451bb205-1988-43c4-9fe9-fcb7c9df3985 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:47.962217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1048/2113] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:33:47.967021 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbafad-fb98-4384-a7d7-fa19657216b2 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:47.981632 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbafad-fb98-4384-a7d7-fa19657216b2 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:47.989349 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c6136-b886-491f-8902-1f4d44363c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:47.989349 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c6136-b886-491f-8902-1f4d44363c1c admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:47.989634 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c6136-b886-491f-8902-1f4d44363c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:47.989812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c6136-b886-491f-8902-1f4d44363c1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:47.991138 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c6136-b886-491f-8902-1f4d44363c1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:47.993396 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c6136-b886-491f-8902-1f4d44363c1c admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:48.042845 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1066/2114] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:33:47 2022] POST /identity/v3/projects => generated 397 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:33:48.046887 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bb205-1988-43c4-9fe9-fcb7c9df3985 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:48.061988 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bb205-1988-43c4-9fe9-fcb7c9df3985 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:48.131816 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ff56e-ca72-4b4c-a1dc-f364d74d94c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:48.132494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ff56e-ca72-4b4c-a1dc-f364d74d94c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:48.132772 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ff56e-ca72-4b4c-a1dc-f364d74d94c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:48.133044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ff56e-ca72-4b4c-a1dc-f364d74d94c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:48.133692 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ff56e-ca72-4b4c-a1dc-f364d74d94c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:48.135717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ff56e-ca72-4b4c-a1dc-f364d74d94c2 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:48.172698 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1049/2115] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:33:48 2022] POST /identity/v3/users => generated 299 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:33:48.181698 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c6136-b886-491f-8902-1f4d44363c1c admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:48.201453 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c6136-b886-491f-8902-1f4d44363c1c admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:48.209366 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc8ea1-369d-4622-a3b9-cac42759de16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:48.211202 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc8ea1-369d-4622-a3b9-cac42759de16 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:48.212100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc8ea1-369d-4622-a3b9-cac42759de16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:48.212622 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc8ea1-369d-4622-a3b9-cac42759de16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:48.213708 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc8ea1-369d-4622-a3b9-cac42759de16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:48.217237 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc8ea1-369d-4622-a3b9-cac42759de16 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:48.239203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ff56e-ca72-4b4c-a1dc-f364d74d94c2 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:48.255549 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1067/2116] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:33:48.260330 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ff56e-ca72-4b4c-a1dc-f364d74d94c2 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:48.265564 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c9f91-ab66-48f7-a436-418ca0e210b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:48.266310 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c9f91-ab66-48f7-a436-418ca0e210b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:48.266715 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c9f91-ab66-48f7-a436-418ca0e210b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:48.267044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c9f91-ab66-48f7-a436-418ca0e210b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:48.267974 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c9f91-ab66-48f7-a436-418ca0e210b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:48.270285 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c9f91-ab66-48f7-a436-418ca0e210b9 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:48.282545 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1050/2117] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:33:48.287275 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc8ea1-369d-4622-a3b9-cac42759de16 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:48.298546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc8ea1-369d-4622-a3b9-cac42759de16 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:48.303321 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6fdf4-8135-4c0d-950e-838c6d1e42d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:48.304054 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6fdf4-8135-4c0d-950e-838c6d1e42d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:48.304320 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6fdf4-8135-4c0d-950e-838c6d1e42d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:48.304637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6fdf4-8135-4c0d-950e-838c6d1e42d5 admin admin] PATH_INFO: `/v3/projects/89b34de0e5c747d1be48c0813ca06f69/users/fe825c4774134aec84eca107a4f0bdf3/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:48.319716 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6fdf4-8135-4c0d-950e-838c6d1e42d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89b34de0e5c747d1be48c0813ca06f69, user_id=fe825c4774134aec84eca107a4f0bdf3, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:48.322382 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6fdf4-8135-4c0d-950e-838c6d1e42d5 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:48.335315 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1068/2118] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:33:48 2022] PUT /identity/v3/projects/89b34de0e5c747d1be48c0813ca06f69/users/fe825c4774134aec84eca107a4f0bdf3/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:48.346857 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289936ec-2d84-4bc2-8ece-9d13ac438585 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:48.347152 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289936ec-2d84-4bc2-8ece-9d13ac438585 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:48.347423 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289936ec-2d84-4bc2-8ece-9d13ac438585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:48.378751 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-289936ec-2d84-4bc2-8ece-9d13ac438585 None None] MFA Rules not processed for user `fe825c4774134aec84eca107a4f0bdf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:48.380014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-289936ec-2d84-4bc2-8ece-9d13ac438585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:48.475588 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1051/2119] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:48 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:48.499907 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6fdf4-8135-4c0d-950e-838c6d1e42d5 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:48.501790 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-06c6fdf4-8135-4c0d-950e-838c6d1e42d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:48.532354 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:48.584895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6fdf4-8135-4c0d-950e-838c6d1e42d5 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:48.588843 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944b90f-e6ac-4a59-bba9-e52ac2a9168e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:48.589639 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944b90f-e6ac-4a59-bba9-e52ac2a9168e service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:48.589985 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944b90f-e6ac-4a59-bba9-e52ac2a9168e service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:48.590712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944b90f-e6ac-4a59-bba9-e52ac2a9168e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:48.601653 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944b90f-e6ac-4a59-bba9-e52ac2a9168e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:48.603231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944b90f-e6ac-4a59-bba9-e52ac2a9168e service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:48.622800 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1069/2120] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:33:48 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:33:54.010245 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289936ec-2d84-4bc2-8ece-9d13ac438585 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:54.030828 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:54.081390 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289936ec-2d84-4bc2-8ece-9d13ac438585 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:54.086726 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc958c2-1d7c-4f1e-bf5a-80c2a8cbe756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:54.087429 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc958c2-1d7c-4f1e-bf5a-80c2a8cbe756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:54.087706 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc958c2-1d7c-4f1e-bf5a-80c2a8cbe756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:54.087977 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc958c2-1d7c-4f1e-bf5a-80c2a8cbe756 admin admin] PATH_INFO: `/v3/users/fe825c4774134aec84eca107a4f0bdf3` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:54.089175 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc958c2-1d7c-4f1e-bf5a-80c2a8cbe756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe825c4774134aec84eca107a4f0bdf3)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:54.091293 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc958c2-1d7c-4f1e-bf5a-80c2a8cbe756 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:54.175447 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-bdc958c2-1d7c-4f1e-bf5a-80c2a8cbe756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe825c4774134aec84eca107a4f0bdf3'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:54.176121 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-bdc958c2-1d7c-4f1e-bf5a-80c2a8cbe756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe825c4774134aec84eca107a4f0bdf3'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:54.183917 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-bdc958c2-1d7c-4f1e-bf5a-80c2a8cbe756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe825c4774134aec84eca107a4f0bdf3'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:54.184712 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-bdc958c2-1d7c-4f1e-bf5a-80c2a8cbe756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe825c4774134aec84eca107a4f0bdf3'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:54.195326 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-bdc958c2-1d7c-4f1e-bf5a-80c2a8cbe756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe825c4774134aec84eca107a4f0bdf3'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:54.223583 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1052/2121] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:33:54 2022] DELETE /identity/v3/users/fe825c4774134aec84eca107a4f0bdf3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:54.229205 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b40ae1-36af-44d0-be60-34f1a5d195ec None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:54.229675 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b40ae1-36af-44d0-be60-34f1a5d195ec None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:54.229895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b40ae1-36af-44d0-be60-34f1a5d195ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:54.266686 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-a2b40ae1-36af-44d0-be60-34f1a5d195ec None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:54.267938 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-a2b40ae1-36af-44d0-be60-34f1a5d195ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:54.332837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1070/2122] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:33:54.342329 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc958c2-1d7c-4f1e-bf5a-80c2a8cbe756 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:54.343869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-bdc958c2-1d7c-4f1e-bf5a-80c2a8cbe756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:54.405523 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc958c2-1d7c-4f1e-bf5a-80c2a8cbe756 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:54.409726 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0612fd7-2b47-4d63-8462-321c90baa4d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:54.410351 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0612fd7-2b47-4d63-8462-321c90baa4d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:54.410621 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0612fd7-2b47-4d63-8462-321c90baa4d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:54.410882 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0612fd7-2b47-4d63-8462-321c90baa4d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:54.423467 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0612fd7-2b47-4d63-8462-321c90baa4d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:54.424924 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0612fd7-2b47-4d63-8462-321c90baa4d6 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:54.438141 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1053/2123] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:33:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:33:54.732487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b40ae1-36af-44d0-be60-34f1a5d195ec None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:54.738297 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-a2b40ae1-36af-44d0-be60-34f1a5d195ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:54.757366 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b40ae1-36af-44d0-be60-34f1a5d195ec None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:54.762900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fec863-98d9-4d0d-9184-8b3b4629472a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:54.763566 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fec863-98d9-4d0d-9184-8b3b4629472a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:54.763858 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fec863-98d9-4d0d-9184-8b3b4629472a admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:54.764165 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fec863-98d9-4d0d-9184-8b3b4629472a admin admin] PATH_INFO: `/v3/projects/89b34de0e5c747d1be48c0813ca06f69` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:54.765244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fec863-98d9-4d0d-9184-8b3b4629472a admin admin] RBAC: Authorizing `identity:delete_project(project_id=89b34de0e5c747d1be48c0813ca06f69)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:54.767253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fec863-98d9-4d0d-9184-8b3b4629472a admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:54.821350 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-d0fec863-98d9-4d0d-9184-8b3b4629472a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89b34de0e5c747d1be48c0813ca06f69', 'request_id': 'req-d0fec863-98d9-4d0d-9184-8b3b4629472a'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:54.830711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-d0fec863-98d9-4d0d-9184-8b3b4629472a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89b34de0e5c747d1be48c0813ca06f69', 'request_id': 'req-d0fec863-98d9-4d0d-9184-8b3b4629472a'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:54.855601 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-d0fec863-98d9-4d0d-9184-8b3b4629472a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89b34de0e5c747d1be48c0813ca06f69', 'request_id': 'req-d0fec863-98d9-4d0d-9184-8b3b4629472a'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:54.866924 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0612fd7-2b47-4d63-8462-321c90baa4d6 service neutron] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:54.868841 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-b0612fd7-2b47-4d63-8462-321c90baa4d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:54.869415 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-d0fec863-98d9-4d0d-9184-8b3b4629472a admin admin] The token cache is being invalidate because project 89b34de0e5c747d1be48c0813ca06f69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:33:54.869710 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-d0fec863-98d9-4d0d-9184-8b3b4629472a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:54.870396 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-d0fec863-98d9-4d0d-9184-8b3b4629472a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:54.872119 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1071/2124] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:33:54 2022] DELETE /identity/v3/projects/89b34de0e5c747d1be48c0813ca06f69 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:54.886075 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0612fd7-2b47-4d63-8462-321c90baa4d6 service neutron] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:54.946669 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:55.001325 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a6f36-8345-42c8-951e-dd5878560b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:55.002255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a6f36-8345-42c8-951e-dd5878560b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:55.002540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a6f36-8345-42c8-951e-dd5878560b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:55.002967 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a6f36-8345-42c8-951e-dd5878560b3d admin admin] PATH_INFO: `/v3/users/25adb7481d2e4426b830e7b37724c67c` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:55.004972 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a6f36-8345-42c8-951e-dd5878560b3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=25adb7481d2e4426b830e7b37724c67c)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:55.007065 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a6f36-8345-42c8-951e-dd5878560b3d admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:55.075276 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-2f3a6f36-8345-42c8-951e-dd5878560b3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25adb7481d2e4426b830e7b37724c67c'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:55.076121 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-2f3a6f36-8345-42c8-951e-dd5878560b3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25adb7481d2e4426b830e7b37724c67c'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:55.084427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-2f3a6f36-8345-42c8-951e-dd5878560b3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25adb7481d2e4426b830e7b37724c67c'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:55.085182 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-2f3a6f36-8345-42c8-951e-dd5878560b3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25adb7481d2e4426b830e7b37724c67c'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:55.095815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-2f3a6f36-8345-42c8-951e-dd5878560b3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25adb7481d2e4426b830e7b37724c67c'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:55.114604 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1054/2125] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:33:54 2022] DELETE /identity/v3/users/25adb7481d2e4426b830e7b37724c67c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:55.119083 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13738db-9510-49ab-ac66-32bc482f2fde None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:55.119373 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13738db-9510-49ab-ac66-32bc482f2fde None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:55.119649 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13738db-9510-49ab-ac66-32bc482f2fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:55.139216 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-c13738db-9510-49ab-ac66-32bc482f2fde None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:55.140434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-c13738db-9510-49ab-ac66-32bc482f2fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:55.184337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:55.203896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1072/2126] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:55.214818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a6f36-8345-42c8-951e-dd5878560b3d admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:55.216290 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-2f3a6f36-8345-42c8-951e-dd5878560b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:55.275625 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a6f36-8345-42c8-951e-dd5878560b3d admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:55.279448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c79ab3-ef43-49cb-b571-9629bf332561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:55.280102 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c79ab3-ef43-49cb-b571-9629bf332561 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:55.280414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c79ab3-ef43-49cb-b571-9629bf332561 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:55.280675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c79ab3-ef43-49cb-b571-9629bf332561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:55.292621 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c79ab3-ef43-49cb-b571-9629bf332561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:55.294124 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c79ab3-ef43-49cb-b571-9629bf332561 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:55.304450 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1055/2127] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:33:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:33:55.578692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13738db-9510-49ab-ac66-32bc482f2fde None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:55.580329 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-c13738db-9510-49ab-ac66-32bc482f2fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:55.593078 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13738db-9510-49ab-ac66-32bc482f2fde None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:55.600443 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eda765-6d45-43ff-baad-5bd0b7f15f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:55.601514 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eda765-6d45-43ff-baad-5bd0b7f15f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:55.602015 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eda765-6d45-43ff-baad-5bd0b7f15f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:55.602481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eda765-6d45-43ff-baad-5bd0b7f15f4f admin admin] PATH_INFO: `/v3/projects/78c5beaf837e46b3abcb0b89ba84ea63` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:55.604070 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eda765-6d45-43ff-baad-5bd0b7f15f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=78c5beaf837e46b3abcb0b89ba84ea63)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:55.606449 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eda765-6d45-43ff-baad-5bd0b7f15f4f admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:55.656651 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f6eda765-6d45-43ff-baad-5bd0b7f15f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78c5beaf837e46b3abcb0b89ba84ea63', 'request_id': 'req-f6eda765-6d45-43ff-baad-5bd0b7f15f4f'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:55.669514 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f6eda765-6d45-43ff-baad-5bd0b7f15f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78c5beaf837e46b3abcb0b89ba84ea63', 'request_id': 'req-f6eda765-6d45-43ff-baad-5bd0b7f15f4f'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:55.677706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f6eda765-6d45-43ff-baad-5bd0b7f15f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78c5beaf837e46b3abcb0b89ba84ea63', 'request_id': 'req-f6eda765-6d45-43ff-baad-5bd0b7f15f4f'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:55.688869 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f6eda765-6d45-43ff-baad-5bd0b7f15f4f admin admin] The token cache is being invalidate because project 78c5beaf837e46b3abcb0b89ba84ea63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:33:55.689096 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f6eda765-6d45-43ff-baad-5bd0b7f15f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:55.689760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f6eda765-6d45-43ff-baad-5bd0b7f15f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:55.691403 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1073/2128] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:33:55 2022] DELETE /identity/v3/projects/78c5beaf837e46b3abcb0b89ba84ea63 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:55.696385 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4986f56-eb9b-469e-a7c5-5ecc1a77bed1 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:55.696719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4986f56-eb9b-469e-a7c5-5ecc1a77bed1 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:55.696997 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4986f56-eb9b-469e-a7c5-5ecc1a77bed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:55.717147 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-a4986f56-eb9b-469e-a7c5-5ecc1a77bed1 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:55.718348 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a4986f56-eb9b-469e-a7c5-5ecc1a77bed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:55.783122 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1056/2129] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:55.791386 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db57a5-f68c-42df-a93e-d2869f3f9a79 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:55.791675 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db57a5-f68c-42df-a93e-d2869f3f9a79 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:55.791972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db57a5-f68c-42df-a93e-d2869f3f9a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:55.814880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-c6db57a5-f68c-42df-a93e-d2869f3f9a79 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:55.816243 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-c6db57a5-f68c-42df-a93e-d2869f3f9a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:55.828180 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1074/2130] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:55.832650 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4986f56-eb9b-469e-a7c5-5ecc1a77bed1 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:55.837646 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:55.844859 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4986f56-eb9b-469e-a7c5-5ecc1a77bed1 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:55.851003 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce1575-6e8c-4c6c-8b78-8f772060a7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:55.851880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce1575-6e8c-4c6c-8b78-8f772060a7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:55.852201 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce1575-6e8c-4c6c-8b78-8f772060a7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:55.852625 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce1575-6e8c-4c6c-8b78-8f772060a7a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:55.853341 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce1575-6e8c-4c6c-8b78-8f772060a7a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:33:55.853931 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce1575-6e8c-4c6c-8b78-8f772060a7a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:55.855607 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce1575-6e8c-4c6c-8b78-8f772060a7a3 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:55.867819 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1057/2131] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:33:55.872133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db57a5-f68c-42df-a93e-d2869f3f9a79 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:55.881593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db57a5-f68c-42df-a93e-d2869f3f9a79 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:55.886372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664487e-62d6-43ff-bc46-f94227bbbd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:55.886975 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664487e-62d6-43ff-bc46-f94227bbbd11 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:55.887282 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664487e-62d6-43ff-bc46-f94227bbbd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:55.887553 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664487e-62d6-43ff-bc46-f94227bbbd11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:55.888201 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664487e-62d6-43ff-bc46-f94227bbbd11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:55.890120 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664487e-62d6-43ff-bc46-f94227bbbd11 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:55.925877 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1075/2132] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:33:55 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:33:55.927973 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce1575-6e8c-4c6c-8b78-8f772060a7a3 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:55.939039 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce1575-6e8c-4c6c-8b78-8f772060a7a3 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:56.007013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb3db0-a115-4126-814a-f234c3933938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:56.007013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb3db0-a115-4126-814a-f234c3933938 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:56.007013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb3db0-a115-4126-814a-f234c3933938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:56.007013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb3db0-a115-4126-814a-f234c3933938 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:56.007632 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb3db0-a115-4126-814a-f234c3933938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:56.007715 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb3db0-a115-4126-814a-f234c3933938 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:56.040651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1058/2133] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:33:55 2022] POST /identity/v3/users => generated 282 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:33:56.050265 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664487e-62d6-43ff-bc46-f94227bbbd11 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:56.061432 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664487e-62d6-43ff-bc46-f94227bbbd11 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:56.066550 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da359370-2fef-4853-ad46-d943b91723fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:56.067314 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da359370-2fef-4853-ad46-d943b91723fa admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:56.067646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da359370-2fef-4853-ad46-d943b91723fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:56.067916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da359370-2fef-4853-ad46-d943b91723fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:56.068649 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da359370-2fef-4853-ad46-d943b91723fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:56.070364 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da359370-2fef-4853-ad46-d943b91723fa admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:56.081253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1076/2134] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:33:56.085322 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb3db0-a115-4126-814a-f234c3933938 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:56.095780 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb3db0-a115-4126-814a-f234c3933938 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:56.100377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e486e-1e2c-4a03-96d1-e3614fcb4091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:56.100980 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e486e-1e2c-4a03-96d1-e3614fcb4091 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:56.101258 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e486e-1e2c-4a03-96d1-e3614fcb4091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:56.101529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e486e-1e2c-4a03-96d1-e3614fcb4091 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:56.102170 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e486e-1e2c-4a03-96d1-e3614fcb4091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:56.103794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e486e-1e2c-4a03-96d1-e3614fcb4091 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:56.115293 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1059/2135] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:33:56.120295 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da359370-2fef-4853-ad46-d943b91723fa admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:56.130445 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da359370-2fef-4853-ad46-d943b91723fa admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:56.135554 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbfc4ec-3f2b-4941-adae-f6a8a734882c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:56.136285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfc4ec-3f2b-4941-adae-f6a8a734882c admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:56.136578 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfc4ec-3f2b-4941-adae-f6a8a734882c admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:56.136851 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfc4ec-3f2b-4941-adae-f6a8a734882c admin admin] PATH_INFO: `/v3/projects/092cc00631e649b2b9f67e1dd1dea003/users/69cf46af4df14f0aaf747c179f60302d/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:56.155988 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbfc4ec-3f2b-4941-adae-f6a8a734882c admin admin] RBAC: Authorizing `identity:create_grant(project_id=092cc00631e649b2b9f67e1dd1dea003, user_id=69cf46af4df14f0aaf747c179f60302d, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:56.158868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbfc4ec-3f2b-4941-adae-f6a8a734882c admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:56.173669 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1077/2136] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:33:56 2022] PUT /identity/v3/projects/092cc00631e649b2b9f67e1dd1dea003/users/69cf46af4df14f0aaf747c179f60302d/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:56.185872 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6856ef-aef4-493c-8548-9b9594331544 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:56.186153 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6856ef-aef4-493c-8548-9b9594331544 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:56.186417 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6856ef-aef4-493c-8548-9b9594331544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:56.216044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-ea6856ef-aef4-493c-8548-9b9594331544 None None] MFA Rules not processed for user `69cf46af4df14f0aaf747c179f60302d`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:56.217186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ea6856ef-aef4-493c-8548-9b9594331544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:56.284801 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1060/2137] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:56.296607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbfc4ec-3f2b-4941-adae-f6a8a734882c admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:56.298712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-cbbfc4ec-3f2b-4941-adae-f6a8a734882c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:56.355819 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbfc4ec-3f2b-4941-adae-f6a8a734882c admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:56.359642 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc39be0-a47e-40c6-931c-215df2432275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:56.360248 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc39be0-a47e-40c6-931c-215df2432275 service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:56.360536 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc39be0-a47e-40c6-931c-215df2432275 service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:56.360788 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc39be0-a47e-40c6-931c-215df2432275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:56.369273 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc39be0-a47e-40c6-931c-215df2432275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:56.370704 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc39be0-a47e-40c6-931c-215df2432275 service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:56.379683 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1078/2138] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:33:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:33:58.317647 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6856ef-aef4-493c-8548-9b9594331544 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:58.319680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ea6856ef-aef4-493c-8548-9b9594331544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:58.403387 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:58.408257 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6856ef-aef4-493c-8548-9b9594331544 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:58.415142 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc658f-5d3e-4061-aa72-2a138bca0d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:58.415802 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc658f-5d3e-4061-aa72-2a138bca0d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:58.416076 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc658f-5d3e-4061-aa72-2a138bca0d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:58.416341 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc658f-5d3e-4061-aa72-2a138bca0d48 admin admin] PATH_INFO: `/v3/users/c96a4b6c250646c1adec98c7d98026c1` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:58.418700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc658f-5d3e-4061-aa72-2a138bca0d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c96a4b6c250646c1adec98c7d98026c1)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:58.420849 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc658f-5d3e-4061-aa72-2a138bca0d48 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:58.473196 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-55dc658f-5d3e-4061-aa72-2a138bca0d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c96a4b6c250646c1adec98c7d98026c1'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:58.473992 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-55dc658f-5d3e-4061-aa72-2a138bca0d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c96a4b6c250646c1adec98c7d98026c1'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:58.481616 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-55dc658f-5d3e-4061-aa72-2a138bca0d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c96a4b6c250646c1adec98c7d98026c1'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:58.482255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-55dc658f-5d3e-4061-aa72-2a138bca0d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c96a4b6c250646c1adec98c7d98026c1'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:58.490918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-55dc658f-5d3e-4061-aa72-2a138bca0d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c96a4b6c250646c1adec98c7d98026c1'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:58.510517 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1061/2139] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:33:58 2022] DELETE /identity/v3/users/c96a4b6c250646c1adec98c7d98026c1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:58.515558 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa441439-aa2a-481e-98e6-ad0eb513d282 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:58.516172 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa441439-aa2a-481e-98e6-ad0eb513d282 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:58.516336 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa441439-aa2a-481e-98e6-ad0eb513d282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:58.537882 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-aa441439-aa2a-481e-98e6-ad0eb513d282 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:58.539272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-aa441439-aa2a-481e-98e6-ad0eb513d282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:58.544885 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:58.616700 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1079/2140] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:58.628343 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc658f-5d3e-4061-aa72-2a138bca0d48 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:58.629778 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-55dc658f-5d3e-4061-aa72-2a138bca0d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:58.705469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc658f-5d3e-4061-aa72-2a138bca0d48 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:58.722416 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bda34-2f12-461e-9381-c81e372e87a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:58.723165 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bda34-2f12-461e-9381-c81e372e87a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:58.723514 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bda34-2f12-461e-9381-c81e372e87a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:58.723880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bda34-2f12-461e-9381-c81e372e87a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:58.735869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9bda34-2f12-461e-9381-c81e372e87a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:58.737320 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9bda34-2f12-461e-9381-c81e372e87a6 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:58.747760 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1062/2141] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:33:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:33:59.124270 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa441439-aa2a-481e-98e6-ad0eb513d282 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:59.125890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-aa441439-aa2a-481e-98e6-ad0eb513d282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:59.144072 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa441439-aa2a-481e-98e6-ad0eb513d282 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:59.159963 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9991af-1493-4cc5-9ac6-bbfb7102cbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:59.160700 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9991af-1493-4cc5-9ac6-bbfb7102cbaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:59.160977 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9991af-1493-4cc5-9ac6-bbfb7102cbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:59.161358 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9991af-1493-4cc5-9ac6-bbfb7102cbaf admin admin] PATH_INFO: `/v3/projects/1561a7923d8244afab6d73e96f0f7339` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:59.162756 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9991af-1493-4cc5-9ac6-bbfb7102cbaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1561a7923d8244afab6d73e96f0f7339)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:59.164714 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9991af-1493-4cc5-9ac6-bbfb7102cbaf admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:59.214778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-1a9991af-1493-4cc5-9ac6-bbfb7102cbaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1561a7923d8244afab6d73e96f0f7339', 'request_id': 'req-1a9991af-1493-4cc5-9ac6-bbfb7102cbaf'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:59.223279 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-1a9991af-1493-4cc5-9ac6-bbfb7102cbaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1561a7923d8244afab6d73e96f0f7339', 'request_id': 'req-1a9991af-1493-4cc5-9ac6-bbfb7102cbaf'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:59.231188 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-1a9991af-1493-4cc5-9ac6-bbfb7102cbaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1561a7923d8244afab6d73e96f0f7339', 'request_id': 'req-1a9991af-1493-4cc5-9ac6-bbfb7102cbaf'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:59.243362 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-1a9991af-1493-4cc5-9ac6-bbfb7102cbaf admin admin] The token cache is being invalidate because project 1561a7923d8244afab6d73e96f0f7339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:33:59.243650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-1a9991af-1493-4cc5-9ac6-bbfb7102cbaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:59.244436 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-1a9991af-1493-4cc5-9ac6-bbfb7102cbaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:33:59.245994 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1080/2142] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:33:59 2022] DELETE /identity/v3/projects/1561a7923d8244afab6d73e96f0f7339 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:59.251182 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef95688-c4a7-4681-a7d6-29a6690133c2 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:59.251460 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef95688-c4a7-4681-a7d6-29a6690133c2 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:59.251738 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef95688-c4a7-4681-a7d6-29a6690133c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:59.273285 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-bef95688-c4a7-4681-a7d6-29a6690133c2 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:59.274497 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-bef95688-c4a7-4681-a7d6-29a6690133c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:59.336650 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1063/2143] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:59.346357 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4af21-69a2-41ab-8cbc-0efb3513ccd9 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:59.346634 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4af21-69a2-41ab-8cbc-0efb3513ccd9 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:59.346905 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4af21-69a2-41ab-8cbc-0efb3513ccd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:59.367872 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-3fd4af21-69a2-41ab-8cbc-0efb3513ccd9 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:59.369084 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-3fd4af21-69a2-41ab-8cbc-0efb3513ccd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:59.384673 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1081/2144] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:59.388358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef95688-c4a7-4681-a7d6-29a6690133c2 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:59.398902 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef95688-c4a7-4681-a7d6-29a6690133c2 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:59.403708 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e049e-682e-4fef-8a03-86d2dd10b811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:59.404255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e049e-682e-4fef-8a03-86d2dd10b811 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:59.404522 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e049e-682e-4fef-8a03-86d2dd10b811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:59.404783 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e049e-682e-4fef-8a03-86d2dd10b811 admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:59.405419 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e049e-682e-4fef-8a03-86d2dd10b811 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:33:59.405747 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e049e-682e-4fef-8a03-86d2dd10b811 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:59.407412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e049e-682e-4fef-8a03-86d2dd10b811 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:59.419322 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1064/2145] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:33:59.423913 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4af21-69a2-41ab-8cbc-0efb3513ccd9 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:59.433602 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4af21-69a2-41ab-8cbc-0efb3513ccd9 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:59.447148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4eb310-402f-4e31-82f9-606727b4f8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:59.447148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4eb310-402f-4e31-82f9-606727b4f8e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:59.447148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4eb310-402f-4e31-82f9-606727b4f8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:59.447148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4eb310-402f-4e31-82f9-606727b4f8e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:59.447832 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4eb310-402f-4e31-82f9-606727b4f8e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:59.447832 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4eb310-402f-4e31-82f9-606727b4f8e7 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:59.477140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1082/2146] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:33:59 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:33:59.482143 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e049e-682e-4fef-8a03-86d2dd10b811 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:59.492850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e049e-682e-4fef-8a03-86d2dd10b811 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:59.498196 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:59.584852 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bc550-e540-4b0f-bae5-1f17db37668e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:59.585584 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bc550-e540-4b0f-bae5-1f17db37668e admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:59.585923 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bc550-e540-4b0f-bae5-1f17db37668e admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:59.586238 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bc550-e540-4b0f-bae5-1f17db37668e admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:59.587008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bc550-e540-4b0f-bae5-1f17db37668e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:59.588986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bc550-e540-4b0f-bae5-1f17db37668e admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:59.611326 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1065/2147] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:33:59 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:33:59.615534 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4eb310-402f-4e31-82f9-606727b4f8e7 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:59.626707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4eb310-402f-4e31-82f9-606727b4f8e7 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:59.632084 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7d5b2-6055-4d5e-95ac-707b6ce0138d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:59.632725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7d5b2-6055-4d5e-95ac-707b6ce0138d admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:59.633011 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7d5b2-6055-4d5e-95ac-707b6ce0138d admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:59.633274 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7d5b2-6055-4d5e-95ac-707b6ce0138d admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:59.633974 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7d5b2-6055-4d5e-95ac-707b6ce0138d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:59.635656 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7d5b2-6055-4d5e-95ac-707b6ce0138d admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:59.647329 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1083/2148] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:33:59.651500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bc550-e540-4b0f-bae5-1f17db37668e admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:59.666634 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bc550-e540-4b0f-bae5-1f17db37668e admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:59.672056 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2782704-ff56-4a64-a20d-739c3c74d2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:59.672752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2782704-ff56-4a64-a20d-739c3c74d2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:59.673037 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2782704-ff56-4a64-a20d-739c3c74d2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:59.673306 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2782704-ff56-4a64-a20d-739c3c74d2f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:59.673961 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2782704-ff56-4a64-a20d-739c3c74d2f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:59.675666 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2782704-ff56-4a64-a20d-739c3c74d2f5 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:59.690599 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1066/2149] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:33:59.691917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7d5b2-6055-4d5e-95ac-707b6ce0138d admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:59.702250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7d5b2-6055-4d5e-95ac-707b6ce0138d admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:59.707122 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beeb01e-506c-4bbc-a950-788a6bffada9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:59.707818 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beeb01e-506c-4bbc-a950-788a6bffada9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:59.708094 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beeb01e-506c-4bbc-a950-788a6bffada9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:59.708392 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beeb01e-506c-4bbc-a950-788a6bffada9 admin admin] PATH_INFO: `/v3/projects/261a40cd6f114ef78a6e31975fa9b922/users/9fc7e9490fac4be294a5d1f5e54d918f/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:59.723247 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beeb01e-506c-4bbc-a950-788a6bffada9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=261a40cd6f114ef78a6e31975fa9b922, user_id=9fc7e9490fac4be294a5d1f5e54d918f, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:59.726052 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beeb01e-506c-4bbc-a950-788a6bffada9 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:59.743233 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1084/2150] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:33:59 2022] PUT /identity/v3/projects/261a40cd6f114ef78a6e31975fa9b922/users/9fc7e9490fac4be294a5d1f5e54d918f/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:33:59.755667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d109d-0e8b-4dc3-9224-7796c67f51d0 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:59.755954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d109d-0e8b-4dc3-9224-7796c67f51d0 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:59.756228 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d109d-0e8b-4dc3-9224-7796c67f51d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:59.797146 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-e08d109d-0e8b-4dc3-9224-7796c67f51d0 None None] MFA Rules not processed for user `9fc7e9490fac4be294a5d1f5e54d918f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:33:59.798482 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-e08d109d-0e8b-4dc3-9224-7796c67f51d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:59.868001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1067/2151] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:33:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:33:59.879682 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beeb01e-506c-4bbc-a950-788a6bffada9 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:33:59.881701 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-0beeb01e-506c-4bbc-a950-788a6bffada9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:33:59.914537 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:33:59.940900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beeb01e-506c-4bbc-a950-788a6bffada9 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:33:59.945210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c6646-9001-4829-86f7-8c50bc3acb8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:33:59.945874 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c6646-9001-4829-86f7-8c50bc3acb8c service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:33:59.946165 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c6646-9001-4829-86f7-8c50bc3acb8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:33:59.946520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c6646-9001-4829-86f7-8c50bc3acb8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:33:59.956668 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c6646-9001-4829-86f7-8c50bc3acb8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:33:59.958105 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c6646-9001-4829-86f7-8c50bc3acb8c service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:33:59.967892 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1085/2152] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:33:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:34:02.574727 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d109d-0e8b-4dc3-9224-7796c67f51d0 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:34:02.661367 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d109d-0e8b-4dc3-9224-7796c67f51d0 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:34:02.678027 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1f5c6-aaf5-4c04-b3e8-da78037672ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:34:02.678804 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1f5c6-aaf5-4c04-b3e8-da78037672ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:02.679985 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1f5c6-aaf5-4c04-b3e8-da78037672ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:02.680454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1f5c6-aaf5-4c04-b3e8-da78037672ee admin admin] PATH_INFO: `/v3/users/9fc7e9490fac4be294a5d1f5e54d918f` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:02.682841 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1f5c6-aaf5-4c04-b3e8-da78037672ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fc7e9490fac4be294a5d1f5e54d918f)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:34:02.685107 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1f5c6-aaf5-4c04-b3e8-da78037672ee admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:34:02.715315 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:34:02.763037 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-70e1f5c6-aaf5-4c04-b3e8-da78037672ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fc7e9490fac4be294a5d1f5e54d918f'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:34:02.763037 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-70e1f5c6-aaf5-4c04-b3e8-da78037672ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fc7e9490fac4be294a5d1f5e54d918f'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:34:02.774227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-70e1f5c6-aaf5-4c04-b3e8-da78037672ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fc7e9490fac4be294a5d1f5e54d918f'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:34:02.775018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-70e1f5c6-aaf5-4c04-b3e8-da78037672ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fc7e9490fac4be294a5d1f5e54d918f'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:34:02.810262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-70e1f5c6-aaf5-4c04-b3e8-da78037672ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fc7e9490fac4be294a5d1f5e54d918f'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:34:02.841956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1068/2153] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:34:02 2022] DELETE /identity/v3/users/9fc7e9490fac4be294a5d1f5e54d918f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:34:02.844232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69a6bb-a477-4c98-9480-963c84a6e19c None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:02.844709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69a6bb-a477-4c98-9480-963c84a6e19c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:02.844868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69a6bb-a477-4c98-9480-963c84a6e19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:02.866938 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-8d69a6bb-a477-4c98-9480-963c84a6e19c None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:34:02.868193 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8d69a6bb-a477-4c98-9480-963c84a6e19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:34:02.935575 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1086/2154] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:34:02.946561 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1f5c6-aaf5-4c04-b3e8-da78037672ee admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:34:02.948465 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-70e1f5c6-aaf5-4c04-b3e8-da78037672ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:34:03.013610 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1f5c6-aaf5-4c04-b3e8-da78037672ee admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:34:03.017418 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d42e98-884e-4848-b2d2-dc25a7d63ff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:34:03.018038 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d42e98-884e-4848-b2d2-dc25a7d63ff7 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:03.018315 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d42e98-884e-4848-b2d2-dc25a7d63ff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:03.018946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d42e98-884e-4848-b2d2-dc25a7d63ff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:03.028972 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d42e98-884e-4848-b2d2-dc25a7d63ff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:34:03.030435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d42e98-884e-4848-b2d2-dc25a7d63ff7 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:34:03.040885 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1069/2155] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:34:03.360851 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69a6bb-a477-4c98-9480-963c84a6e19c None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:34:03.362279 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8d69a6bb-a477-4c98-9480-963c84a6e19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:34:03.381911 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69a6bb-a477-4c98-9480-963c84a6e19c None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:34:03.392801 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6243055-bca3-4d4a-a7e2-9a583c6e6b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:34:03.393451 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6243055-bca3-4d4a-a7e2-9a583c6e6b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:03.394128 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6243055-bca3-4d4a-a7e2-9a583c6e6b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:03.394399 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6243055-bca3-4d4a-a7e2-9a583c6e6b2f admin admin] PATH_INFO: `/v3/projects/261a40cd6f114ef78a6e31975fa9b922` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:03.395561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6243055-bca3-4d4a-a7e2-9a583c6e6b2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=261a40cd6f114ef78a6e31975fa9b922)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:34:03.397642 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6243055-bca3-4d4a-a7e2-9a583c6e6b2f admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:34:03.469583 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c6243055-bca3-4d4a-a7e2-9a583c6e6b2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '261a40cd6f114ef78a6e31975fa9b922', 'request_id': 'req-c6243055-bca3-4d4a-a7e2-9a583c6e6b2f'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:34:03.482194 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c6243055-bca3-4d4a-a7e2-9a583c6e6b2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '261a40cd6f114ef78a6e31975fa9b922', 'request_id': 'req-c6243055-bca3-4d4a-a7e2-9a583c6e6b2f'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:34:03.500971 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c6243055-bca3-4d4a-a7e2-9a583c6e6b2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '261a40cd6f114ef78a6e31975fa9b922', 'request_id': 'req-c6243055-bca3-4d4a-a7e2-9a583c6e6b2f'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:34:03.515143 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c6243055-bca3-4d4a-a7e2-9a583c6e6b2f admin admin] The token cache is being invalidate because project 261a40cd6f114ef78a6e31975fa9b922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:34:03.515698 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c6243055-bca3-4d4a-a7e2-9a583c6e6b2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:34:03.516661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c6243055-bca3-4d4a-a7e2-9a583c6e6b2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:34:03.533834 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1087/2156] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:34:03 2022] DELETE /identity/v3/projects/261a40cd6f114ef78a6e31975fa9b922 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:34:03.534137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f01d5-f946-4838-8750-fd207a70993f None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:03.534137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f01d5-f946-4838-8750-fd207a70993f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:03.534137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f01d5-f946-4838-8750-fd207a70993f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:03.557536 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-c12f01d5-f946-4838-8750-fd207a70993f None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:34:03.558230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c12f01d5-f946-4838-8750-fd207a70993f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:34:03.622731 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1070/2157] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:34:03.630863 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcee5bd-dc15-4f7c-a40a-0ac93b97b75d None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:03.631188 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcee5bd-dc15-4f7c-a40a-0ac93b97b75d None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:03.631462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcee5bd-dc15-4f7c-a40a-0ac93b97b75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:03.651638 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-ffcee5bd-dc15-4f7c-a40a-0ac93b97b75d None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:34:03.652935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ffcee5bd-dc15-4f7c-a40a-0ac93b97b75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:34:03.660812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1088/2158] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:34:03.665185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f01d5-f946-4838-8750-fd207a70993f None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:34:03.675146 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f01d5-f946-4838-8750-fd207a70993f None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:34:03.680186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db64187-af98-40f2-aaa7-840a4abf1667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:34:03.680804 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db64187-af98-40f2-aaa7-840a4abf1667 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:03.681134 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db64187-af98-40f2-aaa7-840a4abf1667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:03.681373 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db64187-af98-40f2-aaa7-840a4abf1667 admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:03.682029 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db64187-af98-40f2-aaa7-840a4abf1667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:34:03.682330 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db64187-af98-40f2-aaa7-840a4abf1667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:34:03.684018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db64187-af98-40f2-aaa7-840a4abf1667 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:34:03.696358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1071/2159] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:34:03.701222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcee5bd-dc15-4f7c-a40a-0ac93b97b75d None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:34:03.711058 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcee5bd-dc15-4f7c-a40a-0ac93b97b75d None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:34:03.716461 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9da18-553c-42d0-9cc4-5ca70ff7709a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:34:03.717113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9da18-553c-42d0-9cc4-5ca70ff7709a admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:03.717384 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9da18-553c-42d0-9cc4-5ca70ff7709a admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:03.717649 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9da18-553c-42d0-9cc4-5ca70ff7709a admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:03.718285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9da18-553c-42d0-9cc4-5ca70ff7709a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:34:03.720269 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9da18-553c-42d0-9cc4-5ca70ff7709a admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:34:03.753827 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1089/2160] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:34:03 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:34:03.758288 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db64187-af98-40f2-aaa7-840a4abf1667 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:34:03.769151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db64187-af98-40f2-aaa7-840a4abf1667 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:34:03.789340 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:34:03.829026 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f26348-ba3e-46c1-9a40-880fae77346b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:34:03.829641 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f26348-ba3e-46c1-9a40-880fae77346b admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:03.829951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f26348-ba3e-46c1-9a40-880fae77346b admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:03.830218 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f26348-ba3e-46c1-9a40-880fae77346b admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:03.830847 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f26348-ba3e-46c1-9a40-880fae77346b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:34:03.833060 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f26348-ba3e-46c1-9a40-880fae77346b admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:34:03.855743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1072/2161] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:34:03 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:34:03.860118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9da18-553c-42d0-9cc4-5ca70ff7709a admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:34:03.872152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9da18-553c-42d0-9cc4-5ca70ff7709a admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:34:03.880058 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cf47b-7410-4728-a781-f84abf7965d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:34:03.880852 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cf47b-7410-4728-a781-f84abf7965d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:03.881085 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cf47b-7410-4728-a781-f84abf7965d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:03.881349 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cf47b-7410-4728-a781-f84abf7965d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:03.882024 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4cf47b-7410-4728-a781-f84abf7965d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:34:03.883676 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4cf47b-7410-4728-a781-f84abf7965d3 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:34:03.895786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1090/2162] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:34:03.899719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f26348-ba3e-46c1-9a40-880fae77346b admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:34:03.911436 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f26348-ba3e-46c1-9a40-880fae77346b admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:34:03.917070 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384ec3d-de1c-4038-9c9a-f2d94b5f52b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:34:03.917626 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384ec3d-de1c-4038-9c9a-f2d94b5f52b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:03.917994 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384ec3d-de1c-4038-9c9a-f2d94b5f52b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:03.918262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384ec3d-de1c-4038-9c9a-f2d94b5f52b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:03.918916 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384ec3d-de1c-4038-9c9a-f2d94b5f52b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:34:03.920564 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384ec3d-de1c-4038-9c9a-f2d94b5f52b7 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:34:03.931346 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1073/2163] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:34:03.935632 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cf47b-7410-4728-a781-f84abf7965d3 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:34:03.946325 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cf47b-7410-4728-a781-f84abf7965d3 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:34:03.951056 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de0f87-758b-4e5f-ad89-2d651fa6eeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:34:03.951721 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de0f87-758b-4e5f-ad89-2d651fa6eeb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:03.952000 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de0f87-758b-4e5f-ad89-2d651fa6eeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:03.952297 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de0f87-758b-4e5f-ad89-2d651fa6eeb2 admin admin] PATH_INFO: `/v3/projects/413fccbc5312458393bfc82436831441/users/a3cb278f27474c83ad2059bb3914fd5d/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:03.964897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:34:03.968209 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de0f87-758b-4e5f-ad89-2d651fa6eeb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=413fccbc5312458393bfc82436831441, user_id=a3cb278f27474c83ad2059bb3914fd5d, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:34:03.971717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de0f87-758b-4e5f-ad89-2d651fa6eeb2 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:34:04.004563 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1091/2164] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:34:03 2022] PUT /identity/v3/projects/413fccbc5312458393bfc82436831441/users/a3cb278f27474c83ad2059bb3914fd5d/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:34:04.009857 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce49ce0-be8c-436d-ad12-3acce5dad220 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:04.010143 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce49ce0-be8c-436d-ad12-3acce5dad220 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:04.010431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce49ce0-be8c-436d-ad12-3acce5dad220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:04.032850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-7ce49ce0-be8c-436d-ad12-3acce5dad220 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:34:04.034212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-7ce49ce0-be8c-436d-ad12-3acce5dad220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:34:04.104494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1074/2165] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:34:04.114530 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de0f87-758b-4e5f-ad89-2d651fa6eeb2 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:34:04.116414 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-55de0f87-758b-4e5f-ad89-2d651fa6eeb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:34:04.176190 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de0f87-758b-4e5f-ad89-2d651fa6eeb2 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:34:04.180941 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dba758-80c9-4f0e-8276-3821f3d5b62b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:34:04.181615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dba758-80c9-4f0e-8276-3821f3d5b62b service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:04.181873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dba758-80c9-4f0e-8276-3821f3d5b62b service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:04.182151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dba758-80c9-4f0e-8276-3821f3d5b62b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:04.193082 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dba758-80c9-4f0e-8276-3821f3d5b62b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:34:04.194649 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dba758-80c9-4f0e-8276-3821f3d5b62b service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:34:04.204837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1092/2166] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:34:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:34:08.996123 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e2447-6225-42b9-b52b-5ec04bcb4cf8 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:08.996722 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e2447-6225-42b9-b52b-5ec04bcb4cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:08.997175 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e2447-6225-42b9-b52b-5ec04bcb4cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:09.052765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-f87e2447-6225-42b9-b52b-5ec04bcb4cf8 None None] MFA Rules not processed for user `a3cb278f27474c83ad2059bb3914fd5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:34:09.054122 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f87e2447-6225-42b9-b52b-5ec04bcb4cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:34:09.160956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1075/2167] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:34:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:34:09.165468 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dba758-80c9-4f0e-8276-3821f3d5b62b service neutron] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:34:09.178586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dba758-80c9-4f0e-8276-3821f3d5b62b service neutron] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:34:09.184609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3e184-ce6e-420f-8b91-b903610b2740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:34:09.185367 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3e184-ce6e-420f-8b91-b903610b2740 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:09.185739 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3e184-ce6e-420f-8b91-b903610b2740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:09.186180 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3e184-ce6e-420f-8b91-b903610b2740 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:09.186922 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3e184-ce6e-420f-8b91-b903610b2740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:34:09.189125 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3e184-ce6e-420f-8b91-b903610b2740 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:34:09.222111 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1093/2168] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:34:09 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:34:09.227144 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e2447-6225-42b9-b52b-5ec04bcb4cf8 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:34:09.239848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e2447-6225-42b9-b52b-5ec04bcb4cf8 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:34:09.275410 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:34:09.331402 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d60b18-72a7-4aeb-bca9-4fa3303fa711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:34:09.332197 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d60b18-72a7-4aeb-bca9-4fa3303fa711 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:09.332297 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d60b18-72a7-4aeb-bca9-4fa3303fa711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:09.332558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d60b18-72a7-4aeb-bca9-4fa3303fa711 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:09.333271 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d60b18-72a7-4aeb-bca9-4fa3303fa711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:34:09.335275 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d60b18-72a7-4aeb-bca9-4fa3303fa711 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:34:09.365517 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1076/2169] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:34:09 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:34:09.379591 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3e184-ce6e-420f-8b91-b903610b2740 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:34:09.394895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3e184-ce6e-420f-8b91-b903610b2740 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:34:09.411058 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ad047-632d-400f-aff6-768acfb40a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:34:09.412024 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ad047-632d-400f-aff6-768acfb40a8c admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:09.412596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ad047-632d-400f-aff6-768acfb40a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:09.413129 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ad047-632d-400f-aff6-768acfb40a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:09.413952 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ad047-632d-400f-aff6-768acfb40a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:34:09.416776 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ad047-632d-400f-aff6-768acfb40a8c admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:34:09.450513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1094/2170] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:34:09.454955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d60b18-72a7-4aeb-bca9-4fa3303fa711 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:34:09.471477 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d60b18-72a7-4aeb-bca9-4fa3303fa711 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:34:09.491440 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee3523-57e2-4faf-9cdc-6e0a90ec519f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:34:09.494474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee3523-57e2-4faf-9cdc-6e0a90ec519f admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:09.495021 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee3523-57e2-4faf-9cdc-6e0a90ec519f admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:09.495251 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee3523-57e2-4faf-9cdc-6e0a90ec519f admin admin] PATH_INFO: `/v3/projects/f60ff330edd54bffb342a6520a32b00d/users/c137cc1e3813484eb996c96bffa15c9d/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:09.525131 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee3523-57e2-4faf-9cdc-6e0a90ec519f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60ff330edd54bffb342a6520a32b00d, user_id=c137cc1e3813484eb996c96bffa15c9d, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:34:09.527929 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee3523-57e2-4faf-9cdc-6e0a90ec519f admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:34:09.549471 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1077/2171] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:34:09 2022] PUT /identity/v3/projects/f60ff330edd54bffb342a6520a32b00d/users/c137cc1e3813484eb996c96bffa15c9d/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:34:09.554494 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ad047-632d-400f-aff6-768acfb40a8c admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:34:09.565680 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ad047-632d-400f-aff6-768acfb40a8c admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:34:09.635863 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52f6a9-8d53-4926-848b-63a4064cadc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:34:09.636883 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52f6a9-8d53-4926-848b-63a4064cadc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:09.637263 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52f6a9-8d53-4926-848b-63a4064cadc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:09.637943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52f6a9-8d53-4926-848b-63a4064cadc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:09.638830 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52f6a9-8d53-4926-848b-63a4064cadc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:34:09.641049 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52f6a9-8d53-4926-848b-63a4064cadc2 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:34:09.668321 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1095/2172] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:34:09.669657 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee3523-57e2-4faf-9cdc-6e0a90ec519f admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:34:09.684140 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee3523-57e2-4faf-9cdc-6e0a90ec519f admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:34:09.697099 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a1596-359d-476d-a15b-6de33197e1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:34:09.697925 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a1596-359d-476d-a15b-6de33197e1d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:09.698341 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a1596-359d-476d-a15b-6de33197e1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:09.698705 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a1596-359d-476d-a15b-6de33197e1d5 admin admin] PATH_INFO: `/v3/projects/f60ff330edd54bffb342a6520a32b00d/users/c137cc1e3813484eb996c96bffa15c9d/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:09.701162 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a1596-359d-476d-a15b-6de33197e1d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60ff330edd54bffb342a6520a32b00d, user_id=c137cc1e3813484eb996c96bffa15c9d, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:34:09.711051 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a1596-359d-476d-a15b-6de33197e1d5 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:34:09.737278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1078/2173] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:34:09 2022] PUT /identity/v3/projects/f60ff330edd54bffb342a6520a32b00d/users/c137cc1e3813484eb996c96bffa15c9d/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:34:15.282946 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bc5ce-c142-49b5-ac51-99c233be7c75 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:15.283463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bc5ce-c142-49b5-ac51-99c233be7c75 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:15.283565 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bc5ce-c142-49b5-ac51-99c233be7c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:15.313721 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-334bc5ce-c142-49b5-ac51-99c233be7c75 None None] MFA Rules not processed for user `c137cc1e3813484eb996c96bffa15c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:34:15.314927 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-334bc5ce-c142-49b5-ac51-99c233be7c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:34:15.369724 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:34:15.411942 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1096/2174] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:34:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:34:15.426498 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a1596-359d-476d-a15b-6de33197e1d5 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:34:15.428247 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-336a1596-359d-476d-a15b-6de33197e1d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:34:15.516159 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a1596-359d-476d-a15b-6de33197e1d5 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:34:15.523142 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f9871-d187-40ae-8ffe-0d92782878d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:34:15.523788 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f9871-d187-40ae-8ffe-0d92782878d3 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:15.524062 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f9871-d187-40ae-8ffe-0d92782878d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:15.524327 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f9871-d187-40ae-8ffe-0d92782878d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:15.589704 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f9871-d187-40ae-8ffe-0d92782878d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:34:15.591634 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f9871-d187-40ae-8ffe-0d92782878d3 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:34:15.604441 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1079/2175] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:34:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:34:16.833808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ee504-df45-4b92-962a-66d1eae7fa14 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:16.834281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ee504-df45-4b92-962a-66d1eae7fa14 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:16.834370 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ee504-df45-4b92-962a-66d1eae7fa14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:16.854893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-1c7ee504-df45-4b92-962a-66d1eae7fa14 None None] MFA Rules not processed for user `a3cb278f27474c83ad2059bb3914fd5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:34:16.856937 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-1c7ee504-df45-4b92-962a-66d1eae7fa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:34:16.865615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1097/2176] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:34:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:34:20.303178 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2eb4f1-8449-4188-a713-d46b2c45472b None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:20.304057 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2eb4f1-8449-4188-a713-d46b2c45472b None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:20.304057 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2eb4f1-8449-4188-a713-d46b2c45472b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:20.338144 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-ac2eb4f1-8449-4188-a713-d46b2c45472b None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:34:20.340016 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ac2eb4f1-8449-4188-a713-d46b2c45472b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:34:20.361860 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:34:20.413420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1080/2177] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Oct 4 16:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:34:20.442732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ee504-df45-4b92-962a-66d1eae7fa14 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:34:20.456498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ee504-df45-4b92-962a-66d1eae7fa14 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:34:20.462581 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9768bce-a21b-4221-8f3a-dad2cdb5c0e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:34:20.463211 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9768bce-a21b-4221-8f3a-dad2cdb5c0e2 service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:20.463498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9768bce-a21b-4221-8f3a-dad2cdb5c0e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:20.463768 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9768bce-a21b-4221-8f3a-dad2cdb5c0e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:20.472208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9768bce-a21b-4221-8f3a-dad2cdb5c0e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:34:20.473791 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9768bce-a21b-4221-8f3a-dad2cdb5c0e2 service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:34:20.483389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1098/2178] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:34:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:34:26.357082 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d04a0b-e8b4-44ee-a042-a757148d8f58 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:26.357558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d04a0b-e8b4-44ee-a042-a757148d8f58 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:26.357663 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d04a0b-e8b4-44ee-a042-a757148d8f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:26.380208 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-a6d04a0b-e8b4-44ee-a042-a757148d8f58 None None] MFA Rules not processed for user `06aca6bb76ec4290b591d9c7a5a6c5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:34:26.381475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a6d04a0b-e8b4-44ee-a042-a757148d8f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:34:26.439775 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1081/2179] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:34:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:34:27.462804 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1f28f-fab0-4eed-ac2d-9e04ebd1cbfa None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:27.463239 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1f28f-fab0-4eed-ac2d-9e04ebd1cbfa None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:27.463586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1f28f-fab0-4eed-ac2d-9e04ebd1cbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:27.486044 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-01f1f28f-fab0-4eed-ac2d-9e04ebd1cbfa None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:34:27.487282 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-01f1f28f-fab0-4eed-ac2d-9e04ebd1cbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:34:27.495945 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1099/2180] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Oct 4 16:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:34:28.318508 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d04a0b-e8b4-44ee-a042-a757148d8f58 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:34:28.332901 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d04a0b-e8b4-44ee-a042-a757148d8f58 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:34:28.338625 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757fe36a-17c3-44d0-adeb-f4356fe20e18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:34:28.339401 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757fe36a-17c3-44d0-adeb-f4356fe20e18 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:28.339608 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757fe36a-17c3-44d0-adeb-f4356fe20e18 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:28.339875 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757fe36a-17c3-44d0-adeb-f4356fe20e18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:28.350803 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757fe36a-17c3-44d0-adeb-f4356fe20e18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:34:28.352865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757fe36a-17c3-44d0-adeb-f4356fe20e18 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:34:28.364602 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1082/2181] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:34:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:34:32.012555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d9ecf-ebcc-4427-8106-56217db89ae2 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:32.013121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d9ecf-ebcc-4427-8106-56217db89ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:32.013121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d9ecf-ebcc-4427-8106-56217db89ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:32.038208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-770d9ecf-ebcc-4427-8106-56217db89ae2 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:34:32.039643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-770d9ecf-ebcc-4427-8106-56217db89ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:34:32.049363 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1100/2182] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Oct 4 16:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:34:32.074834 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757fe36a-17c3-44d0-adeb-f4356fe20e18 service nova] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:34:32.088022 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757fe36a-17c3-44d0-adeb-f4356fe20e18 service nova] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:34:32.094772 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d45d95-52d9-4b11-8e16-4d7c4f52cb03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:34:32.095704 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d45d95-52d9-4b11-8e16-4d7c4f52cb03 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:32.096167 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d45d95-52d9-4b11-8e16-4d7c4f52cb03 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:32.096680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d45d95-52d9-4b11-8e16-4d7c4f52cb03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:32.106187 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d45d95-52d9-4b11-8e16-4d7c4f52cb03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:34:32.107907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d45d95-52d9-4b11-8e16-4d7c4f52cb03 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:34:32.118046 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1083/2183] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:34:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:34:34.874077 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f784a1-445d-4227-8cc2-89a416a17b70 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:34.874605 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f784a1-445d-4227-8cc2-89a416a17b70 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:34.874711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f784a1-445d-4227-8cc2-89a416a17b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:34.895835 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-42f784a1-445d-4227-8cc2-89a416a17b70 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:34:34.897292 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-42f784a1-445d-4227-8cc2-89a416a17b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:34:34.909758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1101/2184] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Oct 4 16:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:34:34.943568 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d45d95-52d9-4b11-8e16-4d7c4f52cb03 service nova] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:34:34.966319 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d45d95-52d9-4b11-8e16-4d7c4f52cb03 service nova] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:34:34.972500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612455d-4ec9-40bd-aa83-9a3b664fa3b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:34:34.973279 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612455d-4ec9-40bd-aa83-9a3b664fa3b8 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:34.973704 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612455d-4ec9-40bd-aa83-9a3b664fa3b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:34.974057 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612455d-4ec9-40bd-aa83-9a3b664fa3b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:34.983551 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612455d-4ec9-40bd-aa83-9a3b664fa3b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:34:34.985139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612455d-4ec9-40bd-aa83-9a3b664fa3b8 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:34:34.995052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1084/2185] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:34:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:34:38.291777 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f784a1-445d-4227-8cc2-89a416a17b70 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:34:38.293448 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-42f784a1-445d-4227-8cc2-89a416a17b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:34:38.305945 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f784a1-445d-4227-8cc2-89a416a17b70 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:34:38.311861 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77461aac-2c15-4013-8244-5d540e82644b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:34:38.312480 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77461aac-2c15-4013-8244-5d540e82644b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:38.312755 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77461aac-2c15-4013-8244-5d540e82644b admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:38.312994 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77461aac-2c15-4013-8244-5d540e82644b admin admin] PATH_INFO: `/v3/users/69cf46af4df14f0aaf747c179f60302d` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:38.314293 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77461aac-2c15-4013-8244-5d540e82644b admin admin] RBAC: Authorizing `identity:delete_user(user_id=69cf46af4df14f0aaf747c179f60302d)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:34:38.316273 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77461aac-2c15-4013-8244-5d540e82644b admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:34:38.374810 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-77461aac-2c15-4013-8244-5d540e82644b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69cf46af4df14f0aaf747c179f60302d'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:34:38.375579 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-77461aac-2c15-4013-8244-5d540e82644b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69cf46af4df14f0aaf747c179f60302d'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:34:38.382916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-77461aac-2c15-4013-8244-5d540e82644b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69cf46af4df14f0aaf747c179f60302d'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:34:38.393347 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-77461aac-2c15-4013-8244-5d540e82644b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69cf46af4df14f0aaf747c179f60302d'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:34:38.394063 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-77461aac-2c15-4013-8244-5d540e82644b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69cf46af4df14f0aaf747c179f60302d'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:34:38.412320 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1102/2186] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:34:38 2022] DELETE /identity/v3/users/69cf46af4df14f0aaf747c179f60302d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:34:38.417096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b2d6c-27e6-4661-a6d3-7c221533b32e None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:38.417580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b2d6c-27e6-4661-a6d3-7c221533b32e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:38.417674 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b2d6c-27e6-4661-a6d3-7c221533b32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:38.437465 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-126b2d6c-27e6-4661-a6d3-7c221533b32e None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:34:38.438675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-126b2d6c-27e6-4661-a6d3-7c221533b32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:34:38.500359 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1085/2187] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:34:38.511642 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77461aac-2c15-4013-8244-5d540e82644b admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:34:38.513271 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-77461aac-2c15-4013-8244-5d540e82644b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:34:38.590581 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77461aac-2c15-4013-8244-5d540e82644b admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:34:38.594378 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe616c0d-8da8-4f09-9eb1-fb1f6af406df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:34:38.595069 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe616c0d-8da8-4f09-9eb1-fb1f6af406df service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:38.595298 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe616c0d-8da8-4f09-9eb1-fb1f6af406df service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:38.595566 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe616c0d-8da8-4f09-9eb1-fb1f6af406df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:38.604954 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe616c0d-8da8-4f09-9eb1-fb1f6af406df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:34:38.606412 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe616c0d-8da8-4f09-9eb1-fb1f6af406df service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:34:38.616067 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1103/2188] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:34:39.220321 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b2d6c-27e6-4661-a6d3-7c221533b32e None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:34:39.222068 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-126b2d6c-27e6-4661-a6d3-7c221533b32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:34:39.234254 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b2d6c-27e6-4661-a6d3-7c221533b32e None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:34:39.239408 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552d0b1-1f07-4bd1-83c9-da9429f6b381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:34:39.240053 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552d0b1-1f07-4bd1-83c9-da9429f6b381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:39.240290 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552d0b1-1f07-4bd1-83c9-da9429f6b381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:39.240593 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552d0b1-1f07-4bd1-83c9-da9429f6b381 admin admin] PATH_INFO: `/v3/projects/092cc00631e649b2b9f67e1dd1dea003` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:39.241710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552d0b1-1f07-4bd1-83c9-da9429f6b381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=092cc00631e649b2b9f67e1dd1dea003)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:34:39.243691 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552d0b1-1f07-4bd1-83c9-da9429f6b381 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:34:39.270142 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:34:39.293596 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-5552d0b1-1f07-4bd1-83c9-da9429f6b381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '092cc00631e649b2b9f67e1dd1dea003', 'request_id': 'req-5552d0b1-1f07-4bd1-83c9-da9429f6b381'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:34:39.303171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-5552d0b1-1f07-4bd1-83c9-da9429f6b381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '092cc00631e649b2b9f67e1dd1dea003', 'request_id': 'req-5552d0b1-1f07-4bd1-83c9-da9429f6b381'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:34:39.310106 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-5552d0b1-1f07-4bd1-83c9-da9429f6b381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '092cc00631e649b2b9f67e1dd1dea003', 'request_id': 'req-5552d0b1-1f07-4bd1-83c9-da9429f6b381'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:34:39.321126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-5552d0b1-1f07-4bd1-83c9-da9429f6b381 admin admin] The token cache is being invalidate because project 092cc00631e649b2b9f67e1dd1dea003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:34:39.321412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-5552d0b1-1f07-4bd1-83c9-da9429f6b381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:34:39.322099 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-5552d0b1-1f07-4bd1-83c9-da9429f6b381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:34:39.323735 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1086/2189] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:34:39 2022] DELETE /identity/v3/projects/092cc00631e649b2b9f67e1dd1dea003 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:34:40.118227 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707b36b-8f9c-474a-a477-d94f8916d207 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:40.119137 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707b36b-8f9c-474a-a477-d94f8916d207 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:40.119471 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707b36b-8f9c-474a-a477-d94f8916d207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:40.152655 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-b707b36b-8f9c-474a-a477-d94f8916d207 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:34:40.153856 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b707b36b-8f9c-474a-a477-d94f8916d207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:34:40.167539 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:34:40.220698 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1104/2190] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Oct 4 16:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:34:40.399218 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552d0b1-1f07-4bd1-83c9-da9429f6b381 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:34:40.400979 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-5552d0b1-1f07-4bd1-83c9-da9429f6b381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:34:40.477141 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552d0b1-1f07-4bd1-83c9-da9429f6b381 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:34:40.484294 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765f121-c37b-411f-b6d6-3f3ad5a43567 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:34:40.484908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765f121-c37b-411f-b6d6-3f3ad5a43567 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:40.485182 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765f121-c37b-411f-b6d6-3f3ad5a43567 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:40.485445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765f121-c37b-411f-b6d6-3f3ad5a43567 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:40.495518 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b765f121-c37b-411f-b6d6-3f3ad5a43567 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:34:40.495518 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b765f121-c37b-411f-b6d6-3f3ad5a43567 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:34:40.506741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1087/2191] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:34:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:34:45.389961 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcbb08-234b-4ed9-93bd-c6b860c87f77 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:45.390514 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcbb08-234b-4ed9-93bd-c6b860c87f77 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:45.390514 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcbb08-234b-4ed9-93bd-c6b860c87f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:45.413364 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-e2bcbb08-234b-4ed9-93bd-c6b860c87f77 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:34:45.414588 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-e2bcbb08-234b-4ed9-93bd-c6b860c87f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:34:45.423140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1105/2192] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Oct 4 16:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:34:45.456792 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765f121-c37b-411f-b6d6-3f3ad5a43567 service nova] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:34:45.470532 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765f121-c37b-411f-b6d6-3f3ad5a43567 service nova] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:34:45.477270 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b1808-62da-48c4-ad32-3b150fc23350 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:34:45.477892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b1808-62da-48c4-ad32-3b150fc23350 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:34:45.478169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b1808-62da-48c4-ad32-3b150fc23350 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:34:45.478438 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b1808-62da-48c4-ad32-3b150fc23350 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:34:45.486960 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b1808-62da-48c4-ad32-3b150fc23350 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:34:45.488575 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b1808-62da-48c4-ad32-3b150fc23350 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:34:45.498179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1088/2193] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:34:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:34:55.407706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=22 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:34:55.493879 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=55,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:35:04.323796 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f3f93-47a5-4313-88eb-18cad29acb0b None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:35:04.324310 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f3f93-47a5-4313-88eb-18cad29acb0b None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:35:04.324310 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f3f93-47a5-4313-88eb-18cad29acb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:35:04.345988 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-a67f3f93-47a5-4313-88eb-18cad29acb0b None None] MFA Rules not processed for user `1162a7b971974650baa2c1bdea03dfc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:35:04.347222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-a67f3f93-47a5-4313-88eb-18cad29acb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:35:04.413151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1106/2194] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:35:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:35:06.704367 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b1808-62da-48c4-ad32-3b150fc23350 service nova] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:35:06.706201 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ea5b1808-62da-48c4-ad32-3b150fc23350 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:35:06.769684 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b1808-62da-48c4-ad32-3b150fc23350 service nova] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:35:06.773686 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4711665-5858-4e89-9e3e-9420520e2b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:35:06.774300 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4711665-5858-4e89-9e3e-9420520e2b35 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:35:06.774646 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4711665-5858-4e89-9e3e-9420520e2b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:35:06.774873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4711665-5858-4e89-9e3e-9420520e2b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:35:06.776807 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a4711665-5858-4e89-9e3e-9420520e2b35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:35:06.849244 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4711665-5858-4e89-9e3e-9420520e2b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:35:06.850814 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4711665-5858-4e89-9e3e-9420520e2b35 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:35:06.860677 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1089/2195] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:35:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:35:14.405114 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=25 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:35:16.856813 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=50 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:35:18.442145 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22347efa-2941-4a73-897d-cfc21cdf6275 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:35:18.442717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22347efa-2941-4a73-897d-cfc21cdf6275 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:35:18.442717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22347efa-2941-4a73-897d-cfc21cdf6275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:35:18.462602 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-22347efa-2941-4a73-897d-cfc21cdf6275 None None] MFA Rules not processed for user `05cfc9d62a244701a5df524d1c26f107`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:35:18.464434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-22347efa-2941-4a73-897d-cfc21cdf6275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:35:18.523592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1107/2196] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Oct 4 16:35:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:35:18.566274 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4711665-5858-4e89-9e3e-9420520e2b35 service neutron] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:35:18.567862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a4711665-5858-4e89-9e3e-9420520e2b35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:35:18.640073 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4711665-5858-4e89-9e3e-9420520e2b35 service neutron] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:35:18.645740 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb03f5-45cc-41b1-baa3-ff5dd3edb662 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6590cb6c1c964039b9dea771a647bdac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:35:18.646354 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb03f5-45cc-41b1-baa3-ff5dd3edb662 service swift] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:35:18.646624 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb03f5-45cc-41b1-baa3-ff5dd3edb662 service swift] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:35:18.646887 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb03f5-45cc-41b1-baa3-ff5dd3edb662 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:35:18.655102 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb03f5-45cc-41b1-baa3-ff5dd3edb662 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:35:18.656732 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb03f5-45cc-41b1-baa3-ff5dd3edb662 service swift] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:35:18.665295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1090/2197] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Oct 4 16:35:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 16:35:22.368237 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22347efa-2941-4a73-897d-cfc21cdf6275 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:35:22.369825 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-22347efa-2941-4a73-897d-cfc21cdf6275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:35:22.539198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22347efa-2941-4a73-897d-cfc21cdf6275 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:35:22.548103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf1f45-2b86-45f9-ba07-8a1221fdceb5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd59eac06e347ee9432185b24fdf773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:35:22.560038 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf1f45-2b86-45f9-ba07-8a1221fdceb5 service placement] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:35:22.560578 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf1f45-2b86-45f9-ba07-8a1221fdceb5 service placement] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:35:22.561018 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf1f45-2b86-45f9-ba07-8a1221fdceb5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:35:22.563283 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-bbaf1f45-2b86-45f9-ba07-8a1221fdceb5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:35:22.582325 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf1f45-2b86-45f9-ba07-8a1221fdceb5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:35:22.584517 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf1f45-2b86-45f9-ba07-8a1221fdceb5 service placement] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:35:22.619272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1108/2198] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:35:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:35:23.372518 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebd958-a5a2-4105-b578-9c8d2caf3ef5 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:35:23.373098 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebd958-a5a2-4105-b578-9c8d2caf3ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:35:23.373098 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebd958-a5a2-4105-b578-9c8d2caf3ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:35:23.403932 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-c6ebd958-a5a2-4105-b578-9c8d2caf3ef5 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:35:23.405571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c6ebd958-a5a2-4105-b578-9c8d2caf3ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:35:23.422202 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1091/2199] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Oct 4 16:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:35:23.695170 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf1f45-2b86-45f9-ba07-8a1221fdceb5 service placement] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:35:23.715540 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf1f45-2b86-45f9-ba07-8a1221fdceb5 service placement] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:35:23.735389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f7a62-cdb9-465f-9f0b-b4135a2ba1df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:35:23.736322 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f7a62-cdb9-465f-9f0b-b4135a2ba1df service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:35:23.736765 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f7a62-cdb9-465f-9f0b-b4135a2ba1df service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:35:23.737186 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f7a62-cdb9-465f-9f0b-b4135a2ba1df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:35:23.746297 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f7a62-cdb9-465f-9f0b-b4135a2ba1df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:35:23.748107 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f7a62-cdb9-465f-9f0b-b4135a2ba1df service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:35:23.760688 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1109/2200] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:35:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:35:26.723144 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dce503-ad26-4537-b157-443a58c3dd85 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:35:26.723747 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dce503-ad26-4537-b157-443a58c3dd85 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:35:26.723747 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dce503-ad26-4537-b157-443a58c3dd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:35:26.748300 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-56dce503-ad26-4537-b157-443a58c3dd85 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:35:26.750022 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-56dce503-ad26-4537-b157-443a58c3dd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:35:26.761684 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1092/2201] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Oct 4 16:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:35:26.837817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f7a62-cdb9-465f-9f0b-b4135a2ba1df service nova] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:35:26.859600 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f7a62-cdb9-465f-9f0b-b4135a2ba1df service nova] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:35:26.868202 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ea122-2eeb-45ab-b9fa-1ad2f5d8c333 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:35:26.871692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ea122-2eeb-45ab-b9fa-1ad2f5d8c333 service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:35:26.872154 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ea122-2eeb-45ab-b9fa-1ad2f5d8c333 service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:35:26.873520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ea122-2eeb-45ab-b9fa-1ad2f5d8c333 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:35:26.884005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ea122-2eeb-45ab-b9fa-1ad2f5d8c333 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:35:26.885833 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ea122-2eeb-45ab-b9fa-1ad2f5d8c333 service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:35:26.901204 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1110/2202] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:35:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:35:27.287750 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a255b6-4d1e-4fd8-9dfe-fa140a1d1904 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:35:27.288045 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a255b6-4d1e-4fd8-9dfe-fa140a1d1904 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:35:27.288309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a255b6-4d1e-4fd8-9dfe-fa140a1d1904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:35:27.307999 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-86a255b6-4d1e-4fd8-9dfe-fa140a1d1904 None None] MFA Rules not processed for user `fd7782e68436445395dd49bf7d8302e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:35:27.309607 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-86a255b6-4d1e-4fd8-9dfe-fa140a1d1904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:35:27.379042 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1093/2203] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:35:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:35:29.800068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fa851-a560-40b6-acb3-b25eb7606fdf None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:35:29.800586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fa851-a560-40b6-acb3-b25eb7606fdf None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:35:29.800734 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fa851-a560-40b6-acb3-b25eb7606fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:35:29.820722 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-ee2fa851-a560-40b6-acb3-b25eb7606fdf None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:35:29.822022 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ee2fa851-a560-40b6-acb3-b25eb7606fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:35:29.830103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1111/2204] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Oct 4 16:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:35:29.944165 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a255b6-4d1e-4fd8-9dfe-fa140a1d1904 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:35:29.958530 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a255b6-4d1e-4fd8-9dfe-fa140a1d1904 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:35:29.964439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b66e22-d983-406c-956e-f9ad98ec358f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:35:29.965083 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b66e22-d983-406c-956e-f9ad98ec358f service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:35:29.965359 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b66e22-d983-406c-956e-f9ad98ec358f service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:35:29.965628 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b66e22-d983-406c-956e-f9ad98ec358f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:35:29.975257 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b66e22-d983-406c-956e-f9ad98ec358f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:35:29.977229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b66e22-d983-406c-956e-f9ad98ec358f service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:35:29.987565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1094/2205] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:35:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:35:34.024280 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7e848-4bad-4870-8c82-4e157e8304bd None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:35:34.024790 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7e848-4bad-4870-8c82-4e157e8304bd None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:35:34.024790 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7e848-4bad-4870-8c82-4e157e8304bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:35:34.046098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-38c7e848-4bad-4870-8c82-4e157e8304bd None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:35:34.047386 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-38c7e848-4bad-4870-8c82-4e157e8304bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:35:34.056738 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1112/2206] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Oct 4 16:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:35:34.087186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b66e22-d983-406c-956e-f9ad98ec358f service nova] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:35:34.102539 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b66e22-d983-406c-956e-f9ad98ec358f service nova] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:35:34.109502 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a7e56-2059-420d-b1e4-2acd9360ee0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:35:34.110098 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a7e56-2059-420d-b1e4-2acd9360ee0c service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:35:34.110373 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a7e56-2059-420d-b1e4-2acd9360ee0c service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:35:34.110634 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a7e56-2059-420d-b1e4-2acd9360ee0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:35:34.119310 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a7e56-2059-420d-b1e4-2acd9360ee0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:35:34.120884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a7e56-2059-420d-b1e4-2acd9360ee0c service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:35:34.130596 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1095/2207] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:35:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:35:37.670486 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab91ee-4ae5-4084-94d8-8a7774276127 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:35:37.670917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab91ee-4ae5-4084-94d8-8a7774276127 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:35:37.671437 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab91ee-4ae5-4084-94d8-8a7774276127 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:35:37.672879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1113/2208] 10.222.0.55 () {54 vars in 921 bytes} [Tue Oct 4 16:35:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:35:37.679735 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77458f67-9180-406a-9377-74dea6049390 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:35:37.680258 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77458f67-9180-406a-9377-74dea6049390 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:35:37.680258 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77458f67-9180-406a-9377-74dea6049390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:35:37.703005 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-77458f67-9180-406a-9377-74dea6049390 None None] MFA Rules not processed for user `6cdee0584fe045028a44c385d032d2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:35:37.705041 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-77458f67-9180-406a-9377-74dea6049390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:35:37.718580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1096/2209] 10.222.0.55 () {58 vars in 1018 bytes} [Tue Oct 4 16:35:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:35:37.731250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab91ee-4ae5-4084-94d8-8a7774276127 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:35:37.733361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-1dab91ee-4ae5-4084-94d8-8a7774276127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:35:37.800888 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab91ee-4ae5-4084-94d8-8a7774276127 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:35:37.804488 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc876e6e-d9b3-4187-8952-de1c232665ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74b3e45a14bd4b539974e9e5e278ee62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:35:37.805104 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc876e6e-d9b3-4187-8952-de1c232665ad service glance] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:35:37.805380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc876e6e-d9b3-4187-8952-de1c232665ad service glance] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:35:37.805669 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc876e6e-d9b3-4187-8952-de1c232665ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:35:37.817172 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc876e6e-d9b3-4187-8952-de1c232665ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:35:37.818744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc876e6e-d9b3-4187-8952-de1c232665ad service glance] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:35:37.823777 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:35:37.833777 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1114/2210] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:35:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:35:37.907658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc38be1-d3d6-43d3-a21a-d1527186aa67 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:35:37.907862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc38be1-d3d6-43d3-a21a-d1527186aa67 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:35:37.908177 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc38be1-d3d6-43d3-a21a-d1527186aa67 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:35:37.909587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1097/2211] 10.222.0.55 () {54 vars in 921 bytes} [Tue Oct 4 16:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:35:37.916067 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38122220-38e1-4324-b3e2-a62dcd2dbebb None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:35:37.916393 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38122220-38e1-4324-b3e2-a62dcd2dbebb None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:35:37.916669 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38122220-38e1-4324-b3e2-a62dcd2dbebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:35:37.938141 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-38122220-38e1-4324-b3e2-a62dcd2dbebb None None] MFA Rules not processed for user `d6ae980afbfd49dea9bbb0adc02b9031`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:35:37.939438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-38122220-38e1-4324-b3e2-a62dcd2dbebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:35:37.948021 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1115/2212] 10.222.0.55 () {58 vars in 1018 bytes} [Tue Oct 4 16:35:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:35:37.962117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc38be1-d3d6-43d3-a21a-d1527186aa67 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:35:37.973532 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc38be1-d3d6-43d3-a21a-d1527186aa67 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:35:37.977263 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32077ab8-7f4c-4adb-ae53-ded247cdd977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:35:37.978012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32077ab8-7f4c-4adb-ae53-ded247cdd977 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:35:37.978326 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32077ab8-7f4c-4adb-ae53-ded247cdd977 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:35:37.978606 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32077ab8-7f4c-4adb-ae53-ded247cdd977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:35:37.985828 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32077ab8-7f4c-4adb-ae53-ded247cdd977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:35:37.987400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32077ab8-7f4c-4adb-ae53-ded247cdd977 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:35:37.995161 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1098/2213] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:35:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:35:38.089441 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093b543-d95c-4939-87b0-21b159aa61d5 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:35:38.089732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093b543-d95c-4939-87b0-21b159aa61d5 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:35:38.089972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093b543-d95c-4939-87b0-21b159aa61d5 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:35:38.091824 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1116/2214] 10.222.0.55 () {54 vars in 921 bytes} [Tue Oct 4 16:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:35:38.100917 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e91c38-46a9-43b6-a24f-fb426a3f6320 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:35:38.101298 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e91c38-46a9-43b6-a24f-fb426a3f6320 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:35:38.101693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e91c38-46a9-43b6-a24f-fb426a3f6320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:35:38.129958 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-19e91c38-46a9-43b6-a24f-fb426a3f6320 None None] MFA Rules not processed for user `6cdee0584fe045028a44c385d032d2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:35:38.131316 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-19e91c38-46a9-43b6-a24f-fb426a3f6320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:35:38.150753 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1099/2215] 10.222.0.55 () {58 vars in 1018 bytes} [Tue Oct 4 16:35:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:35:38.167718 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093b543-d95c-4939-87b0-21b159aa61d5 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:35:38.171608 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-2093b543-d95c-4939-87b0-21b159aa61d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:35:38.187156 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093b543-d95c-4939-87b0-21b159aa61d5 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:35:38.191265 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ab87e-f50b-482c-b4b7-8dbfc1df5aa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:35:38.191887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ab87e-f50b-482c-b4b7-8dbfc1df5aa8 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:35:38.192272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ab87e-f50b-482c-b4b7-8dbfc1df5aa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:35:38.192707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ab87e-f50b-482c-b4b7-8dbfc1df5aa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:35:38.204422 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ab87e-f50b-482c-b4b7-8dbfc1df5aa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:35:38.205875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ab87e-f50b-482c-b4b7-8dbfc1df5aa8 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:35:38.221268 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1117/2216] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:35:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:35:39.274765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a568a-482d-4f9e-a7a2-79fbcc0fb6bc None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:35:39.275291 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a568a-482d-4f9e-a7a2-79fbcc0fb6bc None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:35:39.275382 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a568a-482d-4f9e-a7a2-79fbcc0fb6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:35:39.296157 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-ac8a568a-482d-4f9e-a7a2-79fbcc0fb6bc None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:35:39.297320 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ac8a568a-482d-4f9e-a7a2-79fbcc0fb6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:35:39.305846 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1100/2217] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Oct 4 16:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:35:39.443622 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ab87e-f50b-482c-b4b7-8dbfc1df5aa8 service neutron] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:35:39.457416 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ab87e-f50b-482c-b4b7-8dbfc1df5aa8 service neutron] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:35:39.464616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8322cc-1f5d-4d1f-933f-182f793fb5cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:35:39.465292 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8322cc-1f5d-4d1f-933f-182f793fb5cb service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:35:39.465646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8322cc-1f5d-4d1f-933f-182f793fb5cb service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:35:39.465980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8322cc-1f5d-4d1f-933f-182f793fb5cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:35:39.475624 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8322cc-1f5d-4d1f-933f-182f793fb5cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:35:39.477393 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8322cc-1f5d-4d1f-933f-182f793fb5cb service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:35:39.489617 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1118/2218] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:35:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:35:49.291352 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=90 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:35:49.483923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=16 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:35:50.829616 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06feca66-6f51-4007-8f84-19cc43a2cb9e None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:35:50.830155 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06feca66-6f51-4007-8f84-19cc43a2cb9e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:35:50.830418 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06feca66-6f51-4007-8f84-19cc43a2cb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:35:50.858119 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-06feca66-6f51-4007-8f84-19cc43a2cb9e None None] MFA Rules not processed for user `05cfc9d62a244701a5df524d1c26f107`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:35:50.859381 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-06feca66-6f51-4007-8f84-19cc43a2cb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:35:50.867107 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1101/2219] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Oct 4 16:35:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:35:50.880928 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8322cc-1f5d-4d1f-933f-182f793fb5cb service nova] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:35:50.893450 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8322cc-1f5d-4d1f-933f-182f793fb5cb service nova] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:35:50.899584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7dcc8-3f1c-44cb-89b1-162628d4b41a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6590cb6c1c964039b9dea771a647bdac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:35:50.900285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7dcc8-3f1c-44cb-89b1-162628d4b41a service swift] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:35:50.900655 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7dcc8-3f1c-44cb-89b1-162628d4b41a service swift] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:35:50.900992 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7dcc8-3f1c-44cb-89b1-162628d4b41a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:35:50.910638 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7dcc8-3f1c-44cb-89b1-162628d4b41a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:35:50.912386 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7dcc8-3f1c-44cb-89b1-162628d4b41a service swift] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:35:50.921231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1119/2220] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Oct 4 16:35:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 16:36:00.853000 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:36:00.918479 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=6 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:36:07.370857 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0b9d6-d2b9-4fab-87a0-d912363ee7ed None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:07.371423 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0b9d6-d2b9-4fab-87a0-d912363ee7ed None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:07.371423 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0b9d6-d2b9-4fab-87a0-d912363ee7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:07.391947 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-85f0b9d6-d2b9-4fab-87a0-d912363ee7ed None None] MFA Rules not processed for user `05cfc9d62a244701a5df524d1c26f107`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:36:07.393164 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-85f0b9d6-d2b9-4fab-87a0-d912363ee7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:36:07.401012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1102/2221] 10.222.0.55 () {58 vars in 967 bytes} [Tue Oct 4 16:36:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:36:07.413728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7dcc8-3f1c-44cb-89b1-162628d4b41a service swift] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:07.424538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7dcc8-3f1c-44cb-89b1-162628d4b41a service swift] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:07.429591 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3f134-4158-432e-bd9e-468e9572447c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6590cb6c1c964039b9dea771a647bdac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:07.430195 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3f134-4158-432e-bd9e-468e9572447c service swift] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:07.430474 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3f134-4158-432e-bd9e-468e9572447c service swift] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:07.430779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3f134-4158-432e-bd9e-468e9572447c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:07.440003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3f134-4158-432e-bd9e-468e9572447c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:07.441701 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3f134-4158-432e-bd9e-468e9572447c service swift] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:07.450652 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1120/2222] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Oct 4 16:36:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 16:36:17.386565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:36:17.447203 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=6 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:36:21.830393 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0b9d6-d2b9-4fab-87a0-d912363ee7ed None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:21.831959 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-85f0b9d6-d2b9-4fab-87a0-d912363ee7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:36:21.847508 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0b9d6-d2b9-4fab-87a0-d912363ee7ed None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:21.852574 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf823ef-2e74-49d0-be12-150a9a34cb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:21.853225 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf823ef-2e74-49d0-be12-150a9a34cb94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:21.853498 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf823ef-2e74-49d0-be12-150a9a34cb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:21.853767 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf823ef-2e74-49d0-be12-150a9a34cb94 admin admin] PATH_INFO: `/v3/users/1162a7b971974650baa2c1bdea03dfc1` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:21.854911 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf823ef-2e74-49d0-be12-150a9a34cb94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1162a7b971974650baa2c1bdea03dfc1)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:21.857005 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf823ef-2e74-49d0-be12-150a9a34cb94 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:21.913809 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-3bf823ef-2e74-49d0-be12-150a9a34cb94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1162a7b971974650baa2c1bdea03dfc1'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:36:21.914740 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-3bf823ef-2e74-49d0-be12-150a9a34cb94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1162a7b971974650baa2c1bdea03dfc1'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:36:21.922200 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-3bf823ef-2e74-49d0-be12-150a9a34cb94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1162a7b971974650baa2c1bdea03dfc1'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:36:21.923370 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-3bf823ef-2e74-49d0-be12-150a9a34cb94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1162a7b971974650baa2c1bdea03dfc1'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:36:21.933524 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-3bf823ef-2e74-49d0-be12-150a9a34cb94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1162a7b971974650baa2c1bdea03dfc1'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:36:21.954771 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1103/2223] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:36:21 2022] DELETE /identity/v3/users/1162a7b971974650baa2c1bdea03dfc1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:36:22.155258 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3f134-4158-432e-bd9e-468e9572447c service swift] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:22.168693 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3f134-4158-432e-bd9e-468e9572447c service swift] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:22.236883 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bf758-cc6a-4325-9d46-85aec39077ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:22.237617 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bf758-cc6a-4325-9d46-85aec39077ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:22.237897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bf758-cc6a-4325-9d46-85aec39077ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:22.239296 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bf758-cc6a-4325-9d46-85aec39077ad admin admin] PATH_INFO: `/v3/projects/042a09853624426c89fcd03b557168ab` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:22.240529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34bf758-cc6a-4325-9d46-85aec39077ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=042a09853624426c89fcd03b557168ab)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:22.242519 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34bf758-cc6a-4325-9d46-85aec39077ad admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:22.293277 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f34bf758-cc6a-4325-9d46-85aec39077ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '042a09853624426c89fcd03b557168ab', 'request_id': 'req-f34bf758-cc6a-4325-9d46-85aec39077ad'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:36:22.300938 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f34bf758-cc6a-4325-9d46-85aec39077ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '042a09853624426c89fcd03b557168ab', 'request_id': 'req-f34bf758-cc6a-4325-9d46-85aec39077ad'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:36:22.307667 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f34bf758-cc6a-4325-9d46-85aec39077ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '042a09853624426c89fcd03b557168ab', 'request_id': 'req-f34bf758-cc6a-4325-9d46-85aec39077ad'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:36:22.319236 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f34bf758-cc6a-4325-9d46-85aec39077ad admin admin] The token cache is being invalidate because project 042a09853624426c89fcd03b557168ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:36:22.319520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f34bf758-cc6a-4325-9d46-85aec39077ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:36:22.320186 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f34bf758-cc6a-4325-9d46-85aec39077ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:36:22.321825 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1121/2224] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:36:22 2022] DELETE /identity/v3/projects/042a09853624426c89fcd03b557168ab => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:36:22.326743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2823fc1-9e3f-4698-870b-64bca3d179bd None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:22.327072 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2823fc1-9e3f-4698-870b-64bca3d179bd None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:22.327347 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2823fc1-9e3f-4698-870b-64bca3d179bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:22.348344 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-d2823fc1-9e3f-4698-870b-64bca3d179bd None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:36:22.349562 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-d2823fc1-9e3f-4698-870b-64bca3d179bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:36:22.411382 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1104/2225] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:36:22.419589 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507c960-010d-465e-a730-ec73df3ecaea None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:22.419874 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507c960-010d-465e-a730-ec73df3ecaea None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:22.420145 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507c960-010d-465e-a730-ec73df3ecaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:22.440550 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-5507c960-010d-465e-a730-ec73df3ecaea None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:36:22.441741 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-5507c960-010d-465e-a730-ec73df3ecaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:36:22.450240 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1122/2226] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:36:22.454789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2823fc1-9e3f-4698-870b-64bca3d179bd None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:22.465298 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2823fc1-9e3f-4698-870b-64bca3d179bd None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:22.471222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0d16b-94c2-4685-881f-c1203330821b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:22.471816 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0d16b-94c2-4685-881f-c1203330821b admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:22.472085 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0d16b-94c2-4685-881f-c1203330821b admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:22.472333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0d16b-94c2-4685-881f-c1203330821b admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:22.472975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0d16b-94c2-4685-881f-c1203330821b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:36:22.473282 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0d16b-94c2-4685-881f-c1203330821b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:22.474860 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0d16b-94c2-4685-881f-c1203330821b admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:22.486755 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1105/2227] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:36:22.491440 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507c960-010d-465e-a730-ec73df3ecaea None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:22.501138 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507c960-010d-465e-a730-ec73df3ecaea None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:22.507318 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7e014-f3f2-4d2f-97af-11b403872a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:22.507914 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7e014-f3f2-4d2f-97af-11b403872a6a admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:22.508183 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7e014-f3f2-4d2f-97af-11b403872a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:22.508447 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7e014-f3f2-4d2f-97af-11b403872a6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:22.509098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7e014-f3f2-4d2f-97af-11b403872a6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:22.510972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7e014-f3f2-4d2f-97af-11b403872a6a admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:22.541333 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1123/2228] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:36:22 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:36:22.547412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0d16b-94c2-4685-881f-c1203330821b admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:22.559484 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0d16b-94c2-4685-881f-c1203330821b admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:22.626227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db97c5b-1286-45c0-838e-0335f507ff32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:22.626937 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db97c5b-1286-45c0-838e-0335f507ff32 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:22.627244 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db97c5b-1286-45c0-838e-0335f507ff32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:22.627508 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db97c5b-1286-45c0-838e-0335f507ff32 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:22.628147 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db97c5b-1286-45c0-838e-0335f507ff32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:22.630087 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db97c5b-1286-45c0-838e-0335f507ff32 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:22.638417 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:36:22.656827 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1106/2229] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:36:22 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:36:22.660299 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7e014-f3f2-4d2f-97af-11b403872a6a admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:22.671383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7e014-f3f2-4d2f-97af-11b403872a6a admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:22.676918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ea783-cca5-43a1-8c0c-8efd0a839ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:22.677533 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ea783-cca5-43a1-8c0c-8efd0a839ffe admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:22.677840 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ea783-cca5-43a1-8c0c-8efd0a839ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:22.678081 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ea783-cca5-43a1-8c0c-8efd0a839ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:22.678730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ea783-cca5-43a1-8c0c-8efd0a839ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:22.680445 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ea783-cca5-43a1-8c0c-8efd0a839ffe admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:22.691207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1124/2230] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:36:22.695282 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db97c5b-1286-45c0-838e-0335f507ff32 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:22.706320 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db97c5b-1286-45c0-838e-0335f507ff32 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:22.711771 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c36760-bac4-4033-9c02-bf97fa938aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:22.712396 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c36760-bac4-4033-9c02-bf97fa938aff admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:22.712665 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c36760-bac4-4033-9c02-bf97fa938aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:22.712940 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c36760-bac4-4033-9c02-bf97fa938aff admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:22.713586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c36760-bac4-4033-9c02-bf97fa938aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:22.715243 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c36760-bac4-4033-9c02-bf97fa938aff admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:22.726299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1107/2231] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:36:22.730662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ea783-cca5-43a1-8c0c-8efd0a839ffe admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:22.740597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ea783-cca5-43a1-8c0c-8efd0a839ffe admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:22.746063 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84973e-25a7-444f-98f5-8de046b7d426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:22.746805 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84973e-25a7-444f-98f5-8de046b7d426 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:22.747185 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84973e-25a7-444f-98f5-8de046b7d426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:22.747484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84973e-25a7-444f-98f5-8de046b7d426 admin admin] PATH_INFO: `/v3/projects/fd884a22e2c94de098e1d52aafd45325/users/70addd8719414b8fbf716c9ddb40a3f1/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:22.764104 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84973e-25a7-444f-98f5-8de046b7d426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd884a22e2c94de098e1d52aafd45325, user_id=70addd8719414b8fbf716c9ddb40a3f1, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:22.767188 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84973e-25a7-444f-98f5-8de046b7d426 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:22.781311 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1125/2232] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:36:22 2022] PUT /identity/v3/projects/fd884a22e2c94de098e1d52aafd45325/users/70addd8719414b8fbf716c9ddb40a3f1/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:36:22.786464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb0990-94c0-48d3-9320-0422a36db404 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:22.786811 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb0990-94c0-48d3-9320-0422a36db404 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:22.787173 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb0990-94c0-48d3-9320-0422a36db404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:22.807719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-92bb0990-94c0-48d3-9320-0422a36db404 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:36:22.808972 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-92bb0990-94c0-48d3-9320-0422a36db404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:36:22.874595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1108/2233] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:36:22.884879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84973e-25a7-444f-98f5-8de046b7d426 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:22.886698 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-3d84973e-25a7-444f-98f5-8de046b7d426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:36:22.918503 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:36:22.949607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84973e-25a7-444f-98f5-8de046b7d426 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:22.953443 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6736f51-e050-4530-874a-7f7b43ef39e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:22.954095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6736f51-e050-4530-874a-7f7b43ef39e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:22.954375 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6736f51-e050-4530-874a-7f7b43ef39e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:22.954646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6736f51-e050-4530-874a-7f7b43ef39e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:22.963980 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6736f51-e050-4530-874a-7f7b43ef39e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:22.965633 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6736f51-e050-4530-874a-7f7b43ef39e2 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:22.977375 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1126/2234] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:36:25.006057 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6304da-2c9f-49b7-8ccf-b1e7146e0472 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:25.006678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6304da-2c9f-49b7-8ccf-b1e7146e0472 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:25.006678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6304da-2c9f-49b7-8ccf-b1e7146e0472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:25.027292 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-1f6304da-2c9f-49b7-8ccf-b1e7146e0472 None None] MFA Rules not processed for user `b505541b5fe8494fa9ae8777e7add970`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:36:25.028545 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-1f6304da-2c9f-49b7-8ccf-b1e7146e0472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:36:25.089845 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1109/2235] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:36:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:36:27.339993 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0e718-3f84-48a8-a47f-3a7350a28828 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:27.340524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0e718-3f84-48a8-a47f-3a7350a28828 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:27.340622 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0e718-3f84-48a8-a47f-3a7350a28828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:27.382910 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-fcf0e718-3f84-48a8-a47f-3a7350a28828 None None] MFA Rules not processed for user `70addd8719414b8fbf716c9ddb40a3f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:36:27.384279 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-fcf0e718-3f84-48a8-a47f-3a7350a28828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:36:27.464842 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1127/2236] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:36:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:36:27.469641 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6304da-2c9f-49b7-8ccf-b1e7146e0472 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:27.480999 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6304da-2c9f-49b7-8ccf-b1e7146e0472 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:27.487981 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b515b9-6c0b-4546-a798-f8c4e1e927f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:27.488733 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b515b9-6c0b-4546-a798-f8c4e1e927f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:27.489173 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b515b9-6c0b-4546-a798-f8c4e1e927f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:27.489583 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b515b9-6c0b-4546-a798-f8c4e1e927f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:27.490847 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b515b9-6c0b-4546-a798-f8c4e1e927f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:27.493165 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b515b9-6c0b-4546-a798-f8c4e1e927f4 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:27.531794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1110/2237] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:36:27 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:36:27.532702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0e718-3f84-48a8-a47f-3a7350a28828 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:27.552588 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0e718-3f84-48a8-a47f-3a7350a28828 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:27.671727 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df1847-ce3b-4cce-8320-7632293abeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:27.673415 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df1847-ce3b-4cce-8320-7632293abeff admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:27.673803 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df1847-ce3b-4cce-8320-7632293abeff admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:27.674133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df1847-ce3b-4cce-8320-7632293abeff admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:27.674863 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df1847-ce3b-4cce-8320-7632293abeff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:27.677923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df1847-ce3b-4cce-8320-7632293abeff admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:27.746866 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1128/2238] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:36:27 2022] POST /identity/v3/users => generated 299 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:36:27.749192 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b515b9-6c0b-4546-a798-f8c4e1e927f4 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:27.770230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b515b9-6c0b-4546-a798-f8c4e1e927f4 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:27.793186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fba2f-1f9a-4cc0-bf3f-e0b9d6806376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:27.793932 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fba2f-1f9a-4cc0-bf3f-e0b9d6806376 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:27.794633 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fba2f-1f9a-4cc0-bf3f-e0b9d6806376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:27.795124 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fba2f-1f9a-4cc0-bf3f-e0b9d6806376 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:27.795946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444fba2f-1f9a-4cc0-bf3f-e0b9d6806376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:27.797721 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444fba2f-1f9a-4cc0-bf3f-e0b9d6806376 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:27.829143 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1111/2239] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:36:27.830370 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df1847-ce3b-4cce-8320-7632293abeff admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:27.844272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df1847-ce3b-4cce-8320-7632293abeff admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:27.856186 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789f1a3-1173-46d0-98ec-a841b5fd97c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:27.856886 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789f1a3-1173-46d0-98ec-a841b5fd97c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:27.857282 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789f1a3-1173-46d0-98ec-a841b5fd97c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:27.857445 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789f1a3-1173-46d0-98ec-a841b5fd97c6 admin admin] PATH_INFO: `/v3/projects/4c907df628484efb830eff997a2df727/users/bd740da23ba64cf98387882862570590/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:27.893569 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789f1a3-1173-46d0-98ec-a841b5fd97c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c907df628484efb830eff997a2df727, user_id=bd740da23ba64cf98387882862570590, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:27.896713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789f1a3-1173-46d0-98ec-a841b5fd97c6 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:27.926490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1129/2240] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:36:27 2022] PUT /identity/v3/projects/4c907df628484efb830eff997a2df727/users/bd740da23ba64cf98387882862570590/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:36:27.927809 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fba2f-1f9a-4cc0-bf3f-e0b9d6806376 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:27.939330 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fba2f-1f9a-4cc0-bf3f-e0b9d6806376 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:27.998751 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:36:28.013192 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4281a-44e4-4958-955b-5fee3c81d8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:28.014108 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4281a-44e4-4958-955b-5fee3c81d8ae admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:28.014388 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4281a-44e4-4958-955b-5fee3c81d8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:28.014661 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4281a-44e4-4958-955b-5fee3c81d8ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:28.015759 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4281a-44e4-4958-955b-5fee3c81d8ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:28.017554 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4281a-44e4-4958-955b-5fee3c81d8ae admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:28.033400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1112/2241] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:36:28.037730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789f1a3-1173-46d0-98ec-a841b5fd97c6 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:28.050065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789f1a3-1173-46d0-98ec-a841b5fd97c6 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:28.054920 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e0e85-86ec-40ae-b32f-aa2d186adf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:28.055651 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e0e85-86ec-40ae-b32f-aa2d186adf7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:28.055931 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e0e85-86ec-40ae-b32f-aa2d186adf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:28.056217 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e0e85-86ec-40ae-b32f-aa2d186adf7d admin admin] PATH_INFO: `/v3/projects/4c907df628484efb830eff997a2df727/users/bd740da23ba64cf98387882862570590/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:28.058212 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e0e85-86ec-40ae-b32f-aa2d186adf7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c907df628484efb830eff997a2df727, user_id=bd740da23ba64cf98387882862570590, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:28.060921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e0e85-86ec-40ae-b32f-aa2d186adf7d admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:28.075263 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1130/2242] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:36:28 2022] PUT /identity/v3/projects/4c907df628484efb830eff997a2df727/users/bd740da23ba64cf98387882862570590/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:36:33.091731 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d689f42-85d0-4a87-ae62-9bd5f14263e7 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:33.092592 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d689f42-85d0-4a87-ae62-9bd5f14263e7 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:33.093005 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d689f42-85d0-4a87-ae62-9bd5f14263e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:33.132929 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-5d689f42-85d0-4a87-ae62-9bd5f14263e7 None None] MFA Rules not processed for user `06aca6bb76ec4290b591d9c7a5a6c5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:36:33.134137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-5d689f42-85d0-4a87-ae62-9bd5f14263e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:36:33.251307 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1113/2243] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:36:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:36:34.617912 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae12cac-40ef-43bd-b529-d5429d5514cc None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:34.618368 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae12cac-40ef-43bd-b529-d5429d5514cc None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:34.618484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae12cac-40ef-43bd-b529-d5429d5514cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:34.649307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:36:34.689875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-7ae12cac-40ef-43bd-b529-d5429d5514cc None None] MFA Rules not processed for user `bd740da23ba64cf98387882862570590`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:36:34.691374 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-7ae12cac-40ef-43bd-b529-d5429d5514cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:36:34.785306 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1131/2244] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:36:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:36:34.801719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d689f42-85d0-4a87-ae62-9bd5f14263e7 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:34.804041 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-5d689f42-85d0-4a87-ae62-9bd5f14263e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:36:34.865484 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d689f42-85d0-4a87-ae62-9bd5f14263e7 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:34.869719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef80c1b-0d38-42fa-84f7-5a1a06fadc62 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74b3e45a14bd4b539974e9e5e278ee62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:34.870447 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef80c1b-0d38-42fa-84f7-5a1a06fadc62 service glance] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:34.870797 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef80c1b-0d38-42fa-84f7-5a1a06fadc62 service glance] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:34.871178 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef80c1b-0d38-42fa-84f7-5a1a06fadc62 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:34.934179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef80c1b-0d38-42fa-84f7-5a1a06fadc62 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:34.935633 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef80c1b-0d38-42fa-84f7-5a1a06fadc62 service glance] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:34.945712 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1114/2245] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:36:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:36:35.090926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d859000-494e-4f1c-bed2-044a7dc92412 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:35.091421 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d859000-494e-4f1c-bed2-044a7dc92412 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:35.091758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d859000-494e-4f1c-bed2-044a7dc92412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:35.126738 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-6d859000-494e-4f1c-bed2-044a7dc92412 None None] MFA Rules not processed for user `05cfc9d62a244701a5df524d1c26f107`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:36:35.127987 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-6d859000-494e-4f1c-bed2-044a7dc92412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:36:35.214387 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1132/2246] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Oct 4 16:36:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:36:35.240334 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef80c1b-0d38-42fa-84f7-5a1a06fadc62 service glance] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:35.242081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-7ef80c1b-0d38-42fa-84f7-5a1a06fadc62 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:36:35.309614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:36:35.336491 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef80c1b-0d38-42fa-84f7-5a1a06fadc62 service glance] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:35.341846 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43007c9e-1339-480d-95b7-d170df685940 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6590cb6c1c964039b9dea771a647bdac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:35.342483 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43007c9e-1339-480d-95b7-d170df685940 service swift] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:35.342762 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43007c9e-1339-480d-95b7-d170df685940 service swift] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:35.343063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43007c9e-1339-480d-95b7-d170df685940 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:35.353820 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43007c9e-1339-480d-95b7-d170df685940 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:35.356024 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43007c9e-1339-480d-95b7-d170df685940 service swift] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:35.366880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1115/2247] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Oct 4 16:36:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 16:36:45.211433 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=54 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:36:45.364815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=11 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:36:46.642240 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c89c1-66dd-4a56-9315-5a8818586b44 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:46.642806 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c89c1-66dd-4a56-9315-5a8818586b44 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:46.642806 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c89c1-66dd-4a56-9315-5a8818586b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:46.662967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-017c89c1-66dd-4a56-9315-5a8818586b44 None None] MFA Rules not processed for user `70addd8719414b8fbf716c9ddb40a3f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:36:46.664256 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-017c89c1-66dd-4a56-9315-5a8818586b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:36:46.672235 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1133/2248] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:36:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:36:51.161642 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc58713-8de4-4785-86a8-c0c4b6977536 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:51.162724 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc58713-8de4-4785-86a8-c0c4b6977536 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:51.163355 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc58713-8de4-4785-86a8-c0c4b6977536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:51.188438 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-8cc58713-8de4-4785-86a8-c0c4b6977536 None None] MFA Rules not processed for user `05cfc9d62a244701a5df524d1c26f107`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:36:51.189769 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-8cc58713-8de4-4785-86a8-c0c4b6977536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:36:51.197851 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1116/2249] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Oct 4 16:36:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:36:51.211179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c89c1-66dd-4a56-9315-5a8818586b44 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:51.227222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c89c1-66dd-4a56-9315-5a8818586b44 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:51.232687 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1645c-1074-4ef4-94a4-034ab297efd4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6590cb6c1c964039b9dea771a647bdac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:51.233310 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1645c-1074-4ef4-94a4-034ab297efd4 service swift] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:51.233614 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1645c-1074-4ef4-94a4-034ab297efd4 service swift] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:51.233879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1645c-1074-4ef4-94a4-034ab297efd4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:51.243014 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1645c-1074-4ef4-94a4-034ab297efd4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:51.244605 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1645c-1074-4ef4-94a4-034ab297efd4 service swift] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:51.253214 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1134/2250] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Oct 4 16:36:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 16:36:51.416695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc58713-8de4-4785-86a8-c0c4b6977536 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:51.419054 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-8cc58713-8de4-4785-86a8-c0c4b6977536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:36:51.615285 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc58713-8de4-4785-86a8-c0c4b6977536 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:51.631510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e463050-b534-434e-a7ba-f5da0ea7dfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:51.632266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e463050-b534-434e-a7ba-f5da0ea7dfb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:51.632543 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e463050-b534-434e-a7ba-f5da0ea7dfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:51.632811 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e463050-b534-434e-a7ba-f5da0ea7dfb3 admin admin] PATH_INFO: `/v3/users/fd7782e68436445395dd49bf7d8302e8` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:51.633996 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e463050-b534-434e-a7ba-f5da0ea7dfb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd7782e68436445395dd49bf7d8302e8)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:51.635982 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e463050-b534-434e-a7ba-f5da0ea7dfb3 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:51.772706 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-4e463050-b534-434e-a7ba-f5da0ea7dfb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd7782e68436445395dd49bf7d8302e8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:36:51.773342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-4e463050-b534-434e-a7ba-f5da0ea7dfb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd7782e68436445395dd49bf7d8302e8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:36:51.793373 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-4e463050-b534-434e-a7ba-f5da0ea7dfb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd7782e68436445395dd49bf7d8302e8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:36:51.796137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-4e463050-b534-434e-a7ba-f5da0ea7dfb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd7782e68436445395dd49bf7d8302e8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:36:51.815972 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-4e463050-b534-434e-a7ba-f5da0ea7dfb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd7782e68436445395dd49bf7d8302e8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:36:51.865760 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1117/2251] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:36:51 2022] DELETE /identity/v3/users/fd7782e68436445395dd49bf7d8302e8 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:36:52.231535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1645c-1074-4ef4-94a4-034ab297efd4 service swift] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:52.265181 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1645c-1074-4ef4-94a4-034ab297efd4 service swift] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:52.372366 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5355f-08a5-4565-b1de-11e964242553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:52.374717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5355f-08a5-4565-b1de-11e964242553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:52.375319 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5355f-08a5-4565-b1de-11e964242553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:52.375855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5355f-08a5-4565-b1de-11e964242553 admin admin] PATH_INFO: `/v3/projects/abc1c3fe146e49b08b04a8ef09d59075` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:52.377946 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5355f-08a5-4565-b1de-11e964242553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abc1c3fe146e49b08b04a8ef09d59075)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:52.382705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5355f-08a5-4565-b1de-11e964242553 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:52.493506 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-54d5355f-08a5-4565-b1de-11e964242553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abc1c3fe146e49b08b04a8ef09d59075', 'request_id': 'req-54d5355f-08a5-4565-b1de-11e964242553'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:36:52.508991 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-54d5355f-08a5-4565-b1de-11e964242553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abc1c3fe146e49b08b04a8ef09d59075', 'request_id': 'req-54d5355f-08a5-4565-b1de-11e964242553'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:36:52.517714 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-54d5355f-08a5-4565-b1de-11e964242553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abc1c3fe146e49b08b04a8ef09d59075', 'request_id': 'req-54d5355f-08a5-4565-b1de-11e964242553'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:36:52.530784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-54d5355f-08a5-4565-b1de-11e964242553 admin admin] The token cache is being invalidate because project abc1c3fe146e49b08b04a8ef09d59075 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:36:52.531358 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-54d5355f-08a5-4565-b1de-11e964242553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:36:52.532180 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-54d5355f-08a5-4565-b1de-11e964242553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:36:52.534193 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1135/2252] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:36:52 2022] DELETE /identity/v3/projects/abc1c3fe146e49b08b04a8ef09d59075 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:36:52.539412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57760c1a-92af-453e-bf2c-248f712ea7fe None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:52.540244 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57760c1a-92af-453e-bf2c-248f712ea7fe None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:52.540244 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57760c1a-92af-453e-bf2c-248f712ea7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:52.560817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-57760c1a-92af-453e-bf2c-248f712ea7fe None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:36:52.562030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-57760c1a-92af-453e-bf2c-248f712ea7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:36:52.697162 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1118/2253] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:36:52.705013 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a17f5a-ee36-47f1-8835-8b671e8947ee None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:52.705640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a17f5a-ee36-47f1-8835-8b671e8947ee None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:52.706078 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a17f5a-ee36-47f1-8835-8b671e8947ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:52.759996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-a5a17f5a-ee36-47f1-8835-8b671e8947ee None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:36:52.761721 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-a5a17f5a-ee36-47f1-8835-8b671e8947ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:36:52.793203 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1136/2254] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:36:52.798551 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57760c1a-92af-453e-bf2c-248f712ea7fe None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:52.816346 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57760c1a-92af-453e-bf2c-248f712ea7fe None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:52.831933 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdb407-c04c-4d4e-96ef-280d8a148273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:52.835723 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdb407-c04c-4d4e-96ef-280d8a148273 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:52.835723 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdb407-c04c-4d4e-96ef-280d8a148273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:52.835723 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdb407-c04c-4d4e-96ef-280d8a148273 admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:52.836308 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdb407-c04c-4d4e-96ef-280d8a148273 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:36:52.836767 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdb407-c04c-4d4e-96ef-280d8a148273 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:52.839211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdb407-c04c-4d4e-96ef-280d8a148273 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:52.850075 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:36:52.854945 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1119/2255] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:36:52.859432 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a17f5a-ee36-47f1-8835-8b671e8947ee None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:52.870372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a17f5a-ee36-47f1-8835-8b671e8947ee None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:52.881513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea806f39-6067-4fd9-a503-bba0339d24bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:52.883371 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea806f39-6067-4fd9-a503-bba0339d24bb admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:52.884583 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea806f39-6067-4fd9-a503-bba0339d24bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:52.887037 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea806f39-6067-4fd9-a503-bba0339d24bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:52.887783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea806f39-6067-4fd9-a503-bba0339d24bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:52.893277 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea806f39-6067-4fd9-a503-bba0339d24bb admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:52.961932 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1137/2256] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:36:52 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:36:52.966025 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdb407-c04c-4d4e-96ef-280d8a148273 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:52.983864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdb407-c04c-4d4e-96ef-280d8a148273 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:53.061091 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f12744-bab8-4166-aee9-453272a208d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:53.061917 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f12744-bab8-4166-aee9-453272a208d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:53.062343 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f12744-bab8-4166-aee9-453272a208d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:53.062897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f12744-bab8-4166-aee9-453272a208d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:53.063686 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f12744-bab8-4166-aee9-453272a208d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:53.066792 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f12744-bab8-4166-aee9-453272a208d8 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:53.098317 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1120/2257] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:36:52 2022] POST /identity/v3/users => generated 284 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:36:53.102755 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea806f39-6067-4fd9-a503-bba0339d24bb admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:53.116783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea806f39-6067-4fd9-a503-bba0339d24bb admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:53.129942 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f130df-5db0-46c8-b352-cd131715610e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:53.130664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f130df-5db0-46c8-b352-cd131715610e admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:53.130965 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f130df-5db0-46c8-b352-cd131715610e admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:53.131261 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f130df-5db0-46c8-b352-cd131715610e admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:53.132006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f130df-5db0-46c8-b352-cd131715610e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:53.133663 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f130df-5db0-46c8-b352-cd131715610e admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:53.158918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1138/2258] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:36:53.163852 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f12744-bab8-4166-aee9-453272a208d8 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:53.182066 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f12744-bab8-4166-aee9-453272a208d8 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:53.191841 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10891e5-0574-4685-8026-56a82ea7af07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:53.192816 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10891e5-0574-4685-8026-56a82ea7af07 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:53.193580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10891e5-0574-4685-8026-56a82ea7af07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:53.194059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10891e5-0574-4685-8026-56a82ea7af07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:53.195206 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10891e5-0574-4685-8026-56a82ea7af07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:53.199356 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10891e5-0574-4685-8026-56a82ea7af07 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:53.216313 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1121/2259] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:36:53.220281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f130df-5db0-46c8-b352-cd131715610e admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:53.232139 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f130df-5db0-46c8-b352-cd131715610e admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:53.239105 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3585b8c-e4e5-4cef-8b1f-1ff147c61bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:53.240101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3585b8c-e4e5-4cef-8b1f-1ff147c61bba admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:53.240585 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3585b8c-e4e5-4cef-8b1f-1ff147c61bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:53.241058 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3585b8c-e4e5-4cef-8b1f-1ff147c61bba admin admin] PATH_INFO: `/v3/projects/16bb5f865d8c4c4db54c7d1bd8587322/users/b34b8b342dba47b49ca496ca874a0b0a/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:53.285527 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3585b8c-e4e5-4cef-8b1f-1ff147c61bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=16bb5f865d8c4c4db54c7d1bd8587322, user_id=b34b8b342dba47b49ca496ca874a0b0a, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:53.289060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3585b8c-e4e5-4cef-8b1f-1ff147c61bba admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:53.328037 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1139/2260] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:36:53 2022] PUT /identity/v3/projects/16bb5f865d8c4c4db54c7d1bd8587322/users/b34b8b342dba47b49ca496ca874a0b0a/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:36:53.340173 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68c685-8ba1-4ed5-86bd-f74cd08d9689 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:53.340610 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68c685-8ba1-4ed5-86bd-f74cd08d9689 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:53.340785 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68c685-8ba1-4ed5-86bd-f74cd08d9689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:53.377571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-8b68c685-8ba1-4ed5-86bd-f74cd08d9689 None None] MFA Rules not processed for user `b34b8b342dba47b49ca496ca874a0b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:36:53.378945 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-8b68c685-8ba1-4ed5-86bd-f74cd08d9689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:36:53.501702 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1122/2261] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:36:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:36:53.515201 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3585b8c-e4e5-4cef-8b1f-1ff147c61bba admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:36:53.517233 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-f3585b8c-e4e5-4cef-8b1f-1ff147c61bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:36:53.536673 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:36:53.630392 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3585b8c-e4e5-4cef-8b1f-1ff147c61bba admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:36:53.638034 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b2e57-5c5f-4bf6-a17e-cf1d1ed24a5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:36:53.640288 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b2e57-5c5f-4bf6-a17e-cf1d1ed24a5d service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:36:53.640701 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b2e57-5c5f-4bf6-a17e-cf1d1ed24a5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:36:53.641263 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b2e57-5c5f-4bf6-a17e-cf1d1ed24a5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:36:53.651420 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b2e57-5c5f-4bf6-a17e-cf1d1ed24a5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:36:53.654344 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b2e57-5c5f-4bf6-a17e-cf1d1ed24a5d service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:36:53.692422 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1140/2262] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:36:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:37:02.732644 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68c685-8ba1-4ed5-86bd-f74cd08d9689 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:02.799115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68c685-8ba1-4ed5-86bd-f74cd08d9689 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:02.804247 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568f06c-c1f7-4130-8669-d1e18ec7a67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:02.804877 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568f06c-c1f7-4130-8669-d1e18ec7a67b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:02.805154 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568f06c-c1f7-4130-8669-d1e18ec7a67b admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:02.805424 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568f06c-c1f7-4130-8669-d1e18ec7a67b admin admin] PATH_INFO: `/v3/users/b34b8b342dba47b49ca496ca874a0b0a` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:02.806592 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568f06c-c1f7-4130-8669-d1e18ec7a67b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b34b8b342dba47b49ca496ca874a0b0a)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:02.808564 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568f06c-c1f7-4130-8669-d1e18ec7a67b admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:02.819291 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:02.857161 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-8568f06c-c1f7-4130-8669-d1e18ec7a67b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b34b8b342dba47b49ca496ca874a0b0a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:02.857802 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-8568f06c-c1f7-4130-8669-d1e18ec7a67b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b34b8b342dba47b49ca496ca874a0b0a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:02.865225 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-8568f06c-c1f7-4130-8669-d1e18ec7a67b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b34b8b342dba47b49ca496ca874a0b0a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:02.865931 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-8568f06c-c1f7-4130-8669-d1e18ec7a67b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b34b8b342dba47b49ca496ca874a0b0a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:02.874590 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-8568f06c-c1f7-4130-8669-d1e18ec7a67b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b34b8b342dba47b49ca496ca874a0b0a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:02.892420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1123/2263] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:37:02 2022] DELETE /identity/v3/users/b34b8b342dba47b49ca496ca874a0b0a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:02.896936 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388904e-9247-472f-aaaa-a5e76308f36f None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:02.897483 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388904e-9247-472f-aaaa-a5e76308f36f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:02.897483 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388904e-9247-472f-aaaa-a5e76308f36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:02.917726 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-6388904e-9247-472f-aaaa-a5e76308f36f None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:02.919030 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-6388904e-9247-472f-aaaa-a5e76308f36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:02.984703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1141/2264] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:02.994609 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568f06c-c1f7-4130-8669-d1e18ec7a67b admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:02.996278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-8568f06c-c1f7-4130-8669-d1e18ec7a67b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:03.055320 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568f06c-c1f7-4130-8669-d1e18ec7a67b admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:03.061150 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073424e-6b61-4a74-b4dd-f48c3980520b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:03.062034 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073424e-6b61-4a74-b4dd-f48c3980520b service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:03.062402 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073424e-6b61-4a74-b4dd-f48c3980520b service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:03.062764 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073424e-6b61-4a74-b4dd-f48c3980520b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:03.076131 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073424e-6b61-4a74-b4dd-f48c3980520b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:03.077606 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073424e-6b61-4a74-b4dd-f48c3980520b service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:03.088021 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1124/2265] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:37:03.498834 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388904e-9247-472f-aaaa-a5e76308f36f None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:03.500436 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-6388904e-9247-472f-aaaa-a5e76308f36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:03.517198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388904e-9247-472f-aaaa-a5e76308f36f None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:03.528599 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87279634-0942-4534-b252-846addd7c16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:03.529267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87279634-0942-4534-b252-846addd7c16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:03.530116 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87279634-0942-4534-b252-846addd7c16c admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:03.530488 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87279634-0942-4534-b252-846addd7c16c admin admin] PATH_INFO: `/v3/projects/16bb5f865d8c4c4db54c7d1bd8587322` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:03.531997 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87279634-0942-4534-b252-846addd7c16c admin admin] RBAC: Authorizing `identity:delete_project(project_id=16bb5f865d8c4c4db54c7d1bd8587322)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:03.534278 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87279634-0942-4534-b252-846addd7c16c admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:03.587413 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-87279634-0942-4534-b252-846addd7c16c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16bb5f865d8c4c4db54c7d1bd8587322', 'request_id': 'req-87279634-0942-4534-b252-846addd7c16c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:03.596946 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-87279634-0942-4534-b252-846addd7c16c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16bb5f865d8c4c4db54c7d1bd8587322', 'request_id': 'req-87279634-0942-4534-b252-846addd7c16c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:03.603925 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-87279634-0942-4534-b252-846addd7c16c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16bb5f865d8c4c4db54c7d1bd8587322', 'request_id': 'req-87279634-0942-4534-b252-846addd7c16c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:03.617206 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-87279634-0942-4534-b252-846addd7c16c admin admin] The token cache is being invalidate because project 16bb5f865d8c4c4db54c7d1bd8587322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:37:03.617768 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-87279634-0942-4534-b252-846addd7c16c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:03.618620 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-87279634-0942-4534-b252-846addd7c16c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:03.620530 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1142/2266] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:37:03 2022] DELETE /identity/v3/projects/16bb5f865d8c4c4db54c7d1bd8587322 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:03.625438 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5baa841-b356-46a2-a9a3-bbc7ebdbc8be None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:03.625962 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5baa841-b356-46a2-a9a3-bbc7ebdbc8be None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:03.625962 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5baa841-b356-46a2-a9a3-bbc7ebdbc8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:03.649080 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-d5baa841-b356-46a2-a9a3-bbc7ebdbc8be None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:03.650476 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-d5baa841-b356-46a2-a9a3-bbc7ebdbc8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:03.724480 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1125/2267] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:03.732439 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d468f8b-9b24-4c73-a64b-34117aeb663e None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:03.732730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d468f8b-9b24-4c73-a64b-34117aeb663e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:03.733006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d468f8b-9b24-4c73-a64b-34117aeb663e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:03.753888 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-2d468f8b-9b24-4c73-a64b-34117aeb663e None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:03.755152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-2d468f8b-9b24-4c73-a64b-34117aeb663e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:03.763493 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1143/2268] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:03.768438 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5baa841-b356-46a2-a9a3-bbc7ebdbc8be None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:03.778683 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5baa841-b356-46a2-a9a3-bbc7ebdbc8be None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:03.783400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c59e0f-a0d1-434e-8fe5-2e384190514e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:03.784010 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c59e0f-a0d1-434e-8fe5-2e384190514e admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:03.784283 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c59e0f-a0d1-434e-8fe5-2e384190514e admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:03.784547 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c59e0f-a0d1-434e-8fe5-2e384190514e admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:03.785221 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c59e0f-a0d1-434e-8fe5-2e384190514e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:37:03.785517 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c59e0f-a0d1-434e-8fe5-2e384190514e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:03.787160 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c59e0f-a0d1-434e-8fe5-2e384190514e admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:03.799936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1126/2269] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:37:03.803683 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d468f8b-9b24-4c73-a64b-34117aeb663e None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:03.813734 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d468f8b-9b24-4c73-a64b-34117aeb663e None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:03.818775 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563ca3c-bce4-4014-8fe3-002646f6e39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:03.819411 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563ca3c-bce4-4014-8fe3-002646f6e39f admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:03.819739 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563ca3c-bce4-4014-8fe3-002646f6e39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:03.820016 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563ca3c-bce4-4014-8fe3-002646f6e39f admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:03.820647 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563ca3c-bce4-4014-8fe3-002646f6e39f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:03.822763 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563ca3c-bce4-4014-8fe3-002646f6e39f admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:03.852318 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1144/2270] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:37:03 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:37:03.856609 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c59e0f-a0d1-434e-8fe5-2e384190514e admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:03.866836 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c59e0f-a0d1-434e-8fe5-2e384190514e admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:03.880997 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:03.927450 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c542b-cca8-480f-b391-abd0db371b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:03.927961 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c542b-cca8-480f-b391-abd0db371b75 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:03.928241 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c542b-cca8-480f-b391-abd0db371b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:03.928508 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c542b-cca8-480f-b391-abd0db371b75 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:03.929159 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c542b-cca8-480f-b391-abd0db371b75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:03.931152 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c542b-cca8-480f-b391-abd0db371b75 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:03.954379 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1127/2271] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:37:03 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:37:03.958402 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563ca3c-bce4-4014-8fe3-002646f6e39f admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:03.966035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:03.970350 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563ca3c-bce4-4014-8fe3-002646f6e39f admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:03.977517 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487dee0d-4cc3-42e7-9244-1f985dcd23f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:03.978434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487dee0d-4cc3-42e7-9244-1f985dcd23f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:03.979034 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487dee0d-4cc3-42e7-9244-1f985dcd23f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:03.980060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487dee0d-4cc3-42e7-9244-1f985dcd23f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:03.980354 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487dee0d-4cc3-42e7-9244-1f985dcd23f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:03.983020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487dee0d-4cc3-42e7-9244-1f985dcd23f9 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:03.996741 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1145/2272] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:37:03.997907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c542b-cca8-480f-b391-abd0db371b75 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:04.010871 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c542b-cca8-480f-b391-abd0db371b75 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:04.016154 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed4c3f-eb7a-4207-83aa-258541436e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:04.016765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed4c3f-eb7a-4207-83aa-258541436e73 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:04.017042 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed4c3f-eb7a-4207-83aa-258541436e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:04.017312 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed4c3f-eb7a-4207-83aa-258541436e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:04.017960 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed4c3f-eb7a-4207-83aa-258541436e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:04.019627 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed4c3f-eb7a-4207-83aa-258541436e73 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:04.031120 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1128/2273] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:37:04.034845 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487dee0d-4cc3-42e7-9244-1f985dcd23f9 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:04.045807 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487dee0d-4cc3-42e7-9244-1f985dcd23f9 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:04.050925 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e0503-aa91-4f0e-b953-951124969446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:04.051628 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e0503-aa91-4f0e-b953-951124969446 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:04.051901 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e0503-aa91-4f0e-b953-951124969446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:04.052225 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e0503-aa91-4f0e-b953-951124969446 admin admin] PATH_INFO: `/v3/projects/b17b1e39c7c34c699c59c1c4e8b8b035/users/4db58074e39d451b851713d02469195f/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:04.067622 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e0503-aa91-4f0e-b953-951124969446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b17b1e39c7c34c699c59c1c4e8b8b035, user_id=4db58074e39d451b851713d02469195f, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:04.070258 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e0503-aa91-4f0e-b953-951124969446 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:04.084736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1146/2274] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:37:04 2022] PUT /identity/v3/projects/b17b1e39c7c34c699c59c1c4e8b8b035/users/4db58074e39d451b851713d02469195f/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:04.095454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1e000-0a39-4a72-a985-912b5d985f44 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:04.095717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1e000-0a39-4a72-a985-912b5d985f44 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:04.095985 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1e000-0a39-4a72-a985-912b5d985f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:04.128114 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-c2c1e000-0a39-4a72-a985-912b5d985f44 None None] MFA Rules not processed for user `4db58074e39d451b851713d02469195f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:04.129961 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c2c1e000-0a39-4a72-a985-912b5d985f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:04.205050 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1129/2275] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:04.209812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e0503-aa91-4f0e-b953-951124969446 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:04.284482 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e0503-aa91-4f0e-b953-951124969446 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:04.289265 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e0f9a-cdd6-4806-9caa-590c631abb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:04.289878 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e0f9a-cdd6-4806-9caa-590c631abb46 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:04.290182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e0f9a-cdd6-4806-9caa-590c631abb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:04.290450 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e0f9a-cdd6-4806-9caa-590c631abb46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:04.291149 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e0f9a-cdd6-4806-9caa-590c631abb46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:04.293047 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e0f9a-cdd6-4806-9caa-590c631abb46 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:04.322804 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1147/2276] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:37:04 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:37:04.324020 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1e000-0a39-4a72-a985-912b5d985f44 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:04.334816 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1e000-0a39-4a72-a985-912b5d985f44 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:04.395568 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e0f9a-cdd6-4806-9caa-590c631abb46 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:04.397405 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-676e0f9a-cdd6-4806-9caa-590c631abb46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:04.402265 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc6e8d-2cd6-453a-b1e5-8c6c2f5f22fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:04.402893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc6e8d-2cd6-453a-b1e5-8c6c2f5f22fa admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:04.403202 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc6e8d-2cd6-453a-b1e5-8c6c2f5f22fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:04.403472 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc6e8d-2cd6-453a-b1e5-8c6c2f5f22fa admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:04.404115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc6e8d-2cd6-453a-b1e5-8c6c2f5f22fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:04.406149 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc6e8d-2cd6-453a-b1e5-8c6c2f5f22fa admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:04.429148 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1130/2277] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:37:04 2022] POST /identity/v3/users => generated 297 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:37:04.433465 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc6e8d-2cd6-453a-b1e5-8c6c2f5f22fa admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:04.445853 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc6e8d-2cd6-453a-b1e5-8c6c2f5f22fa admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:04.450809 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd8753-54d7-462a-a473-ebd19e254ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:04.451466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd8753-54d7-462a-a473-ebd19e254ddc admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:04.451741 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd8753-54d7-462a-a473-ebd19e254ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:04.452009 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd8753-54d7-462a-a473-ebd19e254ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:04.452655 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd8753-54d7-462a-a473-ebd19e254ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:04.454330 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd8753-54d7-462a-a473-ebd19e254ddc admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:04.459491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e0f9a-cdd6-4806-9caa-590c631abb46 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:04.465473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1131/2278] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:37:04.465886 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d13f8-af50-42d0-b58f-fd8e208215e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:04.466581 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d13f8-af50-42d0-b58f-fd8e208215e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:04.466863 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d13f8-af50-42d0-b58f-fd8e208215e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:04.467162 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d13f8-af50-42d0-b58f-fd8e208215e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:04.468944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-751d13f8-af50-42d0-b58f-fd8e208215e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:04.469748 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd8753-54d7-462a-a473-ebd19e254ddc admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:04.479280 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:04.483609 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd8753-54d7-462a-a473-ebd19e254ddc admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:04.491544 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476efd7-910b-461f-9be8-fe233f60f555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:04.493557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476efd7-910b-461f-9be8-fe233f60f555 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:04.494197 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476efd7-910b-461f-9be8-fe233f60f555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:04.495094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476efd7-910b-461f-9be8-fe233f60f555 admin admin] PATH_INFO: `/v3/projects/7d197065bb524de290f2b366c651bd9f/users/66578015411e4f5ca0917ed4a0c01da3/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:04.512334 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476efd7-910b-461f-9be8-fe233f60f555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d197065bb524de290f2b366c651bd9f, user_id=66578015411e4f5ca0917ed4a0c01da3, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:04.515818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476efd7-910b-461f-9be8-fe233f60f555 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:04.533536 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1132/2279] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:37:04 2022] PUT /identity/v3/projects/7d197065bb524de290f2b366c651bd9f/users/66578015411e4f5ca0917ed4a0c01da3/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:37:04.537563 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476efd7-910b-461f-9be8-fe233f60f555 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:04.549464 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:04.555887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d13f8-af50-42d0-b58f-fd8e208215e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:04.558256 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d13f8-af50-42d0-b58f-fd8e208215e0 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:04.570353 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1148/2280] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:37:04.605200 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476efd7-910b-461f-9be8-fe233f60f555 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:04.610301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee1bb2-74a8-4137-ae4a-e98c5a4295e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:04.610920 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee1bb2-74a8-4137-ae4a-e98c5a4295e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:04.611232 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee1bb2-74a8-4137-ae4a-e98c5a4295e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:04.611511 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee1bb2-74a8-4137-ae4a-e98c5a4295e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:04.612161 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee1bb2-74a8-4137-ae4a-e98c5a4295e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:04.613784 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee1bb2-74a8-4137-ae4a-e98c5a4295e6 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:04.625003 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1133/2281] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:37:04.629261 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d13f8-af50-42d0-b58f-fd8e208215e0 service neutron] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:04.641159 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d13f8-af50-42d0-b58f-fd8e208215e0 service neutron] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:04.647051 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58880d39-3f8d-4bd2-905b-35e87c8a933d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:04.647733 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58880d39-3f8d-4bd2-905b-35e87c8a933d admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:04.648041 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58880d39-3f8d-4bd2-905b-35e87c8a933d admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:04.648345 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58880d39-3f8d-4bd2-905b-35e87c8a933d admin admin] PATH_INFO: `/v3/projects/7d197065bb524de290f2b366c651bd9f/users/66578015411e4f5ca0917ed4a0c01da3/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:04.650781 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58880d39-3f8d-4bd2-905b-35e87c8a933d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d197065bb524de290f2b366c651bd9f, user_id=66578015411e4f5ca0917ed4a0c01da3, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:04.653897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58880d39-3f8d-4bd2-905b-35e87c8a933d admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:04.669755 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1149/2282] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:37:04 2022] PUT /identity/v3/projects/7d197065bb524de290f2b366c651bd9f/users/66578015411e4f5ca0917ed4a0c01da3/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:04.681519 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9005fa-e8ca-478f-9c39-7bba642075c5 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:04.681867 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9005fa-e8ca-478f-9c39-7bba642075c5 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:04.682148 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9005fa-e8ca-478f-9c39-7bba642075c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:04.717627 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-db9005fa-e8ca-478f-9c39-7bba642075c5 None None] MFA Rules not processed for user `66578015411e4f5ca0917ed4a0c01da3`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:04.718913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-db9005fa-e8ca-478f-9c39-7bba642075c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:04.793178 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1134/2283] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:04.804561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58880d39-3f8d-4bd2-905b-35e87c8a933d admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:04.806363 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-58880d39-3f8d-4bd2-905b-35e87c8a933d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:04.868426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58880d39-3f8d-4bd2-905b-35e87c8a933d admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:04.872293 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2c140-3243-46bb-9776-c11c918de58e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:04.872913 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2c140-3243-46bb-9776-c11c918de58e service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:04.873192 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2c140-3243-46bb-9776-c11c918de58e service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:04.873462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2c140-3243-46bb-9776-c11c918de58e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:04.883804 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2c140-3243-46bb-9776-c11c918de58e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:04.885250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2c140-3243-46bb-9776-c11c918de58e service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:04.896487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1150/2284] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:37:04.974902 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9005fa-e8ca-478f-9c39-7bba642075c5 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:04.991237 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9005fa-e8ca-478f-9c39-7bba642075c5 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:04.996779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e84833-8ae8-4324-8e40-1c6cc607af99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:04.997658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e84833-8ae8-4324-8e40-1c6cc607af99 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:04.997940 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e84833-8ae8-4324-8e40-1c6cc607af99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:04.999316 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e84833-8ae8-4324-8e40-1c6cc607af99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:05.066580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e84833-8ae8-4324-8e40-1c6cc607af99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:05.068063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e84833-8ae8-4324-8e40-1c6cc607af99 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:05.072811 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:05.078069 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1135/2285] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:37:06.912963 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec396e40-1f11-409a-9ac1-576290169678 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:06.913529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec396e40-1f11-409a-9ac1-576290169678 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:06.913529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec396e40-1f11-409a-9ac1-576290169678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:06.936564 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-ec396e40-1f11-409a-9ac1-576290169678 None None] MFA Rules not processed for user `66d63b0fb3514e7984e698afd21f2095`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:06.937781 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ec396e40-1f11-409a-9ac1-576290169678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:06.999432 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1151/2286] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:12.061724 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e84833-8ae8-4324-8e40-1c6cc607af99 service cinder] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:12.128173 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e84833-8ae8-4324-8e40-1c6cc607af99 service cinder] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:12.132870 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cab94b-b6ff-4575-b203-a4f069844c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:12.133506 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cab94b-b6ff-4575-b203-a4f069844c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:12.133788 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cab94b-b6ff-4575-b203-a4f069844c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:12.134052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cab94b-b6ff-4575-b203-a4f069844c48 admin admin] PATH_INFO: `/v3/users/4db58074e39d451b851713d02469195f` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:12.135224 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cab94b-b6ff-4575-b203-a4f069844c48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4db58074e39d451b851713d02469195f)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:12.137229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cab94b-b6ff-4575-b203-a4f069844c48 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:12.187410 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-91cab94b-b6ff-4575-b203-a4f069844c48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4db58074e39d451b851713d02469195f'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:12.188095 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-91cab94b-b6ff-4575-b203-a4f069844c48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4db58074e39d451b851713d02469195f'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:12.195756 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-91cab94b-b6ff-4575-b203-a4f069844c48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4db58074e39d451b851713d02469195f'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:12.196397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-91cab94b-b6ff-4575-b203-a4f069844c48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4db58074e39d451b851713d02469195f'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:12.204525 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-91cab94b-b6ff-4575-b203-a4f069844c48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4db58074e39d451b851713d02469195f'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:12.225213 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1136/2287] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:37:12 2022] DELETE /identity/v3/users/4db58074e39d451b851713d02469195f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:12.230099 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c547b-6780-40c7-8ae5-d629ac07f702 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:12.230573 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c547b-6780-40c7-8ae5-d629ac07f702 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:12.230666 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c547b-6780-40c7-8ae5-d629ac07f702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:12.249803 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-175c547b-6780-40c7-8ae5-d629ac07f702 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:12.251020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-175c547b-6780-40c7-8ae5-d629ac07f702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:12.337879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1152/2288] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:37:12.351729 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cab94b-b6ff-4575-b203-a4f069844c48 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:12.353329 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-91cab94b-b6ff-4575-b203-a4f069844c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:12.438212 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cab94b-b6ff-4575-b203-a4f069844c48 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:12.442147 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204b366-b493-46fe-99fd-c609dbd9dc2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:12.442839 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204b366-b493-46fe-99fd-c609dbd9dc2e service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:12.443170 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204b366-b493-46fe-99fd-c609dbd9dc2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:12.443547 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204b366-b493-46fe-99fd-c609dbd9dc2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:12.453696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204b366-b493-46fe-99fd-c609dbd9dc2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:12.455183 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204b366-b493-46fe-99fd-c609dbd9dc2e service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:12.465050 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1137/2289] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:37:12.927918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c547b-6780-40c7-8ae5-d629ac07f702 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:12.929437 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-175c547b-6780-40c7-8ae5-d629ac07f702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:12.942472 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c547b-6780-40c7-8ae5-d629ac07f702 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:12.948126 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f129f-1343-48c6-b226-d6134fadbdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:12.949186 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f129f-1343-48c6-b226-d6134fadbdd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:12.949645 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f129f-1343-48c6-b226-d6134fadbdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:12.950291 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f129f-1343-48c6-b226-d6134fadbdd1 admin admin] PATH_INFO: `/v3/projects/b17b1e39c7c34c699c59c1c4e8b8b035` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:12.951685 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f129f-1343-48c6-b226-d6134fadbdd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b17b1e39c7c34c699c59c1c4e8b8b035)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:12.954267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f129f-1343-48c6-b226-d6134fadbdd1 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:12.999033 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:13.027250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-800f129f-1343-48c6-b226-d6134fadbdd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b17b1e39c7c34c699c59c1c4e8b8b035', 'request_id': 'req-800f129f-1343-48c6-b226-d6134fadbdd1'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:13.032121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-800f129f-1343-48c6-b226-d6134fadbdd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b17b1e39c7c34c699c59c1c4e8b8b035', 'request_id': 'req-800f129f-1343-48c6-b226-d6134fadbdd1'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:13.039450 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-800f129f-1343-48c6-b226-d6134fadbdd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b17b1e39c7c34c699c59c1c4e8b8b035', 'request_id': 'req-800f129f-1343-48c6-b226-d6134fadbdd1'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:13.050505 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-800f129f-1343-48c6-b226-d6134fadbdd1 admin admin] The token cache is being invalidate because project b17b1e39c7c34c699c59c1c4e8b8b035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:37:13.050789 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-800f129f-1343-48c6-b226-d6134fadbdd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:13.051464 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-800f129f-1343-48c6-b226-d6134fadbdd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:13.052966 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1153/2290] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:37:12 2022] DELETE /identity/v3/projects/b17b1e39c7c34c699c59c1c4e8b8b035 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:13.057091 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204b366-b493-46fe-99fd-c609dbd9dc2e service neutron] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:13.066830 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204b366-b493-46fe-99fd-c609dbd9dc2e service neutron] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:13.086508 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:13.131236 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb5907-ad2e-48d5-ba2f-04cd918481f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:13.131784 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb5907-ad2e-48d5-ba2f-04cd918481f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:13.132051 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb5907-ad2e-48d5-ba2f-04cd918481f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:13.132313 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb5907-ad2e-48d5-ba2f-04cd918481f2 admin admin] PATH_INFO: `/v3/users/66578015411e4f5ca0917ed4a0c01da3` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:13.133431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb5907-ad2e-48d5-ba2f-04cd918481f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66578015411e4f5ca0917ed4a0c01da3)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:13.135370 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb5907-ad2e-48d5-ba2f-04cd918481f2 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:13.184375 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ecdb5907-ad2e-48d5-ba2f-04cd918481f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66578015411e4f5ca0917ed4a0c01da3'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:13.185035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ecdb5907-ad2e-48d5-ba2f-04cd918481f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66578015411e4f5ca0917ed4a0c01da3'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:13.191799 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ecdb5907-ad2e-48d5-ba2f-04cd918481f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66578015411e4f5ca0917ed4a0c01da3'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:13.192428 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ecdb5907-ad2e-48d5-ba2f-04cd918481f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66578015411e4f5ca0917ed4a0c01da3'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:13.200718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ecdb5907-ad2e-48d5-ba2f-04cd918481f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66578015411e4f5ca0917ed4a0c01da3'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:13.218326 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1138/2291] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:37:13 2022] DELETE /identity/v3/users/66578015411e4f5ca0917ed4a0c01da3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:13.506798 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f129f-1343-48c6-b226-d6134fadbdd1 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:13.508456 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-800f129f-1343-48c6-b226-d6134fadbdd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:13.522546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f129f-1343-48c6-b226-d6134fadbdd1 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:13.591729 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3078e-2f22-4101-8543-25de1ea9c0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:13.592512 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3078e-2f22-4101-8543-25de1ea9c0c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:13.592974 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3078e-2f22-4101-8543-25de1ea9c0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:13.593393 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3078e-2f22-4101-8543-25de1ea9c0c6 admin admin] PATH_INFO: `/v3/projects/7d197065bb524de290f2b366c651bd9f` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:13.601233 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3078e-2f22-4101-8543-25de1ea9c0c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d197065bb524de290f2b366c651bd9f)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:13.603268 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3078e-2f22-4101-8543-25de1ea9c0c6 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:13.661163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3bc3078e-2f22-4101-8543-25de1ea9c0c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d197065bb524de290f2b366c651bd9f', 'request_id': 'req-3bc3078e-2f22-4101-8543-25de1ea9c0c6'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:13.669408 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3bc3078e-2f22-4101-8543-25de1ea9c0c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d197065bb524de290f2b366c651bd9f', 'request_id': 'req-3bc3078e-2f22-4101-8543-25de1ea9c0c6'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:13.676028 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3bc3078e-2f22-4101-8543-25de1ea9c0c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d197065bb524de290f2b366c651bd9f', 'request_id': 'req-3bc3078e-2f22-4101-8543-25de1ea9c0c6'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:13.686099 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3bc3078e-2f22-4101-8543-25de1ea9c0c6 admin admin] The token cache is being invalidate because project 7d197065bb524de290f2b366c651bd9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:37:13.686378 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3bc3078e-2f22-4101-8543-25de1ea9c0c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:13.686975 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3bc3078e-2f22-4101-8543-25de1ea9c0c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:13.688490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1154/2292] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:37:13 2022] DELETE /identity/v3/projects/7d197065bb524de290f2b366c651bd9f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:13.693496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a529406-d7f9-4795-99f2-4601b586676c None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:13.693786 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a529406-d7f9-4795-99f2-4601b586676c None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:13.694061 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a529406-d7f9-4795-99f2-4601b586676c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:13.714084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-6a529406-d7f9-4795-99f2-4601b586676c None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:13.715384 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-6a529406-d7f9-4795-99f2-4601b586676c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:13.775932 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1139/2293] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:37:13.783732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9416e3-09b4-4d93-8d1a-d1b5bc025268 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:13.784114 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9416e3-09b4-4d93-8d1a-d1b5bc025268 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:13.784471 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9416e3-09b4-4d93-8d1a-d1b5bc025268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:13.806730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-3d9416e3-09b4-4d93-8d1a-d1b5bc025268 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:13.808009 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-3d9416e3-09b4-4d93-8d1a-d1b5bc025268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:13.817236 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1155/2294] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:13.821532 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a529406-d7f9-4795-99f2-4601b586676c None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:13.832049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a529406-d7f9-4795-99f2-4601b586676c None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:13.836988 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca1f38-60de-405f-8768-25b684c51bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:13.837594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca1f38-60de-405f-8768-25b684c51bfa admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:13.837871 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca1f38-60de-405f-8768-25b684c51bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:13.838167 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca1f38-60de-405f-8768-25b684c51bfa admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:13.839191 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca1f38-60de-405f-8768-25b684c51bfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:37:13.839496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca1f38-60de-405f-8768-25b684c51bfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:13.841210 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca1f38-60de-405f-8768-25b684c51bfa admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:13.853360 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1140/2295] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:37:13.858091 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9416e3-09b4-4d93-8d1a-d1b5bc025268 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:13.867618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9416e3-09b4-4d93-8d1a-d1b5bc025268 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:13.872583 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6bf5e-15ba-4b65-a5b0-6dfd1d77056a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:13.873185 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6bf5e-15ba-4b65-a5b0-6dfd1d77056a admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:13.873461 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6bf5e-15ba-4b65-a5b0-6dfd1d77056a admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:13.873732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6bf5e-15ba-4b65-a5b0-6dfd1d77056a admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:13.874366 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6bf5e-15ba-4b65-a5b0-6dfd1d77056a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:13.876310 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6bf5e-15ba-4b65-a5b0-6dfd1d77056a admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:13.906293 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1156/2296] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:37:13 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:37:13.910508 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca1f38-60de-405f-8768-25b684c51bfa admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:13.920810 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca1f38-60de-405f-8768-25b684c51bfa admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:13.946685 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:13.985950 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd7458-686e-4ddf-b5a6-51a5feafec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:13.986843 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd7458-686e-4ddf-b5a6-51a5feafec46 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:13.987181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd7458-686e-4ddf-b5a6-51a5feafec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:13.987455 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd7458-686e-4ddf-b5a6-51a5feafec46 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:13.988399 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd7458-686e-4ddf-b5a6-51a5feafec46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:13.991488 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd7458-686e-4ddf-b5a6-51a5feafec46 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:14.016645 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1141/2297] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:37:13 2022] POST /identity/v3/users => generated 282 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:37:14.021085 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6bf5e-15ba-4b65-a5b0-6dfd1d77056a admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:14.031830 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6bf5e-15ba-4b65-a5b0-6dfd1d77056a admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:14.036873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6eb0e3-a9ff-43f7-914d-8581d17aaeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:14.037473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6eb0e3-a9ff-43f7-914d-8581d17aaeee admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:14.037748 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6eb0e3-a9ff-43f7-914d-8581d17aaeee admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:14.038106 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6eb0e3-a9ff-43f7-914d-8581d17aaeee admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:14.038648 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6eb0e3-a9ff-43f7-914d-8581d17aaeee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:14.040288 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6eb0e3-a9ff-43f7-914d-8581d17aaeee admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:14.050775 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1157/2298] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:37:14.055003 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd7458-686e-4ddf-b5a6-51a5feafec46 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:14.065546 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd7458-686e-4ddf-b5a6-51a5feafec46 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:14.071117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebf882-9b5e-4e1a-973d-f57ece51f7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:14.071735 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebf882-9b5e-4e1a-973d-f57ece51f7fe admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:14.072048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebf882-9b5e-4e1a-973d-f57ece51f7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:14.072317 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebf882-9b5e-4e1a-973d-f57ece51f7fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:14.072968 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebf882-9b5e-4e1a-973d-f57ece51f7fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:14.074605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebf882-9b5e-4e1a-973d-f57ece51f7fe admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:14.085531 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1142/2299] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:37:14.089759 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6eb0e3-a9ff-43f7-914d-8581d17aaeee admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:14.096687 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:14.100409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6eb0e3-a9ff-43f7-914d-8581d17aaeee admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:14.108294 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2cd2cc-2bc6-44ea-9f5a-4aaea1998d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:14.109258 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cd2cc-2bc6-44ea-9f5a-4aaea1998d68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:14.109537 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cd2cc-2bc6-44ea-9f5a-4aaea1998d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:14.109810 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cd2cc-2bc6-44ea-9f5a-4aaea1998d68 admin admin] PATH_INFO: `/v3/projects/0b4a83705c244686967352c9a03b82b4/users/6e661f39ea1a4808a1f31e6586d12bea/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:14.131145 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2cd2cc-2bc6-44ea-9f5a-4aaea1998d68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b4a83705c244686967352c9a03b82b4, user_id=6e661f39ea1a4808a1f31e6586d12bea, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:14.131145 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2cd2cc-2bc6-44ea-9f5a-4aaea1998d68 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:14.143349 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1158/2300] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:37:14 2022] PUT /identity/v3/projects/0b4a83705c244686967352c9a03b82b4/users/6e661f39ea1a4808a1f31e6586d12bea/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:14.154057 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a745368-6db9-4331-a6f8-e21568aa33c0 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:14.154394 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a745368-6db9-4331-a6f8-e21568aa33c0 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:14.154678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a745368-6db9-4331-a6f8-e21568aa33c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:14.186289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-8a745368-6db9-4331-a6f8-e21568aa33c0 None None] MFA Rules not processed for user `6e661f39ea1a4808a1f31e6586d12bea`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:14.187637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-8a745368-6db9-4331-a6f8-e21568aa33c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:14.271806 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1143/2301] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:14.276368 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2cd2cc-2bc6-44ea-9f5a-4aaea1998d68 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:14.353222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2cd2cc-2bc6-44ea-9f5a-4aaea1998d68 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:14.358150 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f801ec-4e57-4fcc-b971-623b3fcb4556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:14.358874 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f801ec-4e57-4fcc-b971-623b3fcb4556 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:14.359065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f801ec-4e57-4fcc-b971-623b3fcb4556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:14.359344 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f801ec-4e57-4fcc-b971-623b3fcb4556 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:14.360260 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f801ec-4e57-4fcc-b971-623b3fcb4556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:14.362119 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f801ec-4e57-4fcc-b971-623b3fcb4556 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:14.393128 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1159/2302] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:37:14 2022] POST /identity/v3/projects => generated 365 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:37:14.397322 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a745368-6db9-4331-a6f8-e21568aa33c0 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:14.408949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a745368-6db9-4331-a6f8-e21568aa33c0 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:14.475870 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416244a-88a2-4da8-aa62-00a374743f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:14.476537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416244a-88a2-4da8-aa62-00a374743f8e admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:14.476811 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416244a-88a2-4da8-aa62-00a374743f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:14.477086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416244a-88a2-4da8-aa62-00a374743f8e admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:14.477868 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416244a-88a2-4da8-aa62-00a374743f8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:14.479844 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416244a-88a2-4da8-aa62-00a374743f8e admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:14.504010 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1144/2303] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:37:14 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:37:14.508095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f801ec-4e57-4fcc-b971-623b3fcb4556 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:14.519578 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f801ec-4e57-4fcc-b971-623b3fcb4556 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:14.524936 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867153e4-eb16-4ac8-8d24-6ca84421fbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:14.525704 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867153e4-eb16-4ac8-8d24-6ca84421fbdd admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:14.526168 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867153e4-eb16-4ac8-8d24-6ca84421fbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:14.526643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867153e4-eb16-4ac8-8d24-6ca84421fbdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:14.527448 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867153e4-eb16-4ac8-8d24-6ca84421fbdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:14.529215 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867153e4-eb16-4ac8-8d24-6ca84421fbdd admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:14.544858 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1160/2304] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:37:14.549187 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416244a-88a2-4da8-aa62-00a374743f8e admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:14.560838 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416244a-88a2-4da8-aa62-00a374743f8e admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:14.566663 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4c922-1091-4008-b5b3-bcd4fdb4c225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:14.567512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4c922-1091-4008-b5b3-bcd4fdb4c225 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:14.567794 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4c922-1091-4008-b5b3-bcd4fdb4c225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:14.568068 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4c922-1091-4008-b5b3-bcd4fdb4c225 admin admin] PATH_INFO: `/v3/projects/405179f0dabf4fa9afb8d27a88b2b1a5/users/a86123e0d1d8427ca365a0d6eae53a0c/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:14.587349 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4c922-1091-4008-b5b3-bcd4fdb4c225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=405179f0dabf4fa9afb8d27a88b2b1a5, user_id=a86123e0d1d8427ca365a0d6eae53a0c, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:14.590323 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4c922-1091-4008-b5b3-bcd4fdb4c225 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:14.607028 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1145/2305] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:37:14 2022] PUT /identity/v3/projects/405179f0dabf4fa9afb8d27a88b2b1a5/users/a86123e0d1d8427ca365a0d6eae53a0c/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:14.611754 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867153e4-eb16-4ac8-8d24-6ca84421fbdd admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:14.626062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867153e4-eb16-4ac8-8d24-6ca84421fbdd admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:14.706692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558158b-4fe6-4710-b29a-79106d911a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:14.707910 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558158b-4fe6-4710-b29a-79106d911a8b admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:14.707910 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558158b-4fe6-4710-b29a-79106d911a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:14.708242 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558158b-4fe6-4710-b29a-79106d911a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:14.709541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558158b-4fe6-4710-b29a-79106d911a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:14.711780 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558158b-4fe6-4710-b29a-79106d911a8b admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:14.725464 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1161/2306] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:37:14.730396 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4c922-1091-4008-b5b3-bcd4fdb4c225 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:14.736897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:14.742644 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4c922-1091-4008-b5b3-bcd4fdb4c225 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:14.749426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41733127-6241-42eb-bf35-a0b11ef32756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:14.750139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41733127-6241-42eb-bf35-a0b11ef32756 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:14.750645 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41733127-6241-42eb-bf35-a0b11ef32756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:14.751231 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41733127-6241-42eb-bf35-a0b11ef32756 admin admin] PATH_INFO: `/v3/projects/405179f0dabf4fa9afb8d27a88b2b1a5/users/a86123e0d1d8427ca365a0d6eae53a0c/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:14.753154 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41733127-6241-42eb-bf35-a0b11ef32756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=405179f0dabf4fa9afb8d27a88b2b1a5, user_id=a86123e0d1d8427ca365a0d6eae53a0c, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:14.755847 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41733127-6241-42eb-bf35-a0b11ef32756 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:14.770930 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1146/2307] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:37:14 2022] PUT /identity/v3/projects/405179f0dabf4fa9afb8d27a88b2b1a5/users/a86123e0d1d8427ca365a0d6eae53a0c/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:14.782918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da4b21-8f52-4b19-992b-4ed1a0de5d41 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:14.783471 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da4b21-8f52-4b19-992b-4ed1a0de5d41 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:14.783858 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da4b21-8f52-4b19-992b-4ed1a0de5d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:14.816342 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-05da4b21-8f52-4b19-992b-4ed1a0de5d41 None None] MFA Rules not processed for user `a86123e0d1d8427ca365a0d6eae53a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:14.817566 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-05da4b21-8f52-4b19-992b-4ed1a0de5d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:14.865996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:14.897457 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1162/2308] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:14.909014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41733127-6241-42eb-bf35-a0b11ef32756 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:14.910848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-41733127-6241-42eb-bf35-a0b11ef32756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:14.970567 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41733127-6241-42eb-bf35-a0b11ef32756 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:14.974168 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53526cc7-ca0e-456f-8b56-ac9036622045 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:14.974776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53526cc7-ca0e-456f-8b56-ac9036622045 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:14.975135 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53526cc7-ca0e-456f-8b56-ac9036622045 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:14.975407 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53526cc7-ca0e-456f-8b56-ac9036622045 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:14.984679 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53526cc7-ca0e-456f-8b56-ac9036622045 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:14.986167 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53526cc7-ca0e-456f-8b56-ac9036622045 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:14.996012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1147/2309] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:14 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:37:15.465941 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da4b21-8f52-4b19-992b-4ed1a0de5d41 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:15.543474 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da4b21-8f52-4b19-992b-4ed1a0de5d41 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:15.549886 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec61f28-105d-408a-b194-b275223adf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:15.550538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec61f28-105d-408a-b194-b275223adf0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:15.550809 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec61f28-105d-408a-b194-b275223adf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:15.551102 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec61f28-105d-408a-b194-b275223adf0e admin admin] PATH_INFO: `/v3/users/6e661f39ea1a4808a1f31e6586d12bea` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:15.552337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec61f28-105d-408a-b194-b275223adf0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e661f39ea1a4808a1f31e6586d12bea)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:15.558478 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec61f28-105d-408a-b194-b275223adf0e admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:15.617255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-0ec61f28-105d-408a-b194-b275223adf0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e661f39ea1a4808a1f31e6586d12bea'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:15.618196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-0ec61f28-105d-408a-b194-b275223adf0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e661f39ea1a4808a1f31e6586d12bea'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:15.627444 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-0ec61f28-105d-408a-b194-b275223adf0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e661f39ea1a4808a1f31e6586d12bea'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:15.636947 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-0ec61f28-105d-408a-b194-b275223adf0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e661f39ea1a4808a1f31e6586d12bea'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:15.638360 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-0ec61f28-105d-408a-b194-b275223adf0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e661f39ea1a4808a1f31e6586d12bea'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:15.663532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1163/2310] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:37:15 2022] DELETE /identity/v3/users/6e661f39ea1a4808a1f31e6586d12bea => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:15.668403 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35205d3f-e1f9-4d8d-b447-373e5626c0d7 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:15.668920 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35205d3f-e1f9-4d8d-b447-373e5626c0d7 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:15.668920 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35205d3f-e1f9-4d8d-b447-373e5626c0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:15.688054 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-35205d3f-e1f9-4d8d-b447-373e5626c0d7 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:15.689279 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-35205d3f-e1f9-4d8d-b447-373e5626c0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:15.774581 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1148/2311] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:15.785245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec61f28-105d-408a-b194-b275223adf0e admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:15.786880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-0ec61f28-105d-408a-b194-b275223adf0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:15.864484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec61f28-105d-408a-b194-b275223adf0e admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:15.868355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7a1a8-3e8a-4750-885a-6ce241ea3962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:15.868978 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7a1a8-3e8a-4750-885a-6ce241ea3962 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:15.869251 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7a1a8-3e8a-4750-885a-6ce241ea3962 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:15.869517 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7a1a8-3e8a-4750-885a-6ce241ea3962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:15.879906 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7a1a8-3e8a-4750-885a-6ce241ea3962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:15.881439 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7a1a8-3e8a-4750-885a-6ce241ea3962 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:15.885893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:15.894418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1164/2312] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:37:16.227881 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35205d3f-e1f9-4d8d-b447-373e5626c0d7 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:16.229513 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-35205d3f-e1f9-4d8d-b447-373e5626c0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:16.242285 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35205d3f-e1f9-4d8d-b447-373e5626c0d7 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:16.247629 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273d2fa-3532-4a81-b270-de0135a411d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:16.248282 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273d2fa-3532-4a81-b270-de0135a411d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:16.248549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273d2fa-3532-4a81-b270-de0135a411d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:16.248803 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273d2fa-3532-4a81-b270-de0135a411d4 admin admin] PATH_INFO: `/v3/projects/0b4a83705c244686967352c9a03b82b4` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:16.250113 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273d2fa-3532-4a81-b270-de0135a411d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b4a83705c244686967352c9a03b82b4)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:16.252262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273d2fa-3532-4a81-b270-de0135a411d4 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:16.307700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-6273d2fa-3532-4a81-b270-de0135a411d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b4a83705c244686967352c9a03b82b4', 'request_id': 'req-6273d2fa-3532-4a81-b270-de0135a411d4'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:16.316829 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-6273d2fa-3532-4a81-b270-de0135a411d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b4a83705c244686967352c9a03b82b4', 'request_id': 'req-6273d2fa-3532-4a81-b270-de0135a411d4'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:16.325214 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-6273d2fa-3532-4a81-b270-de0135a411d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b4a83705c244686967352c9a03b82b4', 'request_id': 'req-6273d2fa-3532-4a81-b270-de0135a411d4'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:16.339081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-6273d2fa-3532-4a81-b270-de0135a411d4 admin admin] The token cache is being invalidate because project 0b4a83705c244686967352c9a03b82b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:37:16.339525 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-6273d2fa-3532-4a81-b270-de0135a411d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:16.340215 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-6273d2fa-3532-4a81-b270-de0135a411d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:16.341747 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1149/2313] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:37:16 2022] DELETE /identity/v3/projects/0b4a83705c244686967352c9a03b82b4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:16.345891 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7a1a8-3e8a-4750-885a-6ce241ea3962 service neutron] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:16.355930 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7a1a8-3e8a-4750-885a-6ce241ea3962 service neutron] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:16.413376 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25887601-7e87-4d5f-835f-c0a8bbfc05cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:16.414021 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25887601-7e87-4d5f-835f-c0a8bbfc05cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:16.414300 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25887601-7e87-4d5f-835f-c0a8bbfc05cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:16.414573 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25887601-7e87-4d5f-835f-c0a8bbfc05cf admin admin] PATH_INFO: `/v3/users/a86123e0d1d8427ca365a0d6eae53a0c` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:16.415728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25887601-7e87-4d5f-835f-c0a8bbfc05cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a86123e0d1d8427ca365a0d6eae53a0c)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:16.417823 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25887601-7e87-4d5f-835f-c0a8bbfc05cf admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:16.464377 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-25887601-7e87-4d5f-835f-c0a8bbfc05cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a86123e0d1d8427ca365a0d6eae53a0c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:16.465139 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-25887601-7e87-4d5f-835f-c0a8bbfc05cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a86123e0d1d8427ca365a0d6eae53a0c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:16.472543 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-25887601-7e87-4d5f-835f-c0a8bbfc05cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a86123e0d1d8427ca365a0d6eae53a0c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:16.480680 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-25887601-7e87-4d5f-835f-c0a8bbfc05cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a86123e0d1d8427ca365a0d6eae53a0c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:16.481500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-25887601-7e87-4d5f-835f-c0a8bbfc05cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a86123e0d1d8427ca365a0d6eae53a0c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:16.499084 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1165/2314] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:37:16 2022] DELETE /identity/v3/users/a86123e0d1d8427ca365a0d6eae53a0c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:16.786760 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273d2fa-3532-4a81-b270-de0135a411d4 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:16.788317 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-6273d2fa-3532-4a81-b270-de0135a411d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:16.801760 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273d2fa-3532-4a81-b270-de0135a411d4 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:16.815047 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:16.865474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3922c0-6a34-42e4-9daa-7740ec0ae31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:16.866126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3922c0-6a34-42e4-9daa-7740ec0ae31f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:16.866406 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3922c0-6a34-42e4-9daa-7740ec0ae31f admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:16.866676 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3922c0-6a34-42e4-9daa-7740ec0ae31f admin admin] PATH_INFO: `/v3/projects/405179f0dabf4fa9afb8d27a88b2b1a5` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:16.867895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3922c0-6a34-42e4-9daa-7740ec0ae31f admin admin] RBAC: Authorizing `identity:delete_project(project_id=405179f0dabf4fa9afb8d27a88b2b1a5)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:16.869830 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3922c0-6a34-42e4-9daa-7740ec0ae31f admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:16.929192 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-bb3922c0-6a34-42e4-9daa-7740ec0ae31f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '405179f0dabf4fa9afb8d27a88b2b1a5', 'request_id': 'req-bb3922c0-6a34-42e4-9daa-7740ec0ae31f'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:16.939391 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-bb3922c0-6a34-42e4-9daa-7740ec0ae31f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '405179f0dabf4fa9afb8d27a88b2b1a5', 'request_id': 'req-bb3922c0-6a34-42e4-9daa-7740ec0ae31f'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:16.946765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-bb3922c0-6a34-42e4-9daa-7740ec0ae31f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '405179f0dabf4fa9afb8d27a88b2b1a5', 'request_id': 'req-bb3922c0-6a34-42e4-9daa-7740ec0ae31f'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:16.961137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-bb3922c0-6a34-42e4-9daa-7740ec0ae31f admin admin] The token cache is being invalidate because project 405179f0dabf4fa9afb8d27a88b2b1a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:37:16.961425 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-bb3922c0-6a34-42e4-9daa-7740ec0ae31f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:16.962070 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-bb3922c0-6a34-42e4-9daa-7740ec0ae31f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:16.963783 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1150/2315] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:37:16 2022] DELETE /identity/v3/projects/405179f0dabf4fa9afb8d27a88b2b1a5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:16.968667 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31688b00-04c6-453e-a7b3-7532b50a72a3 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:16.969157 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31688b00-04c6-453e-a7b3-7532b50a72a3 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:16.969337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31688b00-04c6-453e-a7b3-7532b50a72a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:16.988844 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-31688b00-04c6-453e-a7b3-7532b50a72a3 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:16.990037 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-31688b00-04c6-453e-a7b3-7532b50a72a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:17.054724 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1166/2316] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:17.064990 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccce40c-184a-49c9-9804-9b31ba91275c None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:17.065342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccce40c-184a-49c9-9804-9b31ba91275c None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:17.065799 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccce40c-184a-49c9-9804-9b31ba91275c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:17.087457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-dccce40c-184a-49c9-9804-9b31ba91275c None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:17.088695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-dccce40c-184a-49c9-9804-9b31ba91275c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:17.098542 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1151/2317] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:17.102936 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31688b00-04c6-453e-a7b3-7532b50a72a3 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:17.113433 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31688b00-04c6-453e-a7b3-7532b50a72a3 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:17.118120 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16955da-bbfe-4603-85df-6417cb2b7a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:17.119546 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16955da-bbfe-4603-85df-6417cb2b7a1b admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:17.119978 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16955da-bbfe-4603-85df-6417cb2b7a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:17.120260 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16955da-bbfe-4603-85df-6417cb2b7a1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:17.120944 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16955da-bbfe-4603-85df-6417cb2b7a1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:37:17.121245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16955da-bbfe-4603-85df-6417cb2b7a1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:17.122851 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16955da-bbfe-4603-85df-6417cb2b7a1b admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:17.135749 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1167/2318] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:37:17.140695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccce40c-184a-49c9-9804-9b31ba91275c None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:17.150014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccce40c-184a-49c9-9804-9b31ba91275c None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:17.154612 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc23f2c-ca99-451d-8ba1-273fcc9551c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:17.155248 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc23f2c-ca99-451d-8ba1-273fcc9551c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:17.155526 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc23f2c-ca99-451d-8ba1-273fcc9551c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:17.155843 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc23f2c-ca99-451d-8ba1-273fcc9551c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:17.156477 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc23f2c-ca99-451d-8ba1-273fcc9551c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:17.158629 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc23f2c-ca99-451d-8ba1-273fcc9551c6 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:17.187122 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1152/2319] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:37:17 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:37:17.191432 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16955da-bbfe-4603-85df-6417cb2b7a1b admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:17.198005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:17.202251 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16955da-bbfe-4603-85df-6417cb2b7a1b admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:17.243134 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc23f2c-ca99-451d-8ba1-273fcc9551c6 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:17.244857 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-0cc23f2c-ca99-451d-8ba1-273fcc9551c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:17.274521 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60f856-6b33-4488-81e3-196fea85bb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:17.275179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60f856-6b33-4488-81e3-196fea85bb11 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:17.275502 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60f856-6b33-4488-81e3-196fea85bb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:17.275843 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60f856-6b33-4488-81e3-196fea85bb11 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:17.276665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60f856-6b33-4488-81e3-196fea85bb11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:17.279960 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60f856-6b33-4488-81e3-196fea85bb11 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:17.308921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1168/2320] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:37:17 2022] POST /identity/v3/users => generated 283 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:37:17.313306 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60f856-6b33-4488-81e3-196fea85bb11 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:17.315230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc23f2c-ca99-451d-8ba1-273fcc9551c6 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:17.319400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69beda87-9e6d-4206-a413-6228128ca9d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:17.320024 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69beda87-9e6d-4206-a413-6228128ca9d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:17.320301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69beda87-9e6d-4206-a413-6228128ca9d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:17.320571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69beda87-9e6d-4206-a413-6228128ca9d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:17.322323 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-69beda87-9e6d-4206-a413-6228128ca9d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:17.323988 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60f856-6b33-4488-81e3-196fea85bb11 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:17.329133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478782ec-f7a4-416d-afe1-038d3a5f44b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:17.329873 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478782ec-f7a4-416d-afe1-038d3a5f44b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:17.330228 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478782ec-f7a4-416d-afe1-038d3a5f44b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:17.330549 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478782ec-f7a4-416d-afe1-038d3a5f44b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:17.331471 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478782ec-f7a4-416d-afe1-038d3a5f44b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:17.333432 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478782ec-f7a4-416d-afe1-038d3a5f44b2 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:17.348162 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1169/2321] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:37:17.352181 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478782ec-f7a4-416d-afe1-038d3a5f44b2 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:17.354485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:17.362761 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478782ec-f7a4-416d-afe1-038d3a5f44b2 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:17.368212 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdac630-fc98-41a0-b4d9-1e9543f94843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:17.368825 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdac630-fc98-41a0-b4d9-1e9543f94843 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:17.369098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdac630-fc98-41a0-b4d9-1e9543f94843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:17.369365 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdac630-fc98-41a0-b4d9-1e9543f94843 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:17.370025 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdac630-fc98-41a0-b4d9-1e9543f94843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:17.372095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdac630-fc98-41a0-b4d9-1e9543f94843 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:17.383263 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1170/2322] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:37:17.387490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdac630-fc98-41a0-b4d9-1e9543f94843 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:17.391676 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69beda87-9e6d-4206-a413-6228128ca9d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:17.393431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69beda87-9e6d-4206-a413-6228128ca9d5 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:17.399299 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdac630-fc98-41a0-b4d9-1e9543f94843 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:17.403671 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1153/2323] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:37:17.404250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398812a-b1f6-4b0f-9514-a1744b00e544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:17.404949 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398812a-b1f6-4b0f-9514-a1744b00e544 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:17.405272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398812a-b1f6-4b0f-9514-a1744b00e544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:17.405544 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398812a-b1f6-4b0f-9514-a1744b00e544 admin admin] PATH_INFO: `/v3/projects/9de8726718e14a09a15bc540295cc4a9/users/f773d5f104a84393bf1ad5128b565073/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:17.424324 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398812a-b1f6-4b0f-9514-a1744b00e544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de8726718e14a09a15bc540295cc4a9, user_id=f773d5f104a84393bf1ad5128b565073, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:17.427104 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398812a-b1f6-4b0f-9514-a1744b00e544 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:17.440411 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1171/2324] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:37:17 2022] PUT /identity/v3/projects/9de8726718e14a09a15bc540295cc4a9/users/f773d5f104a84393bf1ad5128b565073/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:37:17.452094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eef906-f15e-4817-87e6-d39fac0e3da1 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:17.452466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eef906-f15e-4817-87e6-d39fac0e3da1 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:17.452775 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eef906-f15e-4817-87e6-d39fac0e3da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:17.482147 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-81eef906-f15e-4817-87e6-d39fac0e3da1 None None] MFA Rules not processed for user `f773d5f104a84393bf1ad5128b565073`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:17.483453 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-81eef906-f15e-4817-87e6-d39fac0e3da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:17.549106 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1154/2325] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:17.553855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398812a-b1f6-4b0f-9514-a1744b00e544 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:17.619533 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398812a-b1f6-4b0f-9514-a1744b00e544 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:17.624453 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86aac3-cc0f-45fb-add1-8fc6d5b0a363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:17.625071 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86aac3-cc0f-45fb-add1-8fc6d5b0a363 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:17.625377 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86aac3-cc0f-45fb-add1-8fc6d5b0a363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:17.625786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86aac3-cc0f-45fb-add1-8fc6d5b0a363 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:17.626559 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86aac3-cc0f-45fb-add1-8fc6d5b0a363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:17.628545 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86aac3-cc0f-45fb-add1-8fc6d5b0a363 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:17.660613 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1172/2326] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:37:17 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:37:17.664387 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eef906-f15e-4817-87e6-d39fac0e3da1 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:17.675634 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eef906-f15e-4817-87e6-d39fac0e3da1 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:17.746469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d93f6-9c31-47b5-890a-f946309e52d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:17.747450 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d93f6-9c31-47b5-890a-f946309e52d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:17.747450 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d93f6-9c31-47b5-890a-f946309e52d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:17.747645 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d93f6-9c31-47b5-890a-f946309e52d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:17.748290 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d93f6-9c31-47b5-890a-f946309e52d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:17.750425 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d93f6-9c31-47b5-890a-f946309e52d4 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:17.783008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1155/2327] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:37:17 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:37:17.784391 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86aac3-cc0f-45fb-add1-8fc6d5b0a363 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:17.798007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86aac3-cc0f-45fb-add1-8fc6d5b0a363 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:17.807166 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e4ad3-abff-493f-bba2-fe5264ea5b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:17.807796 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e4ad3-abff-493f-bba2-fe5264ea5b6c admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:17.808128 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e4ad3-abff-493f-bba2-fe5264ea5b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:17.808402 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e4ad3-abff-493f-bba2-fe5264ea5b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:17.809511 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e4ad3-abff-493f-bba2-fe5264ea5b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:17.811471 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e4ad3-abff-493f-bba2-fe5264ea5b6c admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:17.831033 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1173/2328] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:37:17.832372 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d93f6-9c31-47b5-890a-f946309e52d4 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:17.845000 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d93f6-9c31-47b5-890a-f946309e52d4 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:17.851167 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081d7d7-f6af-47bd-a964-6c00f5dc533e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:17.852092 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081d7d7-f6af-47bd-a964-6c00f5dc533e admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:17.852283 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081d7d7-f6af-47bd-a964-6c00f5dc533e admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:17.852558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081d7d7-f6af-47bd-a964-6c00f5dc533e admin admin] PATH_INFO: `/v3/projects/a34957e03d63472786840a51384a324e/users/ceb2ef9923c849749727d4d6e5199ca7/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:17.869544 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081d7d7-f6af-47bd-a964-6c00f5dc533e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34957e03d63472786840a51384a324e, user_id=ceb2ef9923c849749727d4d6e5199ca7, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:17.872409 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081d7d7-f6af-47bd-a964-6c00f5dc533e admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:17.888216 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1156/2329] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:37:17 2022] PUT /identity/v3/projects/a34957e03d63472786840a51384a324e/users/ceb2ef9923c849749727d4d6e5199ca7/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:17.892625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e4ad3-abff-493f-bba2-fe5264ea5b6c admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:17.903118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e4ad3-abff-493f-bba2-fe5264ea5b6c admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:17.927477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:17.980303 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d56437-6b66-4835-bd8e-d604510c547a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:17.980968 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d56437-6b66-4835-bd8e-d604510c547a admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:17.981350 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d56437-6b66-4835-bd8e-d604510c547a admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:17.981687 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d56437-6b66-4835-bd8e-d604510c547a admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:17.982398 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d56437-6b66-4835-bd8e-d604510c547a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:17.984122 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d56437-6b66-4835-bd8e-d604510c547a admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:18.001688 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1174/2330] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:37:18.006220 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081d7d7-f6af-47bd-a964-6c00f5dc533e admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:18.018865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081d7d7-f6af-47bd-a964-6c00f5dc533e admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:18.028993 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a13cb-dc88-4ceb-a7ec-eb1877a6f17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:18.029679 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a13cb-dc88-4ceb-a7ec-eb1877a6f17e admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:18.029953 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a13cb-dc88-4ceb-a7ec-eb1877a6f17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:18.030218 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a13cb-dc88-4ceb-a7ec-eb1877a6f17e admin admin] PATH_INFO: `/v3/projects/a34957e03d63472786840a51384a324e/users/ceb2ef9923c849749727d4d6e5199ca7/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:18.032188 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a13cb-dc88-4ceb-a7ec-eb1877a6f17e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34957e03d63472786840a51384a324e, user_id=ceb2ef9923c849749727d4d6e5199ca7, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:18.034834 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a13cb-dc88-4ceb-a7ec-eb1877a6f17e admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:18.047876 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1157/2331] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:37:18 2022] PUT /identity/v3/projects/a34957e03d63472786840a51384a324e/users/ceb2ef9923c849749727d4d6e5199ca7/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:37:18.058539 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e2875-096e-416d-942d-2b0635f725a2 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:18.058827 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e2875-096e-416d-942d-2b0635f725a2 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:18.059137 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e2875-096e-416d-942d-2b0635f725a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:18.090574 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-378e2875-096e-416d-942d-2b0635f725a2 None None] MFA Rules not processed for user `ceb2ef9923c849749727d4d6e5199ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:18.091843 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-378e2875-096e-416d-942d-2b0635f725a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:18.181097 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1175/2332] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:18.193268 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a13cb-dc88-4ceb-a7ec-eb1877a6f17e admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:18.195125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-473a13cb-dc88-4ceb-a7ec-eb1877a6f17e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:18.206293 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:18.257792 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a13cb-dc88-4ceb-a7ec-eb1877a6f17e admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:18.261578 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85e3d6-ea0e-4674-8a66-47f4ccbd45da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:18.262185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85e3d6-ea0e-4674-8a66-47f4ccbd45da service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:18.262462 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85e3d6-ea0e-4674-8a66-47f4ccbd45da service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:18.262733 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85e3d6-ea0e-4674-8a66-47f4ccbd45da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:18.274045 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85e3d6-ea0e-4674-8a66-47f4ccbd45da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:18.275989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85e3d6-ea0e-4674-8a66-47f4ccbd45da service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:18.287551 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1158/2333] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:37:18.364363 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e2875-096e-416d-942d-2b0635f725a2 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:18.375700 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e2875-096e-416d-942d-2b0635f725a2 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:18.394204 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f6749-9581-4f46-97e0-02622ba06e65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:18.394837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f6749-9581-4f46-97e0-02622ba06e65 service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:18.395260 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f6749-9581-4f46-97e0-02622ba06e65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:18.395582 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f6749-9581-4f46-97e0-02622ba06e65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:18.462891 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f6749-9581-4f46-97e0-02622ba06e65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:18.464480 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f6749-9581-4f46-97e0-02622ba06e65 service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:18.476166 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1176/2334] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:37:21.488486 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85e3d6-ea0e-4674-8a66-47f4ccbd45da service cinder] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:21.575987 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85e3d6-ea0e-4674-8a66-47f4ccbd45da service cinder] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:21.583340 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cba3cd-3aaa-41bb-bf75-4328ef5af5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:21.584040 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cba3cd-3aaa-41bb-bf75-4328ef5af5ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:21.584617 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cba3cd-3aaa-41bb-bf75-4328ef5af5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:21.584617 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cba3cd-3aaa-41bb-bf75-4328ef5af5ab admin admin] PATH_INFO: `/v3/users/f773d5f104a84393bf1ad5128b565073` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:21.585684 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cba3cd-3aaa-41bb-bf75-4328ef5af5ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f773d5f104a84393bf1ad5128b565073)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:21.587795 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cba3cd-3aaa-41bb-bf75-4328ef5af5ab admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:21.656049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-d6cba3cd-3aaa-41bb-bf75-4328ef5af5ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f773d5f104a84393bf1ad5128b565073'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:21.656899 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-d6cba3cd-3aaa-41bb-bf75-4328ef5af5ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f773d5f104a84393bf1ad5128b565073'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:21.668314 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-d6cba3cd-3aaa-41bb-bf75-4328ef5af5ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f773d5f104a84393bf1ad5128b565073'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:21.669439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-d6cba3cd-3aaa-41bb-bf75-4328ef5af5ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f773d5f104a84393bf1ad5128b565073'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:21.679459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-d6cba3cd-3aaa-41bb-bf75-4328ef5af5ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f773d5f104a84393bf1ad5128b565073'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:21.699971 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1159/2335] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:37:21 2022] DELETE /identity/v3/users/f773d5f104a84393bf1ad5128b565073 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:21.704560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cacfa-c407-4539-8c4e-78156c7738b2 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:21.704999 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cacfa-c407-4539-8c4e-78156c7738b2 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:21.705095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cacfa-c407-4539-8c4e-78156c7738b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:21.736556 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-fa4cacfa-c407-4539-8c4e-78156c7738b2 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:21.737796 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-fa4cacfa-c407-4539-8c4e-78156c7738b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:21.783301 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:21.822126 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cba3cd-3aaa-41bb-bf75-4328ef5af5ab admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:21.823958 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-d6cba3cd-3aaa-41bb-bf75-4328ef5af5ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:21.836916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1177/2336] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:21.874681 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:21.905400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cba3cd-3aaa-41bb-bf75-4328ef5af5ab admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:21.910199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170be8e-6bc8-4018-a7a7-84a89907109c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:21.910829 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170be8e-6bc8-4018-a7a7-84a89907109c service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:21.911149 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170be8e-6bc8-4018-a7a7-84a89907109c service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:21.911418 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170be8e-6bc8-4018-a7a7-84a89907109c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:21.922611 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170be8e-6bc8-4018-a7a7-84a89907109c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:21.924340 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170be8e-6bc8-4018-a7a7-84a89907109c service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:21.937562 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1160/2337] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:37:22.560954 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cacfa-c407-4539-8c4e-78156c7738b2 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:22.562088 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-fa4cacfa-c407-4539-8c4e-78156c7738b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:22.582561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cacfa-c407-4539-8c4e-78156c7738b2 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:22.588264 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91f13c-df6e-4ecf-9fa6-4b89977b604a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:22.588923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91f13c-df6e-4ecf-9fa6-4b89977b604a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:22.589198 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91f13c-df6e-4ecf-9fa6-4b89977b604a admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:22.589462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91f13c-df6e-4ecf-9fa6-4b89977b604a admin admin] PATH_INFO: `/v3/projects/9de8726718e14a09a15bc540295cc4a9` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:22.590647 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91f13c-df6e-4ecf-9fa6-4b89977b604a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9de8726718e14a09a15bc540295cc4a9)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:22.592668 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91f13c-df6e-4ecf-9fa6-4b89977b604a admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:22.649361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8b91f13c-df6e-4ecf-9fa6-4b89977b604a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9de8726718e14a09a15bc540295cc4a9', 'request_id': 'req-8b91f13c-df6e-4ecf-9fa6-4b89977b604a'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:22.658560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8b91f13c-df6e-4ecf-9fa6-4b89977b604a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9de8726718e14a09a15bc540295cc4a9', 'request_id': 'req-8b91f13c-df6e-4ecf-9fa6-4b89977b604a'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:22.666669 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8b91f13c-df6e-4ecf-9fa6-4b89977b604a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9de8726718e14a09a15bc540295cc4a9', 'request_id': 'req-8b91f13c-df6e-4ecf-9fa6-4b89977b604a'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:22.679467 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8b91f13c-df6e-4ecf-9fa6-4b89977b604a admin admin] The token cache is being invalidate because project 9de8726718e14a09a15bc540295cc4a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:37:22.679762 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8b91f13c-df6e-4ecf-9fa6-4b89977b604a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:22.680509 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8b91f13c-df6e-4ecf-9fa6-4b89977b604a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:22.682145 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1178/2338] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:37:22 2022] DELETE /identity/v3/projects/9de8726718e14a09a15bc540295cc4a9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:22.686523 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170be8e-6bc8-4018-a7a7-84a89907109c service neutron] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:22.697106 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170be8e-6bc8-4018-a7a7-84a89907109c service neutron] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:22.757120 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a45666-2c43-46b4-8721-37d54af7071e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:22.757768 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a45666-2c43-46b4-8721-37d54af7071e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:22.758049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a45666-2c43-46b4-8721-37d54af7071e admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:22.758306 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a45666-2c43-46b4-8721-37d54af7071e admin admin] PATH_INFO: `/v3/users/ceb2ef9923c849749727d4d6e5199ca7` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:22.759494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a45666-2c43-46b4-8721-37d54af7071e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceb2ef9923c849749727d4d6e5199ca7)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:22.761505 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a45666-2c43-46b4-8721-37d54af7071e admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:22.815179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-90a45666-2c43-46b4-8721-37d54af7071e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceb2ef9923c849749727d4d6e5199ca7'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:22.816046 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-90a45666-2c43-46b4-8721-37d54af7071e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceb2ef9923c849749727d4d6e5199ca7'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:22.823549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-90a45666-2c43-46b4-8721-37d54af7071e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceb2ef9923c849749727d4d6e5199ca7'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:22.824216 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-90a45666-2c43-46b4-8721-37d54af7071e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceb2ef9923c849749727d4d6e5199ca7'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:22.832661 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-90a45666-2c43-46b4-8721-37d54af7071e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceb2ef9923c849749727d4d6e5199ca7'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:22.850711 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1161/2339] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:37:22 2022] DELETE /identity/v3/users/ceb2ef9923c849749727d4d6e5199ca7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:23.124199 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91f13c-df6e-4ecf-9fa6-4b89977b604a admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:23.125770 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8b91f13c-df6e-4ecf-9fa6-4b89977b604a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:23.140257 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91f13c-df6e-4ecf-9fa6-4b89977b604a admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:23.201130 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5068e23-436b-41a4-9c5d-9a0f330eae8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:23.201780 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5068e23-436b-41a4-9c5d-9a0f330eae8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:23.202059 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5068e23-436b-41a4-9c5d-9a0f330eae8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:23.202330 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5068e23-436b-41a4-9c5d-9a0f330eae8d admin admin] PATH_INFO: `/v3/projects/a34957e03d63472786840a51384a324e` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:23.203491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5068e23-436b-41a4-9c5d-9a0f330eae8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a34957e03d63472786840a51384a324e)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:23.206239 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5068e23-436b-41a4-9c5d-9a0f330eae8d admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:23.266869 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e5068e23-436b-41a4-9c5d-9a0f330eae8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a34957e03d63472786840a51384a324e', 'request_id': 'req-e5068e23-436b-41a4-9c5d-9a0f330eae8d'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:23.280762 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e5068e23-436b-41a4-9c5d-9a0f330eae8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a34957e03d63472786840a51384a324e', 'request_id': 'req-e5068e23-436b-41a4-9c5d-9a0f330eae8d'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:23.289619 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e5068e23-436b-41a4-9c5d-9a0f330eae8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a34957e03d63472786840a51384a324e', 'request_id': 'req-e5068e23-436b-41a4-9c5d-9a0f330eae8d'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:23.294881 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:23.302844 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e5068e23-436b-41a4-9c5d-9a0f330eae8d admin admin] The token cache is being invalidate because project a34957e03d63472786840a51384a324e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:37:23.303592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e5068e23-436b-41a4-9c5d-9a0f330eae8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:23.304382 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e5068e23-436b-41a4-9c5d-9a0f330eae8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:23.306533 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1179/2340] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:37:23 2022] DELETE /identity/v3/projects/a34957e03d63472786840a51384a324e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:23.312243 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f570d2e-3037-4a34-8dca-8ceacf0de889 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:23.312559 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f570d2e-3037-4a34-8dca-8ceacf0de889 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:23.312837 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f570d2e-3037-4a34-8dca-8ceacf0de889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:23.344243 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-2f570d2e-3037-4a34-8dca-8ceacf0de889 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:23.345767 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-2f570d2e-3037-4a34-8dca-8ceacf0de889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:23.403072 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:23.421972 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1162/2341] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:23.429751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90c662-ec3f-452e-a817-b0b22153beef None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:23.430044 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90c662-ec3f-452e-a817-b0b22153beef None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:23.430317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90c662-ec3f-452e-a817-b0b22153beef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:23.450535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-7e90c662-ec3f-452e-a817-b0b22153beef None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:23.451794 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-7e90c662-ec3f-452e-a817-b0b22153beef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:23.459946 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1180/2342] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:23.464085 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f570d2e-3037-4a34-8dca-8ceacf0de889 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:23.474222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f570d2e-3037-4a34-8dca-8ceacf0de889 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:23.478784 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d041fc-58bf-4486-8b47-1edc0b2000e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:23.479431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d041fc-58bf-4486-8b47-1edc0b2000e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:23.479707 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d041fc-58bf-4486-8b47-1edc0b2000e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:23.479976 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d041fc-58bf-4486-8b47-1edc0b2000e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:23.480621 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d041fc-58bf-4486-8b47-1edc0b2000e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:37:23.480915 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d041fc-58bf-4486-8b47-1edc0b2000e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:23.482511 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d041fc-58bf-4486-8b47-1edc0b2000e8 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:23.495186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1163/2343] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:37:23.500000 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90c662-ec3f-452e-a817-b0b22153beef None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:23.510794 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90c662-ec3f-452e-a817-b0b22153beef None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:23.516173 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cc52d-b654-40b8-94cd-c1814fb7a412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:23.516861 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cc52d-b654-40b8-94cd-c1814fb7a412 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:23.517207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cc52d-b654-40b8-94cd-c1814fb7a412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:23.517543 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cc52d-b654-40b8-94cd-c1814fb7a412 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:23.518251 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29cc52d-b654-40b8-94cd-c1814fb7a412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:23.520434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29cc52d-b654-40b8-94cd-c1814fb7a412 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:23.551381 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1181/2344] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:37:23 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:37:23.555657 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d041fc-58bf-4486-8b47-1edc0b2000e8 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:23.567858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d041fc-58bf-4486-8b47-1edc0b2000e8 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:23.666293 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7cd99-454b-4d2f-97ad-fa0c857012cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:23.666831 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7cd99-454b-4d2f-97ad-fa0c857012cf admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:23.667145 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7cd99-454b-4d2f-97ad-fa0c857012cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:23.667408 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7cd99-454b-4d2f-97ad-fa0c857012cf admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:23.668084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7cd99-454b-4d2f-97ad-fa0c857012cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:23.670840 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7cd99-454b-4d2f-97ad-fa0c857012cf admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:23.698628 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1164/2345] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:37:23 2022] POST /identity/v3/users => generated 294 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:37:23.702520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cc52d-b654-40b8-94cd-c1814fb7a412 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:23.715913 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cc52d-b654-40b8-94cd-c1814fb7a412 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:23.721963 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff8fb8-e1e4-446d-a9e8-22d0b62eb836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:23.722584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff8fb8-e1e4-446d-a9e8-22d0b62eb836 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:23.722862 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff8fb8-e1e4-446d-a9e8-22d0b62eb836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:23.723180 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff8fb8-e1e4-446d-a9e8-22d0b62eb836 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:23.723833 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff8fb8-e1e4-446d-a9e8-22d0b62eb836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:23.725422 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff8fb8-e1e4-446d-a9e8-22d0b62eb836 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:23.736634 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1182/2346] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:37:23.740983 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7cd99-454b-4d2f-97ad-fa0c857012cf admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:23.752891 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7cd99-454b-4d2f-97ad-fa0c857012cf admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:23.757646 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f159c-6be8-4c6b-95d1-94c0da36706e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:23.758271 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f159c-6be8-4c6b-95d1-94c0da36706e admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:23.758548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f159c-6be8-4c6b-95d1-94c0da36706e admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:23.758820 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f159c-6be8-4c6b-95d1-94c0da36706e admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:23.759515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f159c-6be8-4c6b-95d1-94c0da36706e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:23.761128 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f159c-6be8-4c6b-95d1-94c0da36706e admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:23.775858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1165/2347] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:37:23.777222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff8fb8-e1e4-446d-a9e8-22d0b62eb836 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:23.787744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff8fb8-e1e4-446d-a9e8-22d0b62eb836 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:23.792726 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f8643-2760-4d08-9ad7-ec72f13339f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:23.793373 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f8643-2760-4d08-9ad7-ec72f13339f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:23.793649 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f8643-2760-4d08-9ad7-ec72f13339f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:23.793929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f8643-2760-4d08-9ad7-ec72f13339f2 admin admin] PATH_INFO: `/v3/projects/4cf80dac66ca43238bf8ed37be82d365/users/d7284d0a2035473c96b172213bc94141/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:23.810747 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f8643-2760-4d08-9ad7-ec72f13339f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cf80dac66ca43238bf8ed37be82d365, user_id=d7284d0a2035473c96b172213bc94141, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:23.813591 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f8643-2760-4d08-9ad7-ec72f13339f2 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:23.829194 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1183/2348] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:37:23 2022] PUT /identity/v3/projects/4cf80dac66ca43238bf8ed37be82d365/users/d7284d0a2035473c96b172213bc94141/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:37:23.841165 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2841dc-a017-4ad9-a87e-4543499d9f5f None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:23.841426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2841dc-a017-4ad9-a87e-4543499d9f5f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:23.841709 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2841dc-a017-4ad9-a87e-4543499d9f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:23.878936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-9d2841dc-a017-4ad9-a87e-4543499d9f5f None None] MFA Rules not processed for user `d7284d0a2035473c96b172213bc94141`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:23.880259 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-9d2841dc-a017-4ad9-a87e-4543499d9f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:23.961945 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1166/2349] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:23.966528 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f8643-2760-4d08-9ad7-ec72f13339f2 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:24.030186 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f8643-2760-4d08-9ad7-ec72f13339f2 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:24.035204 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb53108-78bf-4ea8-8252-eefdd04187cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:24.035935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb53108-78bf-4ea8-8252-eefdd04187cf admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:24.036217 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb53108-78bf-4ea8-8252-eefdd04187cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:24.036484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb53108-78bf-4ea8-8252-eefdd04187cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:24.037180 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb53108-78bf-4ea8-8252-eefdd04187cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:24.039155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb53108-78bf-4ea8-8252-eefdd04187cf admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:24.068844 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1184/2350] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:37:23 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:37:24.073083 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2841dc-a017-4ad9-a87e-4543499d9f5f None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:24.084219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2841dc-a017-4ad9-a87e-4543499d9f5f None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:24.130170 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:24.143461 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f799f-d943-4d47-a54b-58a128b265ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:24.144053 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f799f-d943-4d47-a54b-58a128b265ec admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:24.144382 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f799f-d943-4d47-a54b-58a128b265ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:24.144631 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f799f-d943-4d47-a54b-58a128b265ec admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:24.145285 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f799f-d943-4d47-a54b-58a128b265ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:24.147248 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f799f-d943-4d47-a54b-58a128b265ec admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:24.170230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1167/2351] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:37:24 2022] POST /identity/v3/users => generated 301 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:37:24.174303 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb53108-78bf-4ea8-8252-eefdd04187cf admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:24.185261 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb53108-78bf-4ea8-8252-eefdd04187cf admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:24.190129 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86951a69-08d8-4dc0-9366-e4b3864dcf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:24.190741 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86951a69-08d8-4dc0-9366-e4b3864dcf93 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:24.191037 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86951a69-08d8-4dc0-9366-e4b3864dcf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:24.191308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86951a69-08d8-4dc0-9366-e4b3864dcf93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:24.191956 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86951a69-08d8-4dc0-9366-e4b3864dcf93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:24.193551 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86951a69-08d8-4dc0-9366-e4b3864dcf93 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:24.205506 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1185/2352] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:37:24.211318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f799f-d943-4d47-a54b-58a128b265ec admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:24.221909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f799f-d943-4d47-a54b-58a128b265ec admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:24.227187 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c483c13-8239-43fb-9f1e-49c2afb1894e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:24.227849 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c483c13-8239-43fb-9f1e-49c2afb1894e admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:24.228129 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c483c13-8239-43fb-9f1e-49c2afb1894e admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:24.228435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c483c13-8239-43fb-9f1e-49c2afb1894e admin admin] PATH_INFO: `/v3/projects/6764c6ef516c4b27977ac88f3251de47/users/d18a169f0dc644579f66d5752afc9dfd/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:24.246540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c483c13-8239-43fb-9f1e-49c2afb1894e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6764c6ef516c4b27977ac88f3251de47, user_id=d18a169f0dc644579f66d5752afc9dfd, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:24.249275 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c483c13-8239-43fb-9f1e-49c2afb1894e admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:24.265477 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1168/2353] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:37:24 2022] PUT /identity/v3/projects/6764c6ef516c4b27977ac88f3251de47/users/d18a169f0dc644579f66d5752afc9dfd/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:24.269679 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86951a69-08d8-4dc0-9366-e4b3864dcf93 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:24.283418 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86951a69-08d8-4dc0-9366-e4b3864dcf93 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:24.341776 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6e534-2a26-4681-8ce2-bbc6011b6852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:24.342392 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6e534-2a26-4681-8ce2-bbc6011b6852 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:24.342665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6e534-2a26-4681-8ce2-bbc6011b6852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:24.342935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6e534-2a26-4681-8ce2-bbc6011b6852 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:24.343606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6e534-2a26-4681-8ce2-bbc6011b6852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:24.345212 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6e534-2a26-4681-8ce2-bbc6011b6852 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:24.355044 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1186/2354] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:37:24.359522 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c483c13-8239-43fb-9f1e-49c2afb1894e admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:24.370665 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c483c13-8239-43fb-9f1e-49c2afb1894e admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:24.376672 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea73188-ba7d-4ad7-aa46-122e391b3783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:24.377368 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea73188-ba7d-4ad7-aa46-122e391b3783 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:24.377648 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea73188-ba7d-4ad7-aa46-122e391b3783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:24.377889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea73188-ba7d-4ad7-aa46-122e391b3783 admin admin] PATH_INFO: `/v3/projects/6764c6ef516c4b27977ac88f3251de47/users/d18a169f0dc644579f66d5752afc9dfd/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:24.380133 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea73188-ba7d-4ad7-aa46-122e391b3783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6764c6ef516c4b27977ac88f3251de47, user_id=d18a169f0dc644579f66d5752afc9dfd, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:24.382818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea73188-ba7d-4ad7-aa46-122e391b3783 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:24.395529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1169/2355] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:37:24 2022] PUT /identity/v3/projects/6764c6ef516c4b27977ac88f3251de47/users/d18a169f0dc644579f66d5752afc9dfd/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:24.406304 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477b53c-89e2-4837-a50e-f034f131f4b0 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:24.408111 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477b53c-89e2-4837-a50e-f034f131f4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:24.408111 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477b53c-89e2-4837-a50e-f034f131f4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:24.419461 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:24.445229 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-5477b53c-89e2-4837-a50e-f034f131f4b0 None None] MFA Rules not processed for user `d18a169f0dc644579f66d5752afc9dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:24.446635 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-5477b53c-89e2-4837-a50e-f034f131f4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:24.523037 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1187/2356] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:24 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:24.534509 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea73188-ba7d-4ad7-aa46-122e391b3783 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:24.536336 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-aea73188-ba7d-4ad7-aa46-122e391b3783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:24.606177 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea73188-ba7d-4ad7-aa46-122e391b3783 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:24.610295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5eb9d6-ac54-4549-8afa-6d076b867162 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:24.611281 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5eb9d6-ac54-4549-8afa-6d076b867162 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:24.611591 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5eb9d6-ac54-4549-8afa-6d076b867162 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:24.612013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5eb9d6-ac54-4549-8afa-6d076b867162 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:24.623397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5eb9d6-ac54-4549-8afa-6d076b867162 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:24.624862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5eb9d6-ac54-4549-8afa-6d076b867162 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:24.635966 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1170/2357] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:24 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:37:24.715311 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477b53c-89e2-4837-a50e-f034f131f4b0 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:24.716832 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-5477b53c-89e2-4837-a50e-f034f131f4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:24.779720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5eb9d6-ac54-4549-8afa-6d076b867162 service cinder] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:24.803853 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477b53c-89e2-4837-a50e-f034f131f4b0 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:24.810772 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1be44-d218-4b6d-9214-4ed794cee30b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:24.811423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1be44-d218-4b6d-9214-4ed794cee30b service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:24.811700 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1be44-d218-4b6d-9214-4ed794cee30b service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:24.811971 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1be44-d218-4b6d-9214-4ed794cee30b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:24.813702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-d8b1be44-d218-4b6d-9214-4ed794cee30b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:24.841626 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5eb9d6-ac54-4549-8afa-6d076b867162 service cinder] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:24.847460 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f1e75-df2b-4ea3-8124-a8beece7e884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:24.848350 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f1e75-df2b-4ea3-8124-a8beece7e884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:24.848626 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f1e75-df2b-4ea3-8124-a8beece7e884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:24.848913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f1e75-df2b-4ea3-8124-a8beece7e884 admin admin] PATH_INFO: `/v3/users/d7284d0a2035473c96b172213bc94141` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:24.850105 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f1e75-df2b-4ea3-8124-a8beece7e884 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7284d0a2035473c96b172213bc94141)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:24.852088 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f1e75-df2b-4ea3-8124-a8beece7e884 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:24.873868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b1be44-d218-4b6d-9214-4ed794cee30b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:24.875517 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b1be44-d218-4b6d-9214-4ed794cee30b service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:24.885021 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1188/2358] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:24 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:37:24.901091 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:24.903199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-672f1e75-df2b-4ea3-8124-a8beece7e884 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7284d0a2035473c96b172213bc94141'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:24.904264 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-672f1e75-df2b-4ea3-8124-a8beece7e884 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7284d0a2035473c96b172213bc94141'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:24.914162 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-672f1e75-df2b-4ea3-8124-a8beece7e884 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7284d0a2035473c96b172213bc94141'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:24.914874 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-672f1e75-df2b-4ea3-8124-a8beece7e884 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7284d0a2035473c96b172213bc94141'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:24.922686 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-672f1e75-df2b-4ea3-8124-a8beece7e884 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7284d0a2035473c96b172213bc94141'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:24.940364 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1171/2359] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:37:24 2022] DELETE /identity/v3/users/d7284d0a2035473c96b172213bc94141 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:37:24.945019 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68458c2e-fa18-426b-bad8-eacdf1d2eca6 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:24.945317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68458c2e-fa18-426b-bad8-eacdf1d2eca6 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:24.945586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68458c2e-fa18-426b-bad8-eacdf1d2eca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:24.965632 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-68458c2e-fa18-426b-bad8-eacdf1d2eca6 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:24.966860 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-68458c2e-fa18-426b-bad8-eacdf1d2eca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:24.986901 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:25.031166 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1189/2360] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:25.040325 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f1e75-df2b-4ea3-8124-a8beece7e884 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:25.046746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-672f1e75-df2b-4ea3-8124-a8beece7e884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:25.109220 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f1e75-df2b-4ea3-8124-a8beece7e884 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:25.113354 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c925bf5-3ff0-43a1-9e88-c10d0c8c0e12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:25.113965 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c925bf5-3ff0-43a1-9e88-c10d0c8c0e12 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:25.114240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c925bf5-3ff0-43a1-9e88-c10d0c8c0e12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:25.114518 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c925bf5-3ff0-43a1-9e88-c10d0c8c0e12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:25.124117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c925bf5-3ff0-43a1-9e88-c10d0c8c0e12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:25.125547 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c925bf5-3ff0-43a1-9e88-c10d0c8c0e12 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:25.137345 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1172/2361] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:37:25.435214 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68458c2e-fa18-426b-bad8-eacdf1d2eca6 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:25.436687 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-68458c2e-fa18-426b-bad8-eacdf1d2eca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:25.449086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68458c2e-fa18-426b-bad8-eacdf1d2eca6 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:25.453985 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4338c01-dfbc-432f-8bc1-f30b58aff7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:25.454659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4338c01-dfbc-432f-8bc1-f30b58aff7a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:25.454935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4338c01-dfbc-432f-8bc1-f30b58aff7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:25.455232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4338c01-dfbc-432f-8bc1-f30b58aff7a2 admin admin] PATH_INFO: `/v3/projects/4cf80dac66ca43238bf8ed37be82d365` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:25.456372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4338c01-dfbc-432f-8bc1-f30b58aff7a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cf80dac66ca43238bf8ed37be82d365)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:25.458336 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4338c01-dfbc-432f-8bc1-f30b58aff7a2 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:25.505931 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c4338c01-dfbc-432f-8bc1-f30b58aff7a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cf80dac66ca43238bf8ed37be82d365', 'request_id': 'req-c4338c01-dfbc-432f-8bc1-f30b58aff7a2'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:25.514148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c4338c01-dfbc-432f-8bc1-f30b58aff7a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cf80dac66ca43238bf8ed37be82d365', 'request_id': 'req-c4338c01-dfbc-432f-8bc1-f30b58aff7a2'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:25.520511 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c4338c01-dfbc-432f-8bc1-f30b58aff7a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cf80dac66ca43238bf8ed37be82d365', 'request_id': 'req-c4338c01-dfbc-432f-8bc1-f30b58aff7a2'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:25.531432 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c4338c01-dfbc-432f-8bc1-f30b58aff7a2 admin admin] The token cache is being invalidate because project 4cf80dac66ca43238bf8ed37be82d365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:37:25.531651 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c4338c01-dfbc-432f-8bc1-f30b58aff7a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:25.532373 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c4338c01-dfbc-432f-8bc1-f30b58aff7a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:25.533926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1190/2362] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:37:25 2022] DELETE /identity/v3/projects/4cf80dac66ca43238bf8ed37be82d365 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:25.538148 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c925bf5-3ff0-43a1-9e88-c10d0c8c0e12 service neutron] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:25.548927 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c925bf5-3ff0-43a1-9e88-c10d0c8c0e12 service neutron] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:25.612651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790e0dd-6334-4fe7-b705-7c9d881afcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:25.613330 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790e0dd-6334-4fe7-b705-7c9d881afcb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:25.613604 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790e0dd-6334-4fe7-b705-7c9d881afcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:25.613869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790e0dd-6334-4fe7-b705-7c9d881afcb2 admin admin] PATH_INFO: `/v3/users/d18a169f0dc644579f66d5752afc9dfd` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:25.615153 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7790e0dd-6334-4fe7-b705-7c9d881afcb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d18a169f0dc644579f66d5752afc9dfd)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:25.617135 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7790e0dd-6334-4fe7-b705-7c9d881afcb2 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:25.671327 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-7790e0dd-6334-4fe7-b705-7c9d881afcb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd18a169f0dc644579f66d5752afc9dfd'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:25.672081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-7790e0dd-6334-4fe7-b705-7c9d881afcb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd18a169f0dc644579f66d5752afc9dfd'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:25.679632 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-7790e0dd-6334-4fe7-b705-7c9d881afcb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd18a169f0dc644579f66d5752afc9dfd'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:25.680315 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-7790e0dd-6334-4fe7-b705-7c9d881afcb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd18a169f0dc644579f66d5752afc9dfd'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:25.689293 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-7790e0dd-6334-4fe7-b705-7c9d881afcb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd18a169f0dc644579f66d5752afc9dfd'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:25.694152 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:25.712449 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1173/2363] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:37:25 2022] DELETE /identity/v3/users/d18a169f0dc644579f66d5752afc9dfd => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:26.053163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4338c01-dfbc-432f-8bc1-f30b58aff7a2 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:26.054893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-c4338c01-dfbc-432f-8bc1-f30b58aff7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:26.069302 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4338c01-dfbc-432f-8bc1-f30b58aff7a2 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:26.131564 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79fd0f-c458-4b74-a95b-3443b82d0c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:26.132208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79fd0f-c458-4b74-a95b-3443b82d0c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:26.132489 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79fd0f-c458-4b74-a95b-3443b82d0c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:26.132775 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79fd0f-c458-4b74-a95b-3443b82d0c04 admin admin] PATH_INFO: `/v3/projects/6764c6ef516c4b27977ac88f3251de47` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:26.133926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79fd0f-c458-4b74-a95b-3443b82d0c04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6764c6ef516c4b27977ac88f3251de47)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:26.135879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79fd0f-c458-4b74-a95b-3443b82d0c04 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:26.185362 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-6b79fd0f-c458-4b74-a95b-3443b82d0c04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6764c6ef516c4b27977ac88f3251de47', 'request_id': 'req-6b79fd0f-c458-4b74-a95b-3443b82d0c04'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:26.187200 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:26.194853 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-6b79fd0f-c458-4b74-a95b-3443b82d0c04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6764c6ef516c4b27977ac88f3251de47', 'request_id': 'req-6b79fd0f-c458-4b74-a95b-3443b82d0c04'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:26.203006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-6b79fd0f-c458-4b74-a95b-3443b82d0c04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6764c6ef516c4b27977ac88f3251de47', 'request_id': 'req-6b79fd0f-c458-4b74-a95b-3443b82d0c04'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:26.214145 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-6b79fd0f-c458-4b74-a95b-3443b82d0c04 admin admin] The token cache is being invalidate because project 6764c6ef516c4b27977ac88f3251de47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:37:26.214435 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-6b79fd0f-c458-4b74-a95b-3443b82d0c04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:26.215145 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-6b79fd0f-c458-4b74-a95b-3443b82d0c04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:26.216680 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1191/2364] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:37:26 2022] DELETE /identity/v3/projects/6764c6ef516c4b27977ac88f3251de47 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:26.224296 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa51e8-d0f8-4bc7-8267-aff045bf0372 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:26.224798 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa51e8-d0f8-4bc7-8267-aff045bf0372 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:26.225040 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa51e8-d0f8-4bc7-8267-aff045bf0372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:26.247658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-1ffa51e8-d0f8-4bc7-8267-aff045bf0372 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:26.249113 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-1ffa51e8-d0f8-4bc7-8267-aff045bf0372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:26.314095 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1174/2365] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:26.326104 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd8a05-cd06-4298-ae16-1743430c5a9c None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:26.326293 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd8a05-cd06-4298-ae16-1743430c5a9c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:26.326558 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd8a05-cd06-4298-ae16-1743430c5a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:26.346951 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-75cd8a05-cd06-4298-ae16-1743430c5a9c None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:26.348195 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-75cd8a05-cd06-4298-ae16-1743430c5a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:26.356738 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1192/2366] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:37:26.361311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa51e8-d0f8-4bc7-8267-aff045bf0372 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:26.371853 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa51e8-d0f8-4bc7-8267-aff045bf0372 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:26.377952 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845e7a5-7ed6-400b-97f2-cfc96911cc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:26.378572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845e7a5-7ed6-400b-97f2-cfc96911cc6d admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:26.378842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845e7a5-7ed6-400b-97f2-cfc96911cc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:26.379130 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845e7a5-7ed6-400b-97f2-cfc96911cc6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:26.379806 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845e7a5-7ed6-400b-97f2-cfc96911cc6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:37:26.380101 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845e7a5-7ed6-400b-97f2-cfc96911cc6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:26.381695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845e7a5-7ed6-400b-97f2-cfc96911cc6d admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:26.394239 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1175/2367] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:37:26.398646 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd8a05-cd06-4298-ae16-1743430c5a9c None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:26.408425 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd8a05-cd06-4298-ae16-1743430c5a9c None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:26.414377 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863db4f-0680-46cd-96a7-133c8491186f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:26.415006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863db4f-0680-46cd-96a7-133c8491186f admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:26.415299 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863db4f-0680-46cd-96a7-133c8491186f admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:26.415569 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863db4f-0680-46cd-96a7-133c8491186f admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:26.416203 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863db4f-0680-46cd-96a7-133c8491186f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:26.418248 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863db4f-0680-46cd-96a7-133c8491186f admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:26.448236 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1193/2368] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:37:26 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:37:26.453958 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845e7a5-7ed6-400b-97f2-cfc96911cc6d admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:26.464844 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845e7a5-7ed6-400b-97f2-cfc96911cc6d admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:26.530701 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4bc14-04b3-4c1e-a0fc-d7df5442ab90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:26.531448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4bc14-04b3-4c1e-a0fc-d7df5442ab90 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:26.531729 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4bc14-04b3-4c1e-a0fc-d7df5442ab90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:26.531998 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4bc14-04b3-4c1e-a0fc-d7df5442ab90 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:26.532645 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4bc14-04b3-4c1e-a0fc-d7df5442ab90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:26.534618 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4bc14-04b3-4c1e-a0fc-d7df5442ab90 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:26.559902 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1176/2369] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:37:26 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:37:26.563881 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863db4f-0680-46cd-96a7-133c8491186f admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:26.574404 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863db4f-0680-46cd-96a7-133c8491186f admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:26.579481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce5a7c-14d9-48fa-ba31-a69b3481a9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:26.580096 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce5a7c-14d9-48fa-ba31-a69b3481a9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:26.580379 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce5a7c-14d9-48fa-ba31-a69b3481a9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:26.580672 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce5a7c-14d9-48fa-ba31-a69b3481a9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:26.581849 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce5a7c-14d9-48fa-ba31-a69b3481a9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:26.582907 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce5a7c-14d9-48fa-ba31-a69b3481a9c0 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:26.597180 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1194/2370] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:37:26.598509 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4bc14-04b3-4c1e-a0fc-d7df5442ab90 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:26.609613 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4bc14-04b3-4c1e-a0fc-d7df5442ab90 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:26.615594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb0560-c79f-4de2-87e4-8208803923f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:26.616216 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb0560-c79f-4de2-87e4-8208803923f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:26.616495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb0560-c79f-4de2-87e4-8208803923f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:26.616761 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb0560-c79f-4de2-87e4-8208803923f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:26.617403 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb0560-c79f-4de2-87e4-8208803923f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:26.619025 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb0560-c79f-4de2-87e4-8208803923f6 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:26.633727 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1177/2371] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:37:26.634997 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce5a7c-14d9-48fa-ba31-a69b3481a9c0 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:26.646191 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce5a7c-14d9-48fa-ba31-a69b3481a9c0 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:26.652097 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b1c53-8d63-428a-883f-466efb5f2dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:26.652867 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b1c53-8d63-428a-883f-466efb5f2dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:26.653042 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b1c53-8d63-428a-883f-466efb5f2dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:26.653308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b1c53-8d63-428a-883f-466efb5f2dc2 admin admin] PATH_INFO: `/v3/projects/5df4777ead6544f4a227667c58235926/users/772ba628eb214723ac91fa804729f849/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:26.672289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b1c53-8d63-428a-883f-466efb5f2dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5df4777ead6544f4a227667c58235926, user_id=772ba628eb214723ac91fa804729f849, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:26.675601 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b1c53-8d63-428a-883f-466efb5f2dc2 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:26.690393 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1195/2372] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:37:26 2022] PUT /identity/v3/projects/5df4777ead6544f4a227667c58235926/users/772ba628eb214723ac91fa804729f849/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:37:26.701299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e28741-7440-4396-96fe-c70c435ffd12 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:26.701626 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e28741-7440-4396-96fe-c70c435ffd12 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:26.701884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e28741-7440-4396-96fe-c70c435ffd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:26.730550 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-93e28741-7440-4396-96fe-c70c435ffd12 None None] MFA Rules not processed for user `772ba628eb214723ac91fa804729f849`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:26.731490 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-93e28741-7440-4396-96fe-c70c435ffd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:26.781954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:26.814654 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1178/2373] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:26.825845 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b1c53-8d63-428a-883f-466efb5f2dc2 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:26.827776 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8f2b1c53-8d63-428a-883f-466efb5f2dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:26.887779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b1c53-8d63-428a-883f-466efb5f2dc2 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:26.894291 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18654297-8623-46c3-acb3-a769708bea80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:26.895376 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18654297-8623-46c3-acb3-a769708bea80 service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:26.895376 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18654297-8623-46c3-acb3-a769708bea80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:26.895734 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18654297-8623-46c3-acb3-a769708bea80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:26.906588 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18654297-8623-46c3-acb3-a769708bea80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:26.908189 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18654297-8623-46c3-acb3-a769708bea80 service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:26.918341 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1196/2374] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:37:28.578793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e28741-7440-4396-96fe-c70c435ffd12 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:28.578793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-93e28741-7440-4396-96fe-c70c435ffd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:28.640906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e28741-7440-4396-96fe-c70c435ffd12 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:28.644753 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727ed59-dde0-4528-8443-13b60e0bbf57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:28.645453 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727ed59-dde0-4528-8443-13b60e0bbf57 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:28.645723 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727ed59-dde0-4528-8443-13b60e0bbf57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:28.645989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727ed59-dde0-4528-8443-13b60e0bbf57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:28.648911 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-5727ed59-dde0-4528-8443-13b60e0bbf57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:28.658576 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727ed59-dde0-4528-8443-13b60e0bbf57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:28.660108 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727ed59-dde0-4528-8443-13b60e0bbf57 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:28.669161 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1179/2375] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:37:28.774186 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18654297-8623-46c3-acb3-a769708bea80 service cinder] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:28.775727 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-18654297-8623-46c3-acb3-a769708bea80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:28.889074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18654297-8623-46c3-acb3-a769708bea80 service cinder] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:28.900740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b45fbe-bff4-4611-87ae-429f31c031d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:28.901454 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b45fbe-bff4-4611-87ae-429f31c031d1 service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:28.901896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b45fbe-bff4-4611-87ae-429f31c031d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:28.902139 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b45fbe-bff4-4611-87ae-429f31c031d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:28.904028 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-98b45fbe-bff4-4611-87ae-429f31c031d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:28.944871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:29.011774 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b45fbe-bff4-4611-87ae-429f31c031d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:29.013740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b45fbe-bff4-4611-87ae-429f31c031d1 service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:29.025498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1197/2376] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:37:31.476757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727ed59-dde0-4528-8443-13b60e0bbf57 service neutron] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:31.478382 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-5727ed59-dde0-4528-8443-13b60e0bbf57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:31.565997 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727ed59-dde0-4528-8443-13b60e0bbf57 service neutron] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:31.571623 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670aa76-f4f2-416d-9343-6da50782ab7f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd59eac06e347ee9432185b24fdf773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:31.572255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670aa76-f4f2-416d-9343-6da50782ab7f service placement] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:31.573218 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670aa76-f4f2-416d-9343-6da50782ab7f service placement] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:31.578893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670aa76-f4f2-416d-9343-6da50782ab7f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:31.582240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-5670aa76-f4f2-416d-9343-6da50782ab7f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:31.596181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670aa76-f4f2-416d-9343-6da50782ab7f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:31.597986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670aa76-f4f2-416d-9343-6da50782ab7f service placement] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:31.610682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1180/2377] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:37:32.701532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b45fbe-bff4-4611-87ae-429f31c031d1 service nova] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:32.770675 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b45fbe-bff4-4611-87ae-429f31c031d1 service nova] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:32.775363 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287a3a6-9f36-4c95-b79e-fad7f84b44bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:32.776003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287a3a6-9f36-4c95-b79e-fad7f84b44bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:32.776281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287a3a6-9f36-4c95-b79e-fad7f84b44bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:32.776614 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287a3a6-9f36-4c95-b79e-fad7f84b44bf admin admin] PATH_INFO: `/v3/users/772ba628eb214723ac91fa804729f849` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:32.777763 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287a3a6-9f36-4c95-b79e-fad7f84b44bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=772ba628eb214723ac91fa804729f849)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:32.779817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287a3a6-9f36-4c95-b79e-fad7f84b44bf admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:32.845715 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c287a3a6-9f36-4c95-b79e-fad7f84b44bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '772ba628eb214723ac91fa804729f849'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:32.846368 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c287a3a6-9f36-4c95-b79e-fad7f84b44bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '772ba628eb214723ac91fa804729f849'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:32.854100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c287a3a6-9f36-4c95-b79e-fad7f84b44bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '772ba628eb214723ac91fa804729f849'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:32.863071 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c287a3a6-9f36-4c95-b79e-fad7f84b44bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '772ba628eb214723ac91fa804729f849'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:32.863783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c287a3a6-9f36-4c95-b79e-fad7f84b44bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '772ba628eb214723ac91fa804729f849'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:32.883074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1198/2378] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:37:32 2022] DELETE /identity/v3/users/772ba628eb214723ac91fa804729f849 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:32.887718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ba00d-d394-4384-bee4-0bbe290c4ddd None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:32.888550 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ba00d-d394-4384-bee4-0bbe290c4ddd None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:32.888750 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ba00d-d394-4384-bee4-0bbe290c4ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:32.907662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-b52ba00d-d394-4384-bee4-0bbe290c4ddd None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:32.908868 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-b52ba00d-d394-4384-bee4-0bbe290c4ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:32.969866 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1181/2379] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:32.983660 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287a3a6-9f36-4c95-b79e-fad7f84b44bf admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:32.985177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-c287a3a6-9f36-4c95-b79e-fad7f84b44bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:33.023185 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:33.047450 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287a3a6-9f36-4c95-b79e-fad7f84b44bf admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:33.051224 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36c2a0-21fb-4774-b033-77a9a9368f85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:33.051833 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36c2a0-21fb-4774-b033-77a9a9368f85 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:33.052107 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36c2a0-21fb-4774-b033-77a9a9368f85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:33.052370 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36c2a0-21fb-4774-b033-77a9a9368f85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:33.061314 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36c2a0-21fb-4774-b033-77a9a9368f85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:33.062733 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36c2a0-21fb-4774-b033-77a9a9368f85 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:33.072113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1199/2380] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:37:33.343193 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ba00d-d394-4384-bee4-0bbe290c4ddd None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:33.345006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-b52ba00d-d394-4384-bee4-0bbe290c4ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:33.358181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ba00d-d394-4384-bee4-0bbe290c4ddd None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:33.363316 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8e5f5-36ef-4a56-aea6-311b33b53e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:33.364001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8e5f5-36ef-4a56-aea6-311b33b53e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:33.364284 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8e5f5-36ef-4a56-aea6-311b33b53e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:33.364550 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8e5f5-36ef-4a56-aea6-311b33b53e4d admin admin] PATH_INFO: `/v3/projects/5df4777ead6544f4a227667c58235926` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:33.365701 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8e5f5-36ef-4a56-aea6-311b33b53e4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5df4777ead6544f4a227667c58235926)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:33.367637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8e5f5-36ef-4a56-aea6-311b33b53e4d admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:33.377813 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:33.427578 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-0ea8e5f5-36ef-4a56-aea6-311b33b53e4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5df4777ead6544f4a227667c58235926', 'request_id': 'req-0ea8e5f5-36ef-4a56-aea6-311b33b53e4d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:33.435518 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-0ea8e5f5-36ef-4a56-aea6-311b33b53e4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5df4777ead6544f4a227667c58235926', 'request_id': 'req-0ea8e5f5-36ef-4a56-aea6-311b33b53e4d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:33.442729 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-0ea8e5f5-36ef-4a56-aea6-311b33b53e4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5df4777ead6544f4a227667c58235926', 'request_id': 'req-0ea8e5f5-36ef-4a56-aea6-311b33b53e4d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:33.454767 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-0ea8e5f5-36ef-4a56-aea6-311b33b53e4d admin admin] The token cache is being invalidate because project 5df4777ead6544f4a227667c58235926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:37:33.455094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-0ea8e5f5-36ef-4a56-aea6-311b33b53e4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:33.455757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-0ea8e5f5-36ef-4a56-aea6-311b33b53e4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:33.457262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1182/2381] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:37:33 2022] DELETE /identity/v3/projects/5df4777ead6544f4a227667c58235926 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:33.462540 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b81542-a288-4d68-9e37-ef8d548e3ab8 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:33.462967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b81542-a288-4d68-9e37-ef8d548e3ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:33.463268 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b81542-a288-4d68-9e37-ef8d548e3ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:33.484579 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-d5b81542-a288-4d68-9e37-ef8d548e3ab8 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:33.485894 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-d5b81542-a288-4d68-9e37-ef8d548e3ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:33.549559 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1200/2382] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:33.557452 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648c06a-c61c-4752-bddd-85e8b586394d None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:33.557755 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648c06a-c61c-4752-bddd-85e8b586394d None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:33.558137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648c06a-c61c-4752-bddd-85e8b586394d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:33.581933 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-5648c06a-c61c-4752-bddd-85e8b586394d None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:33.583276 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-5648c06a-c61c-4752-bddd-85e8b586394d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:33.592117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1183/2383] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:33.597244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b81542-a288-4d68-9e37-ef8d548e3ab8 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:33.607248 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b81542-a288-4d68-9e37-ef8d548e3ab8 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:33.611932 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2e0a4-43ad-4cb9-85cb-52b2b662f3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:33.612537 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2e0a4-43ad-4cb9-85cb-52b2b662f3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:33.612813 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2e0a4-43ad-4cb9-85cb-52b2b662f3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:33.613087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2e0a4-43ad-4cb9-85cb-52b2b662f3b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:33.613736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2e0a4-43ad-4cb9-85cb-52b2b662f3b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:37:33.614036 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2e0a4-43ad-4cb9-85cb-52b2b662f3b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:33.615677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2e0a4-43ad-4cb9-85cb-52b2b662f3b7 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:33.631395 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1201/2384] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:37:33.632790 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648c06a-c61c-4752-bddd-85e8b586394d None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:33.642703 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648c06a-c61c-4752-bddd-85e8b586394d None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:33.647394 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f393e-1151-4240-8500-749e147734ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:33.648000 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f393e-1151-4240-8500-749e147734ae admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:33.648277 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f393e-1151-4240-8500-749e147734ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:33.648545 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f393e-1151-4240-8500-749e147734ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:33.649215 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f393e-1151-4240-8500-749e147734ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:33.651183 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f393e-1151-4240-8500-749e147734ae admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:33.682359 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1184/2385] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:37:33 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:37:33.689492 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2e0a4-43ad-4cb9-85cb-52b2b662f3b7 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:33.706972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2e0a4-43ad-4cb9-85cb-52b2b662f3b7 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:33.815343 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac1ccf-c373-438a-9f51-48c2c48844cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:33.816196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac1ccf-c373-438a-9f51-48c2c48844cf admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:33.816595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac1ccf-c373-438a-9f51-48c2c48844cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:33.816918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac1ccf-c373-438a-9f51-48c2c48844cf admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:33.817618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac1ccf-c373-438a-9f51-48c2c48844cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:33.819611 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac1ccf-c373-438a-9f51-48c2c48844cf admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:33.854268 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1202/2386] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:37:33 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:37:33.858524 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f393e-1151-4240-8500-749e147734ae admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:33.871475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f393e-1151-4240-8500-749e147734ae admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:33.877706 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abd5aa-4fc0-416d-a65b-33969605cdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:33.878377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abd5aa-4fc0-416d-a65b-33969605cdb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:33.878657 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abd5aa-4fc0-416d-a65b-33969605cdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:33.878924 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abd5aa-4fc0-416d-a65b-33969605cdb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:33.879807 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abd5aa-4fc0-416d-a65b-33969605cdb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:33.881417 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abd5aa-4fc0-416d-a65b-33969605cdb6 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:33.892504 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1185/2387] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:37:33.897664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac1ccf-c373-438a-9f51-48c2c48844cf admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:33.907816 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac1ccf-c373-438a-9f51-48c2c48844cf admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:33.912709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a852e3-c58f-4b22-8b42-40dd1db40485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:33.913317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a852e3-c58f-4b22-8b42-40dd1db40485 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:33.913596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a852e3-c58f-4b22-8b42-40dd1db40485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:33.913865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a852e3-c58f-4b22-8b42-40dd1db40485 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:33.914537 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a852e3-c58f-4b22-8b42-40dd1db40485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:33.916207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a852e3-c58f-4b22-8b42-40dd1db40485 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:33.927005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1203/2388] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:37:33.931797 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abd5aa-4fc0-416d-a65b-33969605cdb6 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:33.942113 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abd5aa-4fc0-416d-a65b-33969605cdb6 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:33.946679 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bf3df-d7d3-45b3-8c92-f930910a7fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:33.947373 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bf3df-d7d3-45b3-8c92-f930910a7fed admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:33.947655 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bf3df-d7d3-45b3-8c92-f930910a7fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:33.947928 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bf3df-d7d3-45b3-8c92-f930910a7fed admin admin] PATH_INFO: `/v3/projects/a99e485364b14724a1b90c3824ac4741/users/7b0a986fe051460ea4268534c6e59894/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:33.962205 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426bf3df-d7d3-45b3-8c92-f930910a7fed admin admin] RBAC: Authorizing `identity:create_grant(project_id=a99e485364b14724a1b90c3824ac4741, user_id=7b0a986fe051460ea4268534c6e59894, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:33.965009 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426bf3df-d7d3-45b3-8c92-f930910a7fed admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:33.980802 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1186/2389] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:37:33 2022] PUT /identity/v3/projects/a99e485364b14724a1b90c3824ac4741/users/7b0a986fe051460ea4268534c6e59894/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:34.055790 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d11f1d-661c-48b8-9b36-eb0f5c0f9858 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:34.056078 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d11f1d-661c-48b8-9b36-eb0f5c0f9858 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:34.056348 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d11f1d-661c-48b8-9b36-eb0f5c0f9858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:34.085176 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-83d11f1d-661c-48b8-9b36-eb0f5c0f9858 None None] MFA Rules not processed for user `7b0a986fe051460ea4268534c6e59894`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:34.086416 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-83d11f1d-661c-48b8-9b36-eb0f5c0f9858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:34.118862 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:34.159406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1204/2390] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:34.166960 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bf3df-d7d3-45b3-8c92-f930910a7fed admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:34.229704 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bf3df-d7d3-45b3-8c92-f930910a7fed admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:34.234905 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a83e0b-a2a5-461c-9a64-c6c644a5470d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:34.235536 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a83e0b-a2a5-461c-9a64-c6c644a5470d admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:34.235808 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a83e0b-a2a5-461c-9a64-c6c644a5470d admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:34.236058 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a83e0b-a2a5-461c-9a64-c6c644a5470d admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:34.236689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a83e0b-a2a5-461c-9a64-c6c644a5470d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:34.238587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a83e0b-a2a5-461c-9a64-c6c644a5470d admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:34.270129 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1187/2391] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:37:34 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:37:34.275595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d11f1d-661c-48b8-9b36-eb0f5c0f9858 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:34.287800 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d11f1d-661c-48b8-9b36-eb0f5c0f9858 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:34.346836 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7db870-bce8-4ea5-a46c-b2d97a1aabf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:34.347449 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7db870-bce8-4ea5-a46c-b2d97a1aabf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:34.347804 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7db870-bce8-4ea5-a46c-b2d97a1aabf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:34.348270 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7db870-bce8-4ea5-a46c-b2d97a1aabf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:34.349029 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7db870-bce8-4ea5-a46c-b2d97a1aabf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:34.351311 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7db870-bce8-4ea5-a46c-b2d97a1aabf8 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:34.372978 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1205/2392] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:37:34 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:37:34.377242 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a83e0b-a2a5-461c-9a64-c6c644a5470d admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:34.387729 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a83e0b-a2a5-461c-9a64-c6c644a5470d admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:34.393176 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6ab56-159b-4967-ace7-e7968ea03754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:34.393771 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6ab56-159b-4967-ace7-e7968ea03754 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:34.394084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6ab56-159b-4967-ace7-e7968ea03754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:34.394355 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6ab56-159b-4967-ace7-e7968ea03754 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:34.395013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6ab56-159b-4967-ace7-e7968ea03754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:34.396613 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6ab56-159b-4967-ace7-e7968ea03754 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:34.407369 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1188/2393] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:37:34.411347 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7db870-bce8-4ea5-a46c-b2d97a1aabf8 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:34.421743 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7db870-bce8-4ea5-a46c-b2d97a1aabf8 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:34.426627 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfca92d-6ae0-4e48-bcad-2a614049f007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:34.427225 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfca92d-6ae0-4e48-bcad-2a614049f007 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:34.427529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfca92d-6ae0-4e48-bcad-2a614049f007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:34.427804 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfca92d-6ae0-4e48-bcad-2a614049f007 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:34.428443 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfca92d-6ae0-4e48-bcad-2a614049f007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:34.430035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfca92d-6ae0-4e48-bcad-2a614049f007 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:34.440447 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1206/2394] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:37:34.444563 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6ab56-159b-4967-ace7-e7968ea03754 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:34.454787 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6ab56-159b-4967-ace7-e7968ea03754 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:34.459738 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a175bf6-60dc-4c90-a6e3-0b697231e184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:34.460386 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a175bf6-60dc-4c90-a6e3-0b697231e184 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:34.460666 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a175bf6-60dc-4c90-a6e3-0b697231e184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:34.460947 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a175bf6-60dc-4c90-a6e3-0b697231e184 admin admin] PATH_INFO: `/v3/projects/6dc61779cf724a73b70a56f8ec4a0ba2/users/f267d895a2dd497ca2809c87d8e7aeb5/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:34.463203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:34.478826 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a175bf6-60dc-4c90-a6e3-0b697231e184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc61779cf724a73b70a56f8ec4a0ba2, user_id=f267d895a2dd497ca2809c87d8e7aeb5, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:34.481651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a175bf6-60dc-4c90-a6e3-0b697231e184 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:34.495490 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1189/2395] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:37:34 2022] PUT /identity/v3/projects/6dc61779cf724a73b70a56f8ec4a0ba2/users/f267d895a2dd497ca2809c87d8e7aeb5/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:34.506009 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd0e90-3a33-48f2-866e-7477777c8562 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:34.506301 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd0e90-3a33-48f2-866e-7477777c8562 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:34.506571 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd0e90-3a33-48f2-866e-7477777c8562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:34.536429 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-03fd0e90-3a33-48f2-866e-7477777c8562 None None] MFA Rules not processed for user `f267d895a2dd497ca2809c87d8e7aeb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:34.537652 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-03fd0e90-3a33-48f2-866e-7477777c8562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:34.604940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1207/2396] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:34.609633 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a175bf6-60dc-4c90-a6e3-0b697231e184 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:34.674396 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a175bf6-60dc-4c90-a6e3-0b697231e184 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:34.679930 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f81aa-4732-44de-9419-d0a8ee7b3f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:34.680227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f81aa-4732-44de-9419-d0a8ee7b3f23 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:34.680423 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f81aa-4732-44de-9419-d0a8ee7b3f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:34.680712 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f81aa-4732-44de-9419-d0a8ee7b3f23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:34.681334 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f81aa-4732-44de-9419-d0a8ee7b3f23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:34.683280 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f81aa-4732-44de-9419-d0a8ee7b3f23 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:34.712313 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1190/2397] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:37:34 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:37:34.717043 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd0e90-3a33-48f2-866e-7477777c8562 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:34.728361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd0e90-3a33-48f2-866e-7477777c8562 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:34.767473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:34.792673 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3ddee-d958-43a6-8faf-5c7a7f66f525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:34.793308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3ddee-d958-43a6-8faf-5c7a7f66f525 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:34.793580 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3ddee-d958-43a6-8faf-5c7a7f66f525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:34.793845 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3ddee-d958-43a6-8faf-5c7a7f66f525 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:34.794515 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3ddee-d958-43a6-8faf-5c7a7f66f525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:34.796490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3ddee-d958-43a6-8faf-5c7a7f66f525 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:34.819815 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1208/2398] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:37:34 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:37:34.823999 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f81aa-4732-44de-9419-d0a8ee7b3f23 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:34.834514 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f81aa-4732-44de-9419-d0a8ee7b3f23 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:34.840236 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee972c4b-1222-4cdb-aba0-304583347825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:34.840838 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee972c4b-1222-4cdb-aba0-304583347825 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:34.841125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee972c4b-1222-4cdb-aba0-304583347825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:34.841389 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee972c4b-1222-4cdb-aba0-304583347825 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:34.842038 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee972c4b-1222-4cdb-aba0-304583347825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:34.843771 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee972c4b-1222-4cdb-aba0-304583347825 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:34.856224 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1191/2399] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:37:34.861495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3ddee-d958-43a6-8faf-5c7a7f66f525 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:34.872207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3ddee-d958-43a6-8faf-5c7a7f66f525 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:34.876929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199938fa-c38c-4faf-a6d1-8c311dff8a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:34.877578 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199938fa-c38c-4faf-a6d1-8c311dff8a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:34.877853 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199938fa-c38c-4faf-a6d1-8c311dff8a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:34.878128 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199938fa-c38c-4faf-a6d1-8c311dff8a03 admin admin] PATH_INFO: `/v3/projects/d305c558ed2b42c28ede3fb803d7dbaf/users/ba20eb0c1f2e4097ace32594cbfbb6e8/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:34.894205 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199938fa-c38c-4faf-a6d1-8c311dff8a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d305c558ed2b42c28ede3fb803d7dbaf, user_id=ba20eb0c1f2e4097ace32594cbfbb6e8, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:34.896931 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199938fa-c38c-4faf-a6d1-8c311dff8a03 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:34.910642 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1209/2400] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:37:34 2022] PUT /identity/v3/projects/d305c558ed2b42c28ede3fb803d7dbaf/users/ba20eb0c1f2e4097ace32594cbfbb6e8/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:37:34.914654 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee972c4b-1222-4cdb-aba0-304583347825 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:34.929800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee972c4b-1222-4cdb-aba0-304583347825 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:34.994567 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6a33c-f29a-49c3-be00-88009871b34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:34.994930 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6a33c-f29a-49c3-be00-88009871b34b admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:34.995310 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6a33c-f29a-49c3-be00-88009871b34b admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:34.995587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6a33c-f29a-49c3-be00-88009871b34b admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:34.996235 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6a33c-f29a-49c3-be00-88009871b34b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:34.997843 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6a33c-f29a-49c3-be00-88009871b34b admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:35.009268 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1192/2401] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:37:35.014192 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199938fa-c38c-4faf-a6d1-8c311dff8a03 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:35.026397 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199938fa-c38c-4faf-a6d1-8c311dff8a03 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:35.031124 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cbe58-5aaf-425e-a9e2-d8c67d1551c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:35.031793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cbe58-5aaf-425e-a9e2-d8c67d1551c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:35.032071 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cbe58-5aaf-425e-a9e2-d8c67d1551c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:35.032341 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cbe58-5aaf-425e-a9e2-d8c67d1551c5 admin admin] PATH_INFO: `/v3/projects/d305c558ed2b42c28ede3fb803d7dbaf/users/ba20eb0c1f2e4097ace32594cbfbb6e8/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:35.034277 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5cbe58-5aaf-425e-a9e2-d8c67d1551c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d305c558ed2b42c28ede3fb803d7dbaf, user_id=ba20eb0c1f2e4097ace32594cbfbb6e8, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:35.036971 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5cbe58-5aaf-425e-a9e2-d8c67d1551c5 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:35.058021 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1210/2402] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:37:35 2022] PUT /identity/v3/projects/d305c558ed2b42c28ede3fb803d7dbaf/users/ba20eb0c1f2e4097ace32594cbfbb6e8/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:35.068978 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc4fc8-fe15-4ebb-afba-da39130364bf None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:35.069268 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc4fc8-fe15-4ebb-afba-da39130364bf None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:35.069546 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc4fc8-fe15-4ebb-afba-da39130364bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:35.097540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-77dc4fc8-fe15-4ebb-afba-da39130364bf None None] MFA Rules not processed for user `ba20eb0c1f2e4097ace32594cbfbb6e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:35.098760 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-77dc4fc8-fe15-4ebb-afba-da39130364bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:35.140652 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:35.175946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1193/2403] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:35.188140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cbe58-5aaf-425e-a9e2-d8c67d1551c5 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:35.190321 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-6b5cbe58-5aaf-425e-a9e2-d8c67d1551c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:35.258260 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cbe58-5aaf-425e-a9e2-d8c67d1551c5 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:35.262912 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef859ff-5ab3-4440-89a1-f637f9c1a717 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:35.264004 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef859ff-5ab3-4440-89a1-f637f9c1a717 service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:35.264352 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef859ff-5ab3-4440-89a1-f637f9c1a717 service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:35.264687 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef859ff-5ab3-4440-89a1-f637f9c1a717 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:35.327481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef859ff-5ab3-4440-89a1-f637f9c1a717 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:35.328926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef859ff-5ab3-4440-89a1-f637f9c1a717 service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:35.338193 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1211/2404] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:37:37.166190 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc4fc8-fe15-4ebb-afba-da39130364bf None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:37.176429 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc4fc8-fe15-4ebb-afba-da39130364bf None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:37.180274 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783fabe-7099-4fcb-814a-5a6ad57e6440 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:37.180882 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783fabe-7099-4fcb-814a-5a6ad57e6440 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:37.181157 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783fabe-7099-4fcb-814a-5a6ad57e6440 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:37.181436 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783fabe-7099-4fcb-814a-5a6ad57e6440 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:37.239496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783fabe-7099-4fcb-814a-5a6ad57e6440 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:37.240944 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783fabe-7099-4fcb-814a-5a6ad57e6440 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:37.250368 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1194/2405] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:37:37.914903 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef859ff-5ab3-4440-89a1-f637f9c1a717 service cinder] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:37.923788 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef859ff-5ab3-4440-89a1-f637f9c1a717 service cinder] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:37.927864 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc031b-8e41-46b6-9618-726cc261e2d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:37.928515 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc031b-8e41-46b6-9618-726cc261e2d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:37.928783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc031b-8e41-46b6-9618-726cc261e2d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:37.929207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc031b-8e41-46b6-9618-726cc261e2d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:37.939054 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc031b-8e41-46b6-9618-726cc261e2d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:37.940494 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc031b-8e41-46b6-9618-726cc261e2d9 service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:37.950628 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1212/2406] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:37:41.914315 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783fabe-7099-4fcb-814a-5a6ad57e6440 service cinder] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:41.978860 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783fabe-7099-4fcb-814a-5a6ad57e6440 service cinder] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:41.985636 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd475b-ea2c-4633-b557-f564dceec22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:41.986420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd475b-ea2c-4633-b557-f564dceec22b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:41.986862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd475b-ea2c-4633-b557-f564dceec22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:41.987276 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd475b-ea2c-4633-b557-f564dceec22b admin admin] PATH_INFO: `/v3/users/7b0a986fe051460ea4268534c6e59894` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:41.989141 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd475b-ea2c-4633-b557-f564dceec22b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b0a986fe051460ea4268534c6e59894)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:41.992261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd475b-ea2c-4633-b557-f564dceec22b admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:42.049879 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-4bdd475b-ea2c-4633-b557-f564dceec22b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b0a986fe051460ea4268534c6e59894'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:42.050548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-4bdd475b-ea2c-4633-b557-f564dceec22b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b0a986fe051460ea4268534c6e59894'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:42.057525 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-4bdd475b-ea2c-4633-b557-f564dceec22b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b0a986fe051460ea4268534c6e59894'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:42.058156 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-4bdd475b-ea2c-4633-b557-f564dceec22b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b0a986fe051460ea4268534c6e59894'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:42.065574 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-4bdd475b-ea2c-4633-b557-f564dceec22b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b0a986fe051460ea4268534c6e59894'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:42.076793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:42.084692 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1195/2407] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:37:41 2022] DELETE /identity/v3/users/7b0a986fe051460ea4268534c6e59894 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:42.089250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877ba63-6c1b-497f-b7dc-371f737c98fc None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:42.089738 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877ba63-6c1b-497f-b7dc-371f737c98fc None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:42.089835 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877ba63-6c1b-497f-b7dc-371f737c98fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:42.109122 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-c877ba63-6c1b-497f-b7dc-371f737c98fc None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:42.110302 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-c877ba63-6c1b-497f-b7dc-371f737c98fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:42.141321 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:42.177499 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1213/2408] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:42.187770 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd475b-ea2c-4633-b557-f564dceec22b admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:42.189198 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-4bdd475b-ea2c-4633-b557-f564dceec22b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:42.248351 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd475b-ea2c-4633-b557-f564dceec22b admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:42.252388 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e99840-7c27-4db5-be35-20a29315fa55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:42.252996 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e99840-7c27-4db5-be35-20a29315fa55 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:42.253289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e99840-7c27-4db5-be35-20a29315fa55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:42.253561 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e99840-7c27-4db5-be35-20a29315fa55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:42.264232 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e99840-7c27-4db5-be35-20a29315fa55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:42.265766 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e99840-7c27-4db5-be35-20a29315fa55 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:42.278021 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1196/2409] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:37:42.551702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877ba63-6c1b-497f-b7dc-371f737c98fc None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:42.553270 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-c877ba63-6c1b-497f-b7dc-371f737c98fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:42.593787 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877ba63-6c1b-497f-b7dc-371f737c98fc None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:42.601370 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4ddeb-b11b-4632-819b-91046ccb37df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:42.602108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4ddeb-b11b-4632-819b-91046ccb37df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:42.602452 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4ddeb-b11b-4632-819b-91046ccb37df admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:42.602778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4ddeb-b11b-4632-819b-91046ccb37df admin admin] PATH_INFO: `/v3/projects/a99e485364b14724a1b90c3824ac4741` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:42.604090 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4ddeb-b11b-4632-819b-91046ccb37df admin admin] RBAC: Authorizing `identity:delete_project(project_id=a99e485364b14724a1b90c3824ac4741)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:42.606323 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4ddeb-b11b-4632-819b-91046ccb37df admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:42.659528 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-bec4ddeb-b11b-4632-819b-91046ccb37df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a99e485364b14724a1b90c3824ac4741', 'request_id': 'req-bec4ddeb-b11b-4632-819b-91046ccb37df'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:42.667658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-bec4ddeb-b11b-4632-819b-91046ccb37df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a99e485364b14724a1b90c3824ac4741', 'request_id': 'req-bec4ddeb-b11b-4632-819b-91046ccb37df'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:42.674833 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-bec4ddeb-b11b-4632-819b-91046ccb37df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a99e485364b14724a1b90c3824ac4741', 'request_id': 'req-bec4ddeb-b11b-4632-819b-91046ccb37df'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:42.685502 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-bec4ddeb-b11b-4632-819b-91046ccb37df admin admin] The token cache is being invalidate because project a99e485364b14724a1b90c3824ac4741 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:37:42.685789 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-bec4ddeb-b11b-4632-819b-91046ccb37df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:42.686441 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-bec4ddeb-b11b-4632-819b-91046ccb37df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:42.687991 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1214/2410] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:37:42 2022] DELETE /identity/v3/projects/a99e485364b14724a1b90c3824ac4741 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:42.692026 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e99840-7c27-4db5-be35-20a29315fa55 service neutron] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:42.701628 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e99840-7c27-4db5-be35-20a29315fa55 service neutron] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:42.758377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f315b7-c2b8-49bf-ada6-8561c205d8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:42.759046 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f315b7-c2b8-49bf-ada6-8561c205d8d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:42.759316 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f315b7-c2b8-49bf-ada6-8561c205d8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:42.759586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f315b7-c2b8-49bf-ada6-8561c205d8d4 admin admin] PATH_INFO: `/v3/users/f267d895a2dd497ca2809c87d8e7aeb5` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:42.760694 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f315b7-c2b8-49bf-ada6-8561c205d8d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f267d895a2dd497ca2809c87d8e7aeb5)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:42.762682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f315b7-c2b8-49bf-ada6-8561c205d8d4 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:42.809567 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-56f315b7-c2b8-49bf-ada6-8561c205d8d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f267d895a2dd497ca2809c87d8e7aeb5'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:42.810213 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-56f315b7-c2b8-49bf-ada6-8561c205d8d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f267d895a2dd497ca2809c87d8e7aeb5'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:42.817211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-56f315b7-c2b8-49bf-ada6-8561c205d8d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f267d895a2dd497ca2809c87d8e7aeb5'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:42.817873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-56f315b7-c2b8-49bf-ada6-8561c205d8d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f267d895a2dd497ca2809c87d8e7aeb5'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:42.826520 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-56f315b7-c2b8-49bf-ada6-8561c205d8d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f267d895a2dd497ca2809c87d8e7aeb5'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:42.844613 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1197/2411] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:37:42 2022] DELETE /identity/v3/users/f267d895a2dd497ca2809c87d8e7aeb5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:43.129607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4ddeb-b11b-4632-819b-91046ccb37df admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:43.131212 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-bec4ddeb-b11b-4632-819b-91046ccb37df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:43.147301 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4ddeb-b11b-4632-819b-91046ccb37df admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:43.208755 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80b1a9-dfe8-4ba7-a51d-6461d7fab30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:43.209388 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80b1a9-dfe8-4ba7-a51d-6461d7fab30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:43.209664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80b1a9-dfe8-4ba7-a51d-6461d7fab30e admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:43.209932 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80b1a9-dfe8-4ba7-a51d-6461d7fab30e admin admin] PATH_INFO: `/v3/projects/6dc61779cf724a73b70a56f8ec4a0ba2` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:43.211118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80b1a9-dfe8-4ba7-a51d-6461d7fab30e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dc61779cf724a73b70a56f8ec4a0ba2)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:43.213037 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80b1a9-dfe8-4ba7-a51d-6461d7fab30e admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:43.265143 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-fc80b1a9-dfe8-4ba7-a51d-6461d7fab30e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dc61779cf724a73b70a56f8ec4a0ba2', 'request_id': 'req-fc80b1a9-dfe8-4ba7-a51d-6461d7fab30e'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:43.274241 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-fc80b1a9-dfe8-4ba7-a51d-6461d7fab30e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dc61779cf724a73b70a56f8ec4a0ba2', 'request_id': 'req-fc80b1a9-dfe8-4ba7-a51d-6461d7fab30e'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:43.277558 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:43.283899 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-fc80b1a9-dfe8-4ba7-a51d-6461d7fab30e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dc61779cf724a73b70a56f8ec4a0ba2', 'request_id': 'req-fc80b1a9-dfe8-4ba7-a51d-6461d7fab30e'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:43.298143 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-fc80b1a9-dfe8-4ba7-a51d-6461d7fab30e admin admin] The token cache is being invalidate because project 6dc61779cf724a73b70a56f8ec4a0ba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:37:43.298430 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-fc80b1a9-dfe8-4ba7-a51d-6461d7fab30e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:43.299161 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-fc80b1a9-dfe8-4ba7-a51d-6461d7fab30e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:43.300716 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1215/2412] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:37:43 2022] DELETE /identity/v3/projects/6dc61779cf724a73b70a56f8ec4a0ba2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:43.304916 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f315b7-c2b8-49bf-ada6-8561c205d8d4 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:43.306388 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-56f315b7-c2b8-49bf-ada6-8561c205d8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:43.319616 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f315b7-c2b8-49bf-ada6-8561c205d8d4 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:43.332368 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:43.381888 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0b6dc-e0d9-4661-a6f6-a5d572fb4239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:43.382512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0b6dc-e0d9-4661-a6f6-a5d572fb4239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:43.382784 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0b6dc-e0d9-4661-a6f6-a5d572fb4239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:43.383095 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0b6dc-e0d9-4661-a6f6-a5d572fb4239 admin admin] PATH_INFO: `/v3/users/ba20eb0c1f2e4097ace32594cbfbb6e8` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:43.384211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0b6dc-e0d9-4661-a6f6-a5d572fb4239 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba20eb0c1f2e4097ace32594cbfbb6e8)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:43.386149 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0b6dc-e0d9-4661-a6f6-a5d572fb4239 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:43.434142 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-9bc0b6dc-e0d9-4661-a6f6-a5d572fb4239 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba20eb0c1f2e4097ace32594cbfbb6e8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:43.434786 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-9bc0b6dc-e0d9-4661-a6f6-a5d572fb4239 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba20eb0c1f2e4097ace32594cbfbb6e8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:43.441517 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-9bc0b6dc-e0d9-4661-a6f6-a5d572fb4239 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba20eb0c1f2e4097ace32594cbfbb6e8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:43.442136 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-9bc0b6dc-e0d9-4661-a6f6-a5d572fb4239 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba20eb0c1f2e4097ace32594cbfbb6e8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:43.451020 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-9bc0b6dc-e0d9-4661-a6f6-a5d572fb4239 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba20eb0c1f2e4097ace32594cbfbb6e8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:43.468562 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1198/2413] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:37:43 2022] DELETE /identity/v3/users/ba20eb0c1f2e4097ace32594cbfbb6e8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:44.205293 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80b1a9-dfe8-4ba7-a51d-6461d7fab30e admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:44.207652 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-fc80b1a9-dfe8-4ba7-a51d-6461d7fab30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:44.230301 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80b1a9-dfe8-4ba7-a51d-6461d7fab30e admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:44.311172 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851fa7f-1fdd-4bf3-8099-2831ba3dd955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:44.311820 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851fa7f-1fdd-4bf3-8099-2831ba3dd955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:44.312223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851fa7f-1fdd-4bf3-8099-2831ba3dd955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:44.312602 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851fa7f-1fdd-4bf3-8099-2831ba3dd955 admin admin] PATH_INFO: `/v3/projects/d305c558ed2b42c28ede3fb803d7dbaf` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:44.314356 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851fa7f-1fdd-4bf3-8099-2831ba3dd955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d305c558ed2b42c28ede3fb803d7dbaf)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:44.316307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851fa7f-1fdd-4bf3-8099-2831ba3dd955 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:44.364454 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-0851fa7f-1fdd-4bf3-8099-2831ba3dd955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd305c558ed2b42c28ede3fb803d7dbaf', 'request_id': 'req-0851fa7f-1fdd-4bf3-8099-2831ba3dd955'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:44.373448 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-0851fa7f-1fdd-4bf3-8099-2831ba3dd955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd305c558ed2b42c28ede3fb803d7dbaf', 'request_id': 'req-0851fa7f-1fdd-4bf3-8099-2831ba3dd955'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:44.380562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-0851fa7f-1fdd-4bf3-8099-2831ba3dd955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd305c558ed2b42c28ede3fb803d7dbaf', 'request_id': 'req-0851fa7f-1fdd-4bf3-8099-2831ba3dd955'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:44.392780 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-0851fa7f-1fdd-4bf3-8099-2831ba3dd955 admin admin] The token cache is being invalidate because project d305c558ed2b42c28ede3fb803d7dbaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:37:44.393075 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-0851fa7f-1fdd-4bf3-8099-2831ba3dd955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:44.393746 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-0851fa7f-1fdd-4bf3-8099-2831ba3dd955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:44.395284 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1216/2414] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:37:44 2022] DELETE /identity/v3/projects/d305c558ed2b42c28ede3fb803d7dbaf => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:44.400308 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26300c-a691-4771-b1a7-48b309220124 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:44.400836 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26300c-a691-4771-b1a7-48b309220124 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:44.400836 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26300c-a691-4771-b1a7-48b309220124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:44.420996 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-8a26300c-a691-4771-b1a7-48b309220124 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:44.422284 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-8a26300c-a691-4771-b1a7-48b309220124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:44.486127 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1199/2415] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:44.494244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b5a3f-01e8-41e2-961e-d019aab526ff None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:44.494619 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b5a3f-01e8-41e2-961e-d019aab526ff None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:44.494964 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b5a3f-01e8-41e2-961e-d019aab526ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:44.518608 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-709b5a3f-01e8-41e2-961e-d019aab526ff None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:44.520221 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-709b5a3f-01e8-41e2-961e-d019aab526ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:44.528225 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1217/2416] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:44.532371 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26300c-a691-4771-b1a7-48b309220124 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:44.532793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b5a3f-01e8-41e2-961e-d019aab526ff None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:44.534231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-709b5a3f-01e8-41e2-961e-d019aab526ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:44.542026 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26300c-a691-4771-b1a7-48b309220124 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:44.546739 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf2b60-22b9-41c7-815a-6cb0550bcd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:44.547456 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf2b60-22b9-41c7-815a-6cb0550bcd74 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:44.547727 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf2b60-22b9-41c7-815a-6cb0550bcd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:44.547988 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf2b60-22b9-41c7-815a-6cb0550bcd74 admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:44.548634 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf2b60-22b9-41c7-815a-6cb0550bcd74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:37:44.548929 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf2b60-22b9-41c7-815a-6cb0550bcd74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:44.550537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf2b60-22b9-41c7-815a-6cb0550bcd74 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:44.562605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1200/2417] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:37:44.566786 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf2b60-22b9-41c7-815a-6cb0550bcd74 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:44.576922 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf2b60-22b9-41c7-815a-6cb0550bcd74 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:44.582022 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fdaac-3e7a-4fec-8549-a2bcd2cf899d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:44.582845 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fdaac-3e7a-4fec-8549-a2bcd2cf899d admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:44.582845 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fdaac-3e7a-4fec-8549-a2bcd2cf899d admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:44.583168 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fdaac-3e7a-4fec-8549-a2bcd2cf899d admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:44.583799 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fdaac-3e7a-4fec-8549-a2bcd2cf899d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:44.585725 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fdaac-3e7a-4fec-8549-a2bcd2cf899d admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:44.613830 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b5a3f-01e8-41e2-961e-d019aab526ff None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:44.614422 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1201/2418] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:37:44 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:37:44.618381 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fdaac-3e7a-4fec-8549-a2bcd2cf899d admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:44.621671 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:44.623278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:44.685026 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fdaac-3e7a-4fec-8549-a2bcd2cf899d admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:44.689629 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7b8d0-7443-4ea3-9101-37cbe10d0199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:44.690261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7b8d0-7443-4ea3-9101-37cbe10d0199 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:44.690538 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7b8d0-7443-4ea3-9101-37cbe10d0199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:44.690802 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7b8d0-7443-4ea3-9101-37cbe10d0199 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:44.691459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7b8d0-7443-4ea3-9101-37cbe10d0199 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:44.692993 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fffc9-7c4c-4370-9875-dde5649aee1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:44.693382 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7b8d0-7443-4ea3-9101-37cbe10d0199 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:44.693609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fffc9-7c4c-4370-9875-dde5649aee1e service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:44.693890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fffc9-7c4c-4370-9875-dde5649aee1e service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:44.694159 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fffc9-7c4c-4370-9875-dde5649aee1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:44.695901 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-3b1fffc9-7c4c-4370-9875-dde5649aee1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:44.708245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fffc9-7c4c-4370-9875-dde5649aee1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:44.709901 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fffc9-7c4c-4370-9875-dde5649aee1e service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:44.723139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1202/2419] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:37:44 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:37:44.723305 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1218/2420] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:37:44.724571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7b8d0-7443-4ea3-9101-37cbe10d0199 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:44.735584 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7b8d0-7443-4ea3-9101-37cbe10d0199 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:44.741808 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e49a8-3a73-4ca6-b904-138fda545000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:44.741980 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e49a8-3a73-4ca6-b904-138fda545000 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:44.742219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e49a8-3a73-4ca6-b904-138fda545000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:44.742485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e49a8-3a73-4ca6-b904-138fda545000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:44.743156 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e49a8-3a73-4ca6-b904-138fda545000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:44.744883 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e49a8-3a73-4ca6-b904-138fda545000 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:44.759682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1203/2421] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:37:44.760877 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fffc9-7c4c-4370-9875-dde5649aee1e service nova] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:44.772724 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fffc9-7c4c-4370-9875-dde5649aee1e service nova] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:44.777568 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3bad8-2870-419b-9e38-fad5a324af13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:44.779433 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3bad8-2870-419b-9e38-fad5a324af13 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:44.780325 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3bad8-2870-419b-9e38-fad5a324af13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:44.780325 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3bad8-2870-419b-9e38-fad5a324af13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:44.781283 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3bad8-2870-419b-9e38-fad5a324af13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:44.782882 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3bad8-2870-419b-9e38-fad5a324af13 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:44.795191 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1219/2422] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:37:44.799592 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e49a8-3a73-4ca6-b904-138fda545000 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:44.811585 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e49a8-3a73-4ca6-b904-138fda545000 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:44.818441 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262692f-ae13-49f7-871f-4efcc4085336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:44.819340 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262692f-ae13-49f7-871f-4efcc4085336 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:44.819737 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262692f-ae13-49f7-871f-4efcc4085336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:44.820095 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262692f-ae13-49f7-871f-4efcc4085336 admin admin] PATH_INFO: `/v3/projects/61ee4c2113204a858e17aa559459a6af/users/c4fee990d0e14d6eaaf0e7348ddeb39c/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:44.845112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262692f-ae13-49f7-871f-4efcc4085336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61ee4c2113204a858e17aa559459a6af, user_id=c4fee990d0e14d6eaaf0e7348ddeb39c, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:44.848886 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262692f-ae13-49f7-871f-4efcc4085336 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:44.864998 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1204/2423] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:37:44 2022] PUT /identity/v3/projects/61ee4c2113204a858e17aa559459a6af/users/c4fee990d0e14d6eaaf0e7348ddeb39c/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:37:44.875491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce59033-952b-47b7-ae60-15d59436b385 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:44.875695 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce59033-952b-47b7-ae60-15d59436b385 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:44.875948 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce59033-952b-47b7-ae60-15d59436b385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:44.907786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-dce59033-952b-47b7-ae60-15d59436b385 None None] MFA Rules not processed for user `c4fee990d0e14d6eaaf0e7348ddeb39c`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:44.909068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-dce59033-952b-47b7-ae60-15d59436b385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:44.981790 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1220/2424] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:44.992484 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262692f-ae13-49f7-871f-4efcc4085336 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:44.994228 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f262692f-ae13-49f7-871f-4efcc4085336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:45.068024 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262692f-ae13-49f7-871f-4efcc4085336 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:45.071577 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27062d-3014-4c48-a344-8edd6390b5e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:45.072201 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27062d-3014-4c48-a344-8edd6390b5e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:45.072510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27062d-3014-4c48-a344-8edd6390b5e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:45.072786 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27062d-3014-4c48-a344-8edd6390b5e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:45.091270 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27062d-3014-4c48-a344-8edd6390b5e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:45.092850 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27062d-3014-4c48-a344-8edd6390b5e8 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:45.105706 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1205/2425] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:37:46.496918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6c4a9-b31c-4fc2-b5d3-8ef1d66916b4 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:46.497496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6c4a9-b31c-4fc2-b5d3-8ef1d66916b4 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:46.497496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6c4a9-b31c-4fc2-b5d3-8ef1d66916b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:46.519367 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-fee6c4a9-b31c-4fc2-b5d3-8ef1d66916b4 None None] MFA Rules not processed for user `c4fee990d0e14d6eaaf0e7348ddeb39c`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:46.520845 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-fee6c4a9-b31c-4fc2-b5d3-8ef1d66916b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:46.528553 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1221/2426] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:37:47.588911 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27062d-3014-4c48-a344-8edd6390b5e8 service cinder] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:47.590675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-cc27062d-3014-4c48-a344-8edd6390b5e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:47.649892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27062d-3014-4c48-a344-8edd6390b5e8 service cinder] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:47.653733 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ce9ba-c04c-405f-ab7f-0d37a2c487e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:47.654354 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ce9ba-c04c-405f-ab7f-0d37a2c487e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:47.654630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ce9ba-c04c-405f-ab7f-0d37a2c487e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:47.654899 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ce9ba-c04c-405f-ab7f-0d37a2c487e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:47.660709 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-8b5ce9ba-c04c-405f-ab7f-0d37a2c487e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:47.676795 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:47.749024 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ce9ba-c04c-405f-ab7f-0d37a2c487e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:47.750909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ce9ba-c04c-405f-ab7f-0d37a2c487e2 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:47.762355 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1206/2427] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:37:50.941497 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6c4a9-b31c-4fc2-b5d3-8ef1d66916b4 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:50.943728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-fee6c4a9-b31c-4fc2-b5d3-8ef1d66916b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:51.028834 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ce9ba-c04c-405f-ab7f-0d37a2c487e2 service neutron] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:51.030197 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6c4a9-b31c-4fc2-b5d3-8ef1d66916b4 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:51.031100 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-8b5ce9ba-c04c-405f-ab7f-0d37a2c487e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:51.035607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460c937-0619-45d2-9dab-00b33fc7961d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd59eac06e347ee9432185b24fdf773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:51.036390 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460c937-0619-45d2-9dab-00b33fc7961d service placement] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:51.036680 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460c937-0619-45d2-9dab-00b33fc7961d service placement] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:51.036973 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460c937-0619-45d2-9dab-00b33fc7961d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:51.038973 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-6460c937-0619-45d2-9dab-00b33fc7961d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:51.046561 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ce9ba-c04c-405f-ab7f-0d37a2c487e2 service neutron] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:51.051679 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349ea18-f005-44e0-92d4-fbefd5530492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:51.052656 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:51.053250 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349ea18-f005-44e0-92d4-fbefd5530492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:51.053761 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349ea18-f005-44e0-92d4-fbefd5530492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:51.054254 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349ea18-f005-44e0-92d4-fbefd5530492 admin admin] PATH_INFO: `/v3/users/06aca6bb76ec4290b591d9c7a5a6c5c8` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:51.055539 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349ea18-f005-44e0-92d4-fbefd5530492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06aca6bb76ec4290b591d9c7a5a6c5c8)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:51.056140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6460c937-0619-45d2-9dab-00b33fc7961d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:51.057603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349ea18-f005-44e0-92d4-fbefd5530492 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:51.058557 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6460c937-0619-45d2-9dab-00b33fc7961d service placement] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:51.079107 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1222/2428] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:37:51.113100 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-9349ea18-f005-44e0-92d4-fbefd5530492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06aca6bb76ec4290b591d9c7a5a6c5c8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:51.113751 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-9349ea18-f005-44e0-92d4-fbefd5530492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06aca6bb76ec4290b591d9c7a5a6c5c8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:51.121332 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-9349ea18-f005-44e0-92d4-fbefd5530492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06aca6bb76ec4290b591d9c7a5a6c5c8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:51.121979 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-9349ea18-f005-44e0-92d4-fbefd5530492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06aca6bb76ec4290b591d9c7a5a6c5c8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:51.130241 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-9349ea18-f005-44e0-92d4-fbefd5530492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06aca6bb76ec4290b591d9c7a5a6c5c8'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:51.148853 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1207/2429] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:37:51 2022] DELETE /identity/v3/users/06aca6bb76ec4290b591d9c7a5a6c5c8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:37:51.325150 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460c937-0619-45d2-9dab-00b33fc7961d service placement] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:51.337995 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460c937-0619-45d2-9dab-00b33fc7961d service placement] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:51.412602 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a39b7c-4bae-4e01-9e42-276f3d5c0963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:51.413494 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a39b7c-4bae-4e01-9e42-276f3d5c0963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:51.413722 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a39b7c-4bae-4e01-9e42-276f3d5c0963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:51.414027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a39b7c-4bae-4e01-9e42-276f3d5c0963 admin admin] PATH_INFO: `/v3/projects/781b9a3542c8445c836705198f62594c` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:51.415252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a39b7c-4bae-4e01-9e42-276f3d5c0963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=781b9a3542c8445c836705198f62594c)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:51.417240 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a39b7c-4bae-4e01-9e42-276f3d5c0963 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:51.476808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f5a39b7c-4bae-4e01-9e42-276f3d5c0963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '781b9a3542c8445c836705198f62594c', 'request_id': 'req-f5a39b7c-4bae-4e01-9e42-276f3d5c0963'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:51.486908 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f5a39b7c-4bae-4e01-9e42-276f3d5c0963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '781b9a3542c8445c836705198f62594c', 'request_id': 'req-f5a39b7c-4bae-4e01-9e42-276f3d5c0963'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:51.502522 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f5a39b7c-4bae-4e01-9e42-276f3d5c0963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '781b9a3542c8445c836705198f62594c', 'request_id': 'req-f5a39b7c-4bae-4e01-9e42-276f3d5c0963'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:51.522034 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f5a39b7c-4bae-4e01-9e42-276f3d5c0963 admin admin] The token cache is being invalidate because project 781b9a3542c8445c836705198f62594c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:37:51.522359 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f5a39b7c-4bae-4e01-9e42-276f3d5c0963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:51.523227 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f5a39b7c-4bae-4e01-9e42-276f3d5c0963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:51.532463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1223/2430] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:37:51 2022] DELETE /identity/v3/projects/781b9a3542c8445c836705198f62594c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:51.544516 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8390a4-1e35-4241-b530-4150591147a0 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:51.545078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8390a4-1e35-4241-b530-4150591147a0 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:51.545420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8390a4-1e35-4241-b530-4150591147a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:51.566152 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-4d8390a4-1e35-4241-b530-4150591147a0 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:51.567649 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-4d8390a4-1e35-4241-b530-4150591147a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:51.668382 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1208/2431] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:51.679120 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d093333-3fdb-4931-85e7-51f32e33b4e9 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:51.679518 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d093333-3fdb-4931-85e7-51f32e33b4e9 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:51.679685 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d093333-3fdb-4931-85e7-51f32e33b4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:51.701521 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-1d093333-3fdb-4931-85e7-51f32e33b4e9 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:51.702789 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-1d093333-3fdb-4931-85e7-51f32e33b4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:51.711927 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1224/2432] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:51.716486 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8390a4-1e35-4241-b530-4150591147a0 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:51.726886 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8390a4-1e35-4241-b530-4150591147a0 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:51.732776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932cd66-57f6-433d-a226-5e31f059de11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:51.732917 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932cd66-57f6-433d-a226-5e31f059de11 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:51.733287 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932cd66-57f6-433d-a226-5e31f059de11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:51.733630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932cd66-57f6-433d-a226-5e31f059de11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:51.734366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932cd66-57f6-433d-a226-5e31f059de11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:37:51.734725 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932cd66-57f6-433d-a226-5e31f059de11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:51.736448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932cd66-57f6-433d-a226-5e31f059de11 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:51.749745 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1209/2433] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:37:51.753738 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d093333-3fdb-4931-85e7-51f32e33b4e9 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:51.764703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d093333-3fdb-4931-85e7-51f32e33b4e9 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:51.770162 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e0b00-1eb4-4430-a043-29f000f01ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:51.770806 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e0b00-1eb4-4430-a043-29f000f01ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:51.771509 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e0b00-1eb4-4430-a043-29f000f01ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:51.771865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e0b00-1eb4-4430-a043-29f000f01ae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:51.772677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e0b00-1eb4-4430-a043-29f000f01ae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:51.774958 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e0b00-1eb4-4430-a043-29f000f01ae0 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:51.809537 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1225/2434] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:37:51 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:37:51.813752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932cd66-57f6-433d-a226-5e31f059de11 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:51.823805 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932cd66-57f6-433d-a226-5e31f059de11 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:51.828524 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:51.891847 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134adc3-b08d-4e50-a884-e811bdf307ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:51.892597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134adc3-b08d-4e50-a884-e811bdf307ea admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:51.892990 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134adc3-b08d-4e50-a884-e811bdf307ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:51.893352 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134adc3-b08d-4e50-a884-e811bdf307ea admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:51.894093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134adc3-b08d-4e50-a884-e811bdf307ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:51.896173 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134adc3-b08d-4e50-a884-e811bdf307ea admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:51.920168 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1210/2435] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:37:51 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:37:51.924707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e0b00-1eb4-4430-a043-29f000f01ae0 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:51.936301 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e0b00-1eb4-4430-a043-29f000f01ae0 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:51.941859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bc291-ea6f-4d3c-aa2e-6a3d2a34b834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:51.942476 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bc291-ea6f-4d3c-aa2e-6a3d2a34b834 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:51.942753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bc291-ea6f-4d3c-aa2e-6a3d2a34b834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:51.943051 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bc291-ea6f-4d3c-aa2e-6a3d2a34b834 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:51.943704 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44bc291-ea6f-4d3c-aa2e-6a3d2a34b834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:51.945644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44bc291-ea6f-4d3c-aa2e-6a3d2a34b834 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:51.958322 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1226/2436] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:37:51.962237 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134adc3-b08d-4e50-a884-e811bdf307ea admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:51.974049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134adc3-b08d-4e50-a884-e811bdf307ea admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:51.979524 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb730813-9a66-41c4-92ec-e18f18bd1c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:51.980322 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb730813-9a66-41c4-92ec-e18f18bd1c0c admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:51.980654 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb730813-9a66-41c4-92ec-e18f18bd1c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:51.980929 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb730813-9a66-41c4-92ec-e18f18bd1c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:51.981590 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb730813-9a66-41c4-92ec-e18f18bd1c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:51.983572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb730813-9a66-41c4-92ec-e18f18bd1c0c admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:52.000113 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1211/2437] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:37:52.001127 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bc291-ea6f-4d3c-aa2e-6a3d2a34b834 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:52.030110 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bc291-ea6f-4d3c-aa2e-6a3d2a34b834 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:52.036093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ca92d-0909-46f4-8723-06120be4b1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:52.037264 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ca92d-0909-46f4-8723-06120be4b1b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:52.037711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ca92d-0909-46f4-8723-06120be4b1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:52.038330 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ca92d-0909-46f4-8723-06120be4b1b7 admin admin] PATH_INFO: `/v3/projects/beeb7f8bbe1549b0bf24f29344684991/users/17ef7eac1cdd4b59a55b913605f65899/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:52.058329 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ca92d-0909-46f4-8723-06120be4b1b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beeb7f8bbe1549b0bf24f29344684991, user_id=17ef7eac1cdd4b59a55b913605f65899, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:52.061655 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ca92d-0909-46f4-8723-06120be4b1b7 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:52.083055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1227/2438] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:37:51 2022] PUT /identity/v3/projects/beeb7f8bbe1549b0bf24f29344684991/users/17ef7eac1cdd4b59a55b913605f65899/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:52.096236 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290de42-100b-4448-a13d-3283af021b78 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:52.097542 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290de42-100b-4448-a13d-3283af021b78 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:52.097988 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290de42-100b-4448-a13d-3283af021b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:52.136817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-a290de42-100b-4448-a13d-3283af021b78 None None] MFA Rules not processed for user `17ef7eac1cdd4b59a55b913605f65899`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:52.139659 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a290de42-100b-4448-a13d-3283af021b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:52.291297 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1212/2439] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:52.291685 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ca92d-0909-46f4-8723-06120be4b1b7 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:52.293698 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b36ca92d-0909-46f4-8723-06120be4b1b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:52.339467 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:52.438165 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ca92d-0909-46f4-8723-06120be4b1b7 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:52.449783 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93613f6-b30e-4123-9112-c9879377a799 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:52.451725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93613f6-b30e-4123-9112-c9879377a799 service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:52.452120 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93613f6-b30e-4123-9112-c9879377a799 service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:52.452496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93613f6-b30e-4123-9112-c9879377a799 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:52.463564 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93613f6-b30e-4123-9112-c9879377a799 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:52.465346 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93613f6-b30e-4123-9112-c9879377a799 service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:52.476289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1228/2440] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:37:57.975267 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290de42-100b-4448-a13d-3283af021b78 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:57.988912 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290de42-100b-4448-a13d-3283af021b78 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:57.994525 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4f0d2-121c-4c7a-b1bb-4d05e5a987e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:57.995188 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4f0d2-121c-4c7a-b1bb-4d05e5a987e2 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:57.995468 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4f0d2-121c-4c7a-b1bb-4d05e5a987e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:57.995737 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4f0d2-121c-4c7a-b1bb-4d05e5a987e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:57.997647 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-3ee4f0d2-121c-4c7a-b1bb-4d05e5a987e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:58.010590 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4f0d2-121c-4c7a-b1bb-4d05e5a987e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:58.012436 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4f0d2-121c-4c7a-b1bb-4d05e5a987e2 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:58.024414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1213/2441] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:37:58.502125 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93613f6-b30e-4123-9112-c9879377a799 service nova] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:58.570744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93613f6-b30e-4123-9112-c9879377a799 service nova] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:58.576811 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d14e52-615d-458c-a4ea-ef88942d8f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:58.577465 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d14e52-615d-458c-a4ea-ef88942d8f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:58.577751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d14e52-615d-458c-a4ea-ef88942d8f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:58.578033 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d14e52-615d-458c-a4ea-ef88942d8f5b admin admin] PATH_INFO: `/v3/users/17ef7eac1cdd4b59a55b913605f65899` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:58.579201 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d14e52-615d-458c-a4ea-ef88942d8f5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=17ef7eac1cdd4b59a55b913605f65899)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:58.581164 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d14e52-615d-458c-a4ea-ef88942d8f5b admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:58.634658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4f0d2-121c-4c7a-b1bb-4d05e5a987e2 service nova] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:58.636152 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-3ee4f0d2-121c-4c7a-b1bb-4d05e5a987e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:58.638113 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-a4d14e52-615d-458c-a4ea-ef88942d8f5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17ef7eac1cdd4b59a55b913605f65899'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:58.638883 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-a4d14e52-615d-458c-a4ea-ef88942d8f5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17ef7eac1cdd4b59a55b913605f65899'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:58.645888 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-a4d14e52-615d-458c-a4ea-ef88942d8f5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17ef7eac1cdd4b59a55b913605f65899'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:58.653965 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-a4d14e52-615d-458c-a4ea-ef88942d8f5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17ef7eac1cdd4b59a55b913605f65899'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:58.654617 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-a4d14e52-615d-458c-a4ea-ef88942d8f5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17ef7eac1cdd4b59a55b913605f65899'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:58.674326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1229/2442] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:37:58 2022] DELETE /identity/v3/users/17ef7eac1cdd4b59a55b913605f65899 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:58.678904 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f9667-2f73-42ac-95fe-761ea56821be None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:58.679214 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f9667-2f73-42ac-95fe-761ea56821be None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:58.679612 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f9667-2f73-42ac-95fe-761ea56821be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:58.698410 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-960f9667-2f73-42ac-95fe-761ea56821be None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:58.699660 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-960f9667-2f73-42ac-95fe-761ea56821be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:58.700402 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4f0d2-121c-4c7a-b1bb-4d05e5a987e2 service nova] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:58.717649 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:58.719828 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:37:58.766753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1230/2443] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:37:58.773511 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f9667-2f73-42ac-95fe-761ea56821be None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:58.775048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-960f9667-2f73-42ac-95fe-761ea56821be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:58.836839 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f9667-2f73-42ac-95fe-761ea56821be None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:58.840885 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc5f00-9cd8-428e-bf6a-884cabef68da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:58.841544 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc5f00-9cd8-428e-bf6a-884cabef68da service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:58.841816 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc5f00-9cd8-428e-bf6a-884cabef68da service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:58.842220 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc5f00-9cd8-428e-bf6a-884cabef68da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:58.852566 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc5f00-9cd8-428e-bf6a-884cabef68da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:58.854027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc5f00-9cd8-428e-bf6a-884cabef68da service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:58.863876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1231/2444] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:37:58.875573 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b135764-0800-494c-817b-755244c0b436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:58.876187 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b135764-0800-494c-817b-755244c0b436 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:58.876455 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b135764-0800-494c-817b-755244c0b436 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:58.876747 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b135764-0800-494c-817b-755244c0b436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:58.878478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-0b135764-0800-494c-817b-755244c0b436 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:58.892563 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b135764-0800-494c-817b-755244c0b436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:58.894000 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b135764-0800-494c-817b-755244c0b436 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:58.904800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1214/2445] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:37:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:37:59.582792 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc5f00-9cd8-428e-bf6a-884cabef68da service neutron] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:59.584978 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-e7dc5f00-9cd8-428e-bf6a-884cabef68da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:59.602545 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc5f00-9cd8-428e-bf6a-884cabef68da service neutron] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:59.608865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa2a9c-6023-48b5-b32d-6773615751ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:59.609522 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa2a9c-6023-48b5-b32d-6773615751ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:59.609805 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa2a9c-6023-48b5-b32d-6773615751ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:59.610078 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa2a9c-6023-48b5-b32d-6773615751ff admin admin] PATH_INFO: `/v3/projects/beeb7f8bbe1549b0bf24f29344684991` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:59.612210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa2a9c-6023-48b5-b32d-6773615751ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=beeb7f8bbe1549b0bf24f29344684991)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:59.614537 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa2a9c-6023-48b5-b32d-6773615751ff admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:59.674083 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8baa2a9c-6023-48b5-b32d-6773615751ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beeb7f8bbe1549b0bf24f29344684991', 'request_id': 'req-8baa2a9c-6023-48b5-b32d-6773615751ff'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:59.686165 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8baa2a9c-6023-48b5-b32d-6773615751ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beeb7f8bbe1549b0bf24f29344684991', 'request_id': 'req-8baa2a9c-6023-48b5-b32d-6773615751ff'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:59.693172 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8baa2a9c-6023-48b5-b32d-6773615751ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beeb7f8bbe1549b0bf24f29344684991', 'request_id': 'req-8baa2a9c-6023-48b5-b32d-6773615751ff'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:59.704786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8baa2a9c-6023-48b5-b32d-6773615751ff admin admin] The token cache is being invalidate because project beeb7f8bbe1549b0bf24f29344684991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:37:59.704996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8baa2a9c-6023-48b5-b32d-6773615751ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:59.705682 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8baa2a9c-6023-48b5-b32d-6773615751ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:37:59.707226 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1232/2446] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:37:59 2022] DELETE /identity/v3/projects/beeb7f8bbe1549b0bf24f29344684991 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:37:59.712414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69538195-2120-4c48-bc0e-58f3f61a9690 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:59.712907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69538195-2120-4c48-bc0e-58f3f61a9690 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:59.713255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69538195-2120-4c48-bc0e-58f3f61a9690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:59.733885 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-69538195-2120-4c48-bc0e-58f3f61a9690 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:59.735262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-69538195-2120-4c48-bc0e-58f3f61a9690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:59.797329 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1215/2447] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:37:59.805325 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f85f85-a730-4ea4-a130-12b80e2ccfd9 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:59.805605 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f85f85-a730-4ea4-a130-12b80e2ccfd9 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:59.805880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f85f85-a730-4ea4-a130-12b80e2ccfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:59.826667 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-06f85f85-a730-4ea4-a130-12b80e2ccfd9 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:37:59.828070 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-06f85f85-a730-4ea4-a130-12b80e2ccfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:37:59.836342 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1233/2448] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:37:59.840605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69538195-2120-4c48-bc0e-58f3f61a9690 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:59.852417 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69538195-2120-4c48-bc0e-58f3f61a9690 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:59.857334 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f905d49-bd76-4887-b39e-f2b14d303c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:59.857975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f905d49-bd76-4887-b39e-f2b14d303c66 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:59.858255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f905d49-bd76-4887-b39e-f2b14d303c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:59.858537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f905d49-bd76-4887-b39e-f2b14d303c66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:59.859507 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f905d49-bd76-4887-b39e-f2b14d303c66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:37:59.859800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f905d49-bd76-4887-b39e-f2b14d303c66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:59.861398 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f905d49-bd76-4887-b39e-f2b14d303c66 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:59.873782 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1216/2449] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:37:59.877984 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f85f85-a730-4ea4-a130-12b80e2ccfd9 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:59.889145 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f85f85-a730-4ea4-a130-12b80e2ccfd9 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:37:59.894853 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37739f-d98d-442b-9165-40ed65ba0b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:37:59.895555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37739f-d98d-442b-9165-40ed65ba0b15 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:37:59.895835 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37739f-d98d-442b-9165-40ed65ba0b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:37:59.896104 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37739f-d98d-442b-9165-40ed65ba0b15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:37:59.896740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37739f-d98d-442b-9165-40ed65ba0b15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:37:59.898697 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37739f-d98d-442b-9165-40ed65ba0b15 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:37:59.930360 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1234/2450] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:37:59 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:37:59.934773 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f905d49-bd76-4887-b39e-f2b14d303c66 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:37:59.947013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f905d49-bd76-4887-b39e-f2b14d303c66 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:00.006843 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bf8c5-5288-4cb2-b9c6-6003f40e0a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:00.007406 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bf8c5-5288-4cb2-b9c6-6003f40e0a44 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:00.007685 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bf8c5-5288-4cb2-b9c6-6003f40e0a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:00.007960 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bf8c5-5288-4cb2-b9c6-6003f40e0a44 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:00.008700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bf8c5-5288-4cb2-b9c6-6003f40e0a44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:00.010633 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bf8c5-5288-4cb2-b9c6-6003f40e0a44 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:00.033116 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1217/2451] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:37:59 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:00.037463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37739f-d98d-442b-9165-40ed65ba0b15 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:00.048417 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37739f-d98d-442b-9165-40ed65ba0b15 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:00.053652 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54771e1-6d11-4b8a-a59d-fb078d086fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:00.054284 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54771e1-6d11-4b8a-a59d-fb078d086fab admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:00.054813 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54771e1-6d11-4b8a-a59d-fb078d086fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:00.054813 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54771e1-6d11-4b8a-a59d-fb078d086fab admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:00.055519 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54771e1-6d11-4b8a-a59d-fb078d086fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:00.057116 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54771e1-6d11-4b8a-a59d-fb078d086fab admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:00.069501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1235/2452] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:38:00.073631 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bf8c5-5288-4cb2-b9c6-6003f40e0a44 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:00.084316 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bf8c5-5288-4cb2-b9c6-6003f40e0a44 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:00.089814 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b960f-10af-4e87-86ef-fc48735ba243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:00.090477 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b960f-10af-4e87-86ef-fc48735ba243 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:00.090755 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b960f-10af-4e87-86ef-fc48735ba243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:00.091093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b960f-10af-4e87-86ef-fc48735ba243 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:00.092740 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b960f-10af-4e87-86ef-fc48735ba243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:00.093328 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b960f-10af-4e87-86ef-fc48735ba243 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:00.105039 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1218/2453] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:38:00.109417 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54771e1-6d11-4b8a-a59d-fb078d086fab admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:00.120396 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54771e1-6d11-4b8a-a59d-fb078d086fab admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:00.129359 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb501e3-e0a2-430a-81ea-c10934c17cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:00.130429 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb501e3-e0a2-430a-81ea-c10934c17cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:00.130793 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb501e3-e0a2-430a-81ea-c10934c17cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:00.131918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb501e3-e0a2-430a-81ea-c10934c17cc1 admin admin] PATH_INFO: `/v3/projects/d2fcc73f93134c16910451197febc662/users/b93e7f87a41844148402770d6c70698b/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:00.144579 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:00.148952 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb501e3-e0a2-430a-81ea-c10934c17cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2fcc73f93134c16910451197febc662, user_id=b93e7f87a41844148402770d6c70698b, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:00.152125 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb501e3-e0a2-430a-81ea-c10934c17cc1 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:00.166863 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1236/2454] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:00 2022] PUT /identity/v3/projects/d2fcc73f93134c16910451197febc662/users/b93e7f87a41844148402770d6c70698b/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:00.177697 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75032fc7-9795-4be4-af8f-93354ef18c48 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:00.177986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75032fc7-9795-4be4-af8f-93354ef18c48 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:00.178249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75032fc7-9795-4be4-af8f-93354ef18c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:00.209361 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-75032fc7-9795-4be4-af8f-93354ef18c48 None None] MFA Rules not processed for user `b93e7f87a41844148402770d6c70698b`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:00.210619 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-75032fc7-9795-4be4-af8f-93354ef18c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:00.227150 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:00.283938 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1219/2455] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:00.289423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb501e3-e0a2-430a-81ea-c10934c17cc1 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:00.368888 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb501e3-e0a2-430a-81ea-c10934c17cc1 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:00.374342 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09d864-c8d1-4ece-a6e0-c039951a7cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:00.375235 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09d864-c8d1-4ece-a6e0-c039951a7cab admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:00.375520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09d864-c8d1-4ece-a6e0-c039951a7cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:00.376201 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09d864-c8d1-4ece-a6e0-c039951a7cab admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:00.376449 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09d864-c8d1-4ece-a6e0-c039951a7cab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:00.378396 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09d864-c8d1-4ece-a6e0-c039951a7cab admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:00.411207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1237/2456] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:38:00 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:00.415415 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75032fc7-9795-4be4-af8f-93354ef18c48 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:00.426941 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75032fc7-9795-4be4-af8f-93354ef18c48 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:00.495694 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93cd72-0f23-480d-b4c9-2178276395c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:00.496314 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93cd72-0f23-480d-b4c9-2178276395c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:00.496675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93cd72-0f23-480d-b4c9-2178276395c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:00.496943 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93cd72-0f23-480d-b4c9-2178276395c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:00.497566 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c93cd72-0f23-480d-b4c9-2178276395c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:00.499526 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c93cd72-0f23-480d-b4c9-2178276395c0 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:00.520908 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1220/2457] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:38:00 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:38:00.524832 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09d864-c8d1-4ece-a6e0-c039951a7cab admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:00.535668 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09d864-c8d1-4ece-a6e0-c039951a7cab admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:00.540405 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f3011-4b10-473f-bade-9799cbcfafc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:00.540955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f3011-4b10-473f-bade-9799cbcfafc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:00.541228 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f3011-4b10-473f-bade-9799cbcfafc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:00.541490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f3011-4b10-473f-bade-9799cbcfafc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:00.543820 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f3011-4b10-473f-bade-9799cbcfafc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:00.545430 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f3011-4b10-473f-bade-9799cbcfafc5 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:00.560356 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1238/2458] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:00.561106 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93cd72-0f23-480d-b4c9-2178276395c0 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:00.571482 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93cd72-0f23-480d-b4c9-2178276395c0 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:00.581317 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8aee71-d36b-49ed-a919-218d84050350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:00.582602 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8aee71-d36b-49ed-a919-218d84050350 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:00.582602 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8aee71-d36b-49ed-a919-218d84050350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:00.582786 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8aee71-d36b-49ed-a919-218d84050350 admin admin] PATH_INFO: `/v3/projects/3ec4ad14db774b3bbbe0832d5c4484aa/users/4b7442624d0d4eb3ac065a391e839550/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:00.598851 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8aee71-d36b-49ed-a919-218d84050350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ec4ad14db774b3bbbe0832d5c4484aa, user_id=4b7442624d0d4eb3ac065a391e839550, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:00.601548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8aee71-d36b-49ed-a919-218d84050350 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:00.615556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1221/2459] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:00 2022] PUT /identity/v3/projects/3ec4ad14db774b3bbbe0832d5c4484aa/users/4b7442624d0d4eb3ac065a391e839550/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:00.619596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f3011-4b10-473f-bade-9799cbcfafc5 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:00.629812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f3011-4b10-473f-bade-9799cbcfafc5 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:00.689649 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca8f4b6-990f-4f0f-a7af-b62d1bdcbc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:00.690264 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8f4b6-990f-4f0f-a7af-b62d1bdcbc28 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:00.690678 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8f4b6-990f-4f0f-a7af-b62d1bdcbc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:00.691006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8f4b6-990f-4f0f-a7af-b62d1bdcbc28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:00.691727 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca8f4b6-990f-4f0f-a7af-b62d1bdcbc28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:00.693475 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca8f4b6-990f-4f0f-a7af-b62d1bdcbc28 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:00.705428 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1239/2460] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:00.709659 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8aee71-d36b-49ed-a919-218d84050350 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:00.720890 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8aee71-d36b-49ed-a919-218d84050350 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:00.725856 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368e5d3-f7ea-43ef-9735-83b7b45bafa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:00.726535 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368e5d3-f7ea-43ef-9735-83b7b45bafa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:00.726812 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368e5d3-f7ea-43ef-9735-83b7b45bafa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:00.727121 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368e5d3-f7ea-43ef-9735-83b7b45bafa1 admin admin] PATH_INFO: `/v3/projects/3ec4ad14db774b3bbbe0832d5c4484aa/users/4b7442624d0d4eb3ac065a391e839550/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:00.729010 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368e5d3-f7ea-43ef-9735-83b7b45bafa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ec4ad14db774b3bbbe0832d5c4484aa, user_id=4b7442624d0d4eb3ac065a391e839550, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:00.732381 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368e5d3-f7ea-43ef-9735-83b7b45bafa1 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:00.743238 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1222/2461] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:00 2022] PUT /identity/v3/projects/3ec4ad14db774b3bbbe0832d5c4484aa/users/4b7442624d0d4eb3ac065a391e839550/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:00.755249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb3d1e-3fbd-4641-9aa3-7c5d7c15e8e7 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:00.755644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb3d1e-3fbd-4641-9aa3-7c5d7c15e8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:00.755842 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb3d1e-3fbd-4641-9aa3-7c5d7c15e8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:00.784222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-31eb3d1e-3fbd-4641-9aa3-7c5d7c15e8e7 None None] MFA Rules not processed for user `4b7442624d0d4eb3ac065a391e839550`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:00.785362 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-31eb3d1e-3fbd-4641-9aa3-7c5d7c15e8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:00.865760 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:00.920844 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1240/2462] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:00.935043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368e5d3-f7ea-43ef-9735-83b7b45bafa1 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:00.937639 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f368e5d3-f7ea-43ef-9735-83b7b45bafa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:01.013141 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368e5d3-f7ea-43ef-9735-83b7b45bafa1 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:01.017351 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b07d18-f340-4fbc-bb38-7fa9015bee3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:01.018214 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b07d18-f340-4fbc-bb38-7fa9015bee3d service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:01.018668 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b07d18-f340-4fbc-bb38-7fa9015bee3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:01.019145 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b07d18-f340-4fbc-bb38-7fa9015bee3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:01.031113 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b07d18-f340-4fbc-bb38-7fa9015bee3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:01.033283 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b07d18-f340-4fbc-bb38-7fa9015bee3d service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:01.045871 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1223/2463] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:38:01.597662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb3d1e-3fbd-4641-9aa3-7c5d7c15e8e7 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:01.669040 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb3d1e-3fbd-4641-9aa3-7c5d7c15e8e7 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:01.674390 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71098ea0-d5b3-4bcd-9571-13c612c1ef05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:01.675154 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71098ea0-d5b3-4bcd-9571-13c612c1ef05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:01.675437 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71098ea0-d5b3-4bcd-9571-13c612c1ef05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:01.675712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71098ea0-d5b3-4bcd-9571-13c612c1ef05 admin admin] PATH_INFO: `/v3/users/b93e7f87a41844148402770d6c70698b` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:01.676884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71098ea0-d5b3-4bcd-9571-13c612c1ef05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b93e7f87a41844148402770d6c70698b)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:01.678874 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71098ea0-d5b3-4bcd-9571-13c612c1ef05 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:01.725803 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-71098ea0-d5b3-4bcd-9571-13c612c1ef05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b93e7f87a41844148402770d6c70698b'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:01.726474 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-71098ea0-d5b3-4bcd-9571-13c612c1ef05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b93e7f87a41844148402770d6c70698b'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:01.734239 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-71098ea0-d5b3-4bcd-9571-13c612c1ef05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b93e7f87a41844148402770d6c70698b'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:01.742479 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-71098ea0-d5b3-4bcd-9571-13c612c1ef05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b93e7f87a41844148402770d6c70698b'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:01.743267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-71098ea0-d5b3-4bcd-9571-13c612c1ef05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b93e7f87a41844148402770d6c70698b'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:01.763488 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1241/2464] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:38:01 2022] DELETE /identity/v3/users/b93e7f87a41844148402770d6c70698b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:01.768913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ed467-079b-4d5c-bf42-13420d1a3fdb None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:01.770728 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ed467-079b-4d5c-bf42-13420d1a3fdb None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:01.771131 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ed467-079b-4d5c-bf42-13420d1a3fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:01.800310 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-c84ed467-079b-4d5c-bf42-13420d1a3fdb None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:01.803814 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c84ed467-079b-4d5c-bf42-13420d1a3fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:01.819422 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:01.889632 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1224/2465] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:01.902301 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71098ea0-d5b3-4bcd-9571-13c612c1ef05 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:01.904591 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-71098ea0-d5b3-4bcd-9571-13c612c1ef05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:01.977528 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71098ea0-d5b3-4bcd-9571-13c612c1ef05 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:01.981774 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d3914-ed30-4cb0-85a7-cf74cd485f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:01.982595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d3914-ed30-4cb0-85a7-cf74cd485f92 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:01.982972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d3914-ed30-4cb0-85a7-cf74cd485f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:01.983446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d3914-ed30-4cb0-85a7-cf74cd485f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:01.993468 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d3914-ed30-4cb0-85a7-cf74cd485f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:01.994921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d3914-ed30-4cb0-85a7-cf74cd485f92 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:02.005255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1242/2466] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:38:02.432987 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ed467-079b-4d5c-bf42-13420d1a3fdb None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:02.434792 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c84ed467-079b-4d5c-bf42-13420d1a3fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:02.453630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ed467-079b-4d5c-bf42-13420d1a3fdb None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:02.458335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df232c50-9d22-4d7e-b59e-f1f3c949b2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:02.459022 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df232c50-9d22-4d7e-b59e-f1f3c949b2d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:02.459290 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df232c50-9d22-4d7e-b59e-f1f3c949b2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:02.459555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df232c50-9d22-4d7e-b59e-f1f3c949b2d3 admin admin] PATH_INFO: `/v3/projects/d2fcc73f93134c16910451197febc662` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:02.460924 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df232c50-9d22-4d7e-b59e-f1f3c949b2d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2fcc73f93134c16910451197febc662)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:02.463896 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df232c50-9d22-4d7e-b59e-f1f3c949b2d3 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:02.540128 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-df232c50-9d22-4d7e-b59e-f1f3c949b2d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2fcc73f93134c16910451197febc662', 'request_id': 'req-df232c50-9d22-4d7e-b59e-f1f3c949b2d3'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:02.552295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-df232c50-9d22-4d7e-b59e-f1f3c949b2d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2fcc73f93134c16910451197febc662', 'request_id': 'req-df232c50-9d22-4d7e-b59e-f1f3c949b2d3'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:02.563562 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-df232c50-9d22-4d7e-b59e-f1f3c949b2d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2fcc73f93134c16910451197febc662', 'request_id': 'req-df232c50-9d22-4d7e-b59e-f1f3c949b2d3'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:02.593270 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-df232c50-9d22-4d7e-b59e-f1f3c949b2d3 admin admin] The token cache is being invalidate because project d2fcc73f93134c16910451197febc662 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:38:02.593509 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-df232c50-9d22-4d7e-b59e-f1f3c949b2d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:02.595685 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-df232c50-9d22-4d7e-b59e-f1f3c949b2d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:02.602039 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1225/2467] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:38:02 2022] DELETE /identity/v3/projects/d2fcc73f93134c16910451197febc662 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:02.606498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d3914-ed30-4cb0-85a7-cf74cd485f92 service neutron] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:02.619035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d3914-ed30-4cb0-85a7-cf74cd485f92 service neutron] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:02.629791 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:02.732349 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae3721-37c2-4ef2-b0de-a0aa493d03a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:02.733901 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae3721-37c2-4ef2-b0de-a0aa493d03a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:02.734333 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae3721-37c2-4ef2-b0de-a0aa493d03a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:02.734752 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae3721-37c2-4ef2-b0de-a0aa493d03a6 admin admin] PATH_INFO: `/v3/users/4b7442624d0d4eb3ac065a391e839550` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:02.736494 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae3721-37c2-4ef2-b0de-a0aa493d03a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b7442624d0d4eb3ac065a391e839550)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:02.738630 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae3721-37c2-4ef2-b0de-a0aa493d03a6 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:02.799597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df232c50-9d22-4d7e-b59e-f1f3c949b2d3 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:02.801217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-df232c50-9d22-4d7e-b59e-f1f3c949b2d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:02.816533 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df232c50-9d22-4d7e-b59e-f1f3c949b2d3 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:02.817497 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-38ae3721-37c2-4ef2-b0de-a0aa493d03a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b7442624d0d4eb3ac065a391e839550'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:02.818147 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-38ae3721-37c2-4ef2-b0de-a0aa493d03a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b7442624d0d4eb3ac065a391e839550'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:02.821504 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb1aa4-82d5-40c4-bd69-ce4bce0f9219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:02.822334 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb1aa4-82d5-40c4-bd69-ce4bce0f9219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:02.822776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb1aa4-82d5-40c4-bd69-ce4bce0f9219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:02.823079 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb1aa4-82d5-40c4-bd69-ce4bce0f9219 admin admin] PATH_INFO: `/v3/users/b505541b5fe8494fa9ae8777e7add970` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:02.824207 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb1aa4-82d5-40c4-bd69-ce4bce0f9219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b505541b5fe8494fa9ae8777e7add970)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:02.825307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-38ae3721-37c2-4ef2-b0de-a0aa493d03a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b7442624d0d4eb3ac065a391e839550'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:02.826238 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb1aa4-82d5-40c4-bd69-ce4bce0f9219 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:02.833580 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-38ae3721-37c2-4ef2-b0de-a0aa493d03a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b7442624d0d4eb3ac065a391e839550'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:02.834208 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-38ae3721-37c2-4ef2-b0de-a0aa493d03a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b7442624d0d4eb3ac065a391e839550'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:02.852185 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1243/2468] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:38:02 2022] DELETE /identity/v3/users/4b7442624d0d4eb3ac065a391e839550 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:02.884819 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-aeeb1aa4-82d5-40c4-bd69-ce4bce0f9219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b505541b5fe8494fa9ae8777e7add970'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:02.885501 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-aeeb1aa4-82d5-40c4-bd69-ce4bce0f9219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b505541b5fe8494fa9ae8777e7add970'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:02.893292 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-aeeb1aa4-82d5-40c4-bd69-ce4bce0f9219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b505541b5fe8494fa9ae8777e7add970'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:02.893923 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-aeeb1aa4-82d5-40c4-bd69-ce4bce0f9219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b505541b5fe8494fa9ae8777e7add970'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:02.901635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-aeeb1aa4-82d5-40c4-bd69-ce4bce0f9219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b505541b5fe8494fa9ae8777e7add970'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:02.923192 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1226/2469] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:38:02 2022] DELETE /identity/v3/users/b505541b5fe8494fa9ae8777e7add970 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:38:03.095937 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae3721-37c2-4ef2-b0de-a0aa493d03a6 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:03.097338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-38ae3721-37c2-4ef2-b0de-a0aa493d03a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:03.176794 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae3721-37c2-4ef2-b0de-a0aa493d03a6 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:03.210534 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:03.239646 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb1aa4-82d5-40c4-bd69-ce4bce0f9219 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:03.241347 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-aeeb1aa4-82d5-40c4-bd69-ce4bce0f9219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:03.242103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78291ae-d231-4d1e-ba17-884a7936be52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:03.243054 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78291ae-d231-4d1e-ba17-884a7936be52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:03.243502 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78291ae-d231-4d1e-ba17-884a7936be52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:03.243932 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78291ae-d231-4d1e-ba17-884a7936be52 admin admin] PATH_INFO: `/v3/projects/e4583dfba57d4ef8a82b71886679a82a` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:03.245333 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78291ae-d231-4d1e-ba17-884a7936be52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4583dfba57d4ef8a82b71886679a82a)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:03.247506 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78291ae-d231-4d1e-ba17-884a7936be52 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:03.271460 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb1aa4-82d5-40c4-bd69-ce4bce0f9219 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:03.281614 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b616ec-08a0-4bf5-9fa2-afc280071ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:03.282587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b616ec-08a0-4bf5-9fa2-afc280071ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:03.282959 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b616ec-08a0-4bf5-9fa2-afc280071ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:03.283295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b616ec-08a0-4bf5-9fa2-afc280071ad4 admin admin] PATH_INFO: `/v3/projects/3ec4ad14db774b3bbbe0832d5c4484aa` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:03.284725 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b616ec-08a0-4bf5-9fa2-afc280071ad4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ec4ad14db774b3bbbe0832d5c4484aa)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:03.287458 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b616ec-08a0-4bf5-9fa2-afc280071ad4 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:03.291314 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:03.312571 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c78291ae-d231-4d1e-ba17-884a7936be52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4583dfba57d4ef8a82b71886679a82a', 'request_id': 'req-c78291ae-d231-4d1e-ba17-884a7936be52'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:03.321819 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c78291ae-d231-4d1e-ba17-884a7936be52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4583dfba57d4ef8a82b71886679a82a', 'request_id': 'req-c78291ae-d231-4d1e-ba17-884a7936be52'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:03.328839 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c78291ae-d231-4d1e-ba17-884a7936be52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4583dfba57d4ef8a82b71886679a82a', 'request_id': 'req-c78291ae-d231-4d1e-ba17-884a7936be52'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:03.341651 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c78291ae-d231-4d1e-ba17-884a7936be52 admin admin] The token cache is being invalidate because project e4583dfba57d4ef8a82b71886679a82a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:38:03.341990 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c78291ae-d231-4d1e-ba17-884a7936be52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:03.342784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c78291ae-d231-4d1e-ba17-884a7936be52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:03.344946 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1244/2470] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:38:03 2022] DELETE /identity/v3/projects/e4583dfba57d4ef8a82b71886679a82a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:03.349978 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba1a9a-6acd-4674-87b9-477ad06c238b None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:03.350263 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba1a9a-6acd-4674-87b9-477ad06c238b None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:03.350541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba1a9a-6acd-4674-87b9-477ad06c238b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:03.359100 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-d0b616ec-08a0-4bf5-9fa2-afc280071ad4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ec4ad14db774b3bbbe0832d5c4484aa', 'request_id': 'req-d0b616ec-08a0-4bf5-9fa2-afc280071ad4'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:03.368341 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-d0b616ec-08a0-4bf5-9fa2-afc280071ad4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ec4ad14db774b3bbbe0832d5c4484aa', 'request_id': 'req-d0b616ec-08a0-4bf5-9fa2-afc280071ad4'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:03.375711 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-d0b616ec-08a0-4bf5-9fa2-afc280071ad4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ec4ad14db774b3bbbe0832d5c4484aa', 'request_id': 'req-d0b616ec-08a0-4bf5-9fa2-afc280071ad4'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:03.377534 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-99ba1a9a-6acd-4674-87b9-477ad06c238b None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:03.378999 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-99ba1a9a-6acd-4674-87b9-477ad06c238b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:03.400373 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-d0b616ec-08a0-4bf5-9fa2-afc280071ad4 admin admin] The token cache is being invalidate because project 3ec4ad14db774b3bbbe0832d5c4484aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:38:03.400660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-d0b616ec-08a0-4bf5-9fa2-afc280071ad4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:03.402757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-d0b616ec-08a0-4bf5-9fa2-afc280071ad4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:03.404331 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1227/2471] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:38:03 2022] DELETE /identity/v3/projects/3ec4ad14db774b3bbbe0832d5c4484aa => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:03.409548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d800ec-9e8c-4d5c-89d6-f5b69b91d2e7 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:03.409860 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d800ec-9e8c-4d5c-89d6-f5b69b91d2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:03.410098 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d800ec-9e8c-4d5c-89d6-f5b69b91d2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:03.446028 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-48d800ec-9e8c-4d5c-89d6-f5b69b91d2e7 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:03.447385 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-48d800ec-9e8c-4d5c-89d6-f5b69b91d2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:03.459048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1228/2472] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:38:03.461789 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1245/2473] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:03.464457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea76ed8-d3d2-4210-9840-817f68589df7 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:03.464950 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea76ed8-d3d2-4210-9840-817f68589df7 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:03.465496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea76ed8-d3d2-4210-9840-817f68589df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:03.467954 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78172bf8-08f4-4ee1-9b3f-9675ed0ecfe0 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:03.468245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78172bf8-08f4-4ee1-9b3f-9675ed0ecfe0 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:03.468524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78172bf8-08f4-4ee1-9b3f-9675ed0ecfe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:03.490404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-3ea76ed8-d3d2-4210-9840-817f68589df7 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:03.491117 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-78172bf8-08f4-4ee1-9b3f-9675ed0ecfe0 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:03.492662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-78172bf8-08f4-4ee1-9b3f-9675ed0ecfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:03.493162 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-3ea76ed8-d3d2-4210-9840-817f68589df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:03.504165 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1229/2474] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:03.506806 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1246/2475] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:03.507986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea76ed8-d3d2-4210-9840-817f68589df7 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:03.509919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78172bf8-08f4-4ee1-9b3f-9675ed0ecfe0 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:03.520651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea76ed8-d3d2-4210-9840-817f68589df7 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:03.521498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78172bf8-08f4-4ee1-9b3f-9675ed0ecfe0 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:03.527653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b15196-bc84-4d86-b9f9-a0391d1923bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:03.529529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b15196-bc84-4d86-b9f9-a0391d1923bd admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:03.529868 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b15196-bc84-4d86-b9f9-a0391d1923bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:03.530175 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97365a5-bf77-42cc-99ad-0bfba200a49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:03.530331 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b15196-bc84-4d86-b9f9-a0391d1923bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:03.530936 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97365a5-bf77-42cc-99ad-0bfba200a49c admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:03.531085 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b15196-bc84-4d86-b9f9-a0391d1923bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:38:03.531253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97365a5-bf77-42cc-99ad-0bfba200a49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:03.531529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97365a5-bf77-42cc-99ad-0bfba200a49c admin admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:03.531817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b15196-bc84-4d86-b9f9-a0391d1923bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:03.532237 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97365a5-bf77-42cc-99ad-0bfba200a49c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:38:03.532487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97365a5-bf77-42cc-99ad-0bfba200a49c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:03.534765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b15196-bc84-4d86-b9f9-a0391d1923bd admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:03.535294 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97365a5-bf77-42cc-99ad-0bfba200a49c admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:03.554317 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1230/2477] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:38:03.555090 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1247/2476] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:38:03.555830 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b15196-bc84-4d86-b9f9-a0391d1923bd admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:03.556527 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97365a5-bf77-42cc-99ad-0bfba200a49c admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:03.571194 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97365a5-bf77-42cc-99ad-0bfba200a49c admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:03.575742 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b15196-bc84-4d86-b9f9-a0391d1923bd admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:03.577284 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ce472-d182-4ad1-8b6f-47e31a12d3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:03.578405 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ce472-d182-4ad1-8b6f-47e31a12d3af admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:03.578971 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ce472-d182-4ad1-8b6f-47e31a12d3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:03.584107 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae362b-3226-4676-9fbd-117abf5b6f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:03.584910 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae362b-3226-4676-9fbd-117abf5b6f4b admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:03.585221 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae362b-3226-4676-9fbd-117abf5b6f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:03.585499 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae362b-3226-4676-9fbd-117abf5b6f4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:03.586276 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae362b-3226-4676-9fbd-117abf5b6f4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:03.588244 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae362b-3226-4676-9fbd-117abf5b6f4b admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:03.595107 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ce472-d182-4ad1-8b6f-47e31a12d3af admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:03.596256 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ce472-d182-4ad1-8b6f-47e31a12d3af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:03.603175 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ce472-d182-4ad1-8b6f-47e31a12d3af admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:03.640598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1231/2478] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:38:03 2022] POST /identity/v3/projects => generated 369 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:03.648079 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae362b-3226-4676-9fbd-117abf5b6f4b admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:03.703012 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1248/2479] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:38:03 2022] POST /identity/v3/projects => generated 369 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:03.707178 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ce472-d182-4ad1-8b6f-47e31a12d3af admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:03.758788 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:03.781980 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae362b-3226-4676-9fbd-117abf5b6f4b admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:03.825965 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ce472-d182-4ad1-8b6f-47e31a12d3af admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:03.855457 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0967a-39ee-4be6-9226-58d4a71a9ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:03.856272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0967a-39ee-4be6-9226-58d4a71a9ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:03.856665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0967a-39ee-4be6-9226-58d4a71a9ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:03.857875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0967a-39ee-4be6-9226-58d4a71a9ae6 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:03.858827 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0967a-39ee-4be6-9226-58d4a71a9ae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:03.861371 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0967a-39ee-4be6-9226-58d4a71a9ae6 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:03.891702 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:03.899766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1249/2480] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:38:03 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:03.904537 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0967a-39ee-4be6-9226-58d4a71a9ae6 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:03.921232 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b993fd-8869-4657-a7de-4c6dae7b2749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:03.922317 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b993fd-8869-4657-a7de-4c6dae7b2749 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:03.922694 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b993fd-8869-4657-a7de-4c6dae7b2749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:03.923086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b993fd-8869-4657-a7de-4c6dae7b2749 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:03.923822 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b993fd-8869-4657-a7de-4c6dae7b2749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:03.925996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0967a-39ee-4be6-9226-58d4a71a9ae6 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:03.926366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b993fd-8869-4657-a7de-4c6dae7b2749 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:03.932065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564270cd-ce00-441e-b9a7-660da5d339ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:03.933106 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564270cd-ce00-441e-b9a7-660da5d339ad admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:03.933580 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564270cd-ce00-441e-b9a7-660da5d339ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:03.934097 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564270cd-ce00-441e-b9a7-660da5d339ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:03.934953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564270cd-ce00-441e-b9a7-660da5d339ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:03.936931 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564270cd-ce00-441e-b9a7-660da5d339ad admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:03.950356 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1250/2481] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:03.953808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564270cd-ce00-441e-b9a7-660da5d339ad admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:03.958873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1232/2482] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:38:03 2022] POST /identity/v3/users => generated 285 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:03.963380 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b993fd-8869-4657-a7de-4c6dae7b2749 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:03.968952 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564270cd-ce00-441e-b9a7-660da5d339ad admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:03.974929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51031fc2-9e6e-443b-a97b-231da3393be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:03.976016 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51031fc2-9e6e-443b-a97b-231da3393be6 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:03.976444 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51031fc2-9e6e-443b-a97b-231da3393be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:03.976856 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51031fc2-9e6e-443b-a97b-231da3393be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:03.977636 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b993fd-8869-4657-a7de-4c6dae7b2749 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:03.979542 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51031fc2-9e6e-443b-a97b-231da3393be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:03.981242 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51031fc2-9e6e-443b-a97b-231da3393be6 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:03.983052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4214d-a192-4e82-a546-da7287644318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:03.984207 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4214d-a192-4e82-a546-da7287644318 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:03.984548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4214d-a192-4e82-a546-da7287644318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:03.984918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4214d-a192-4e82-a546-da7287644318 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:03.985646 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4214d-a192-4e82-a546-da7287644318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:03.993185 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1251/2483] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:38:03.995238 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4214d-a192-4e82-a546-da7287644318 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:03.997675 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51031fc2-9e6e-443b-a97b-231da3393be6 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:04.011187 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1233/2484] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:38:04.013399 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4214d-a192-4e82-a546-da7287644318 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:04.017632 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51031fc2-9e6e-443b-a97b-231da3393be6 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:04.022501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575bf05-5501-40a8-b84e-268e4a32b898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:04.023333 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575bf05-5501-40a8-b84e-268e4a32b898 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:04.023530 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575bf05-5501-40a8-b84e-268e4a32b898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:04.023884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575bf05-5501-40a8-b84e-268e4a32b898 admin admin] PATH_INFO: `/v3/projects/27324b223cc64b098f9e005779566b63/users/2e712cfb017f4fd884a8136e6847a48d/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:04.024841 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4214d-a192-4e82-a546-da7287644318 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:04.036367 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53ffd0-81d8-4081-a237-47d27e905a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:04.037263 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53ffd0-81d8-4081-a237-47d27e905a8a admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:04.037543 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53ffd0-81d8-4081-a237-47d27e905a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:04.037880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53ffd0-81d8-4081-a237-47d27e905a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:04.038517 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b53ffd0-81d8-4081-a237-47d27e905a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:04.040291 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b53ffd0-81d8-4081-a237-47d27e905a8a admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:04.048215 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575bf05-5501-40a8-b84e-268e4a32b898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27324b223cc64b098f9e005779566b63, user_id=2e712cfb017f4fd884a8136e6847a48d, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:04.051377 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575bf05-5501-40a8-b84e-268e4a32b898 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:04.055053 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1234/2485] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:04.057412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53ffd0-81d8-4081-a237-47d27e905a8a admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:04.066659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1252/2486] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:03 2022] PUT /identity/v3/projects/27324b223cc64b098f9e005779566b63/users/2e712cfb017f4fd884a8136e6847a48d/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:04.069335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53ffd0-81d8-4081-a237-47d27e905a8a admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:04.077374 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa2f28-26a9-496b-a2f6-9037b36e37d7 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:04.078202 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa2f28-26a9-496b-a2f6-9037b36e37d7 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:04.079411 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa2f28-26a9-496b-a2f6-9037b36e37d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:04.111667 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-32aa2f28-26a9-496b-a2f6-9037b36e37d7 None None] MFA Rules not processed for user `2e712cfb017f4fd884a8136e6847a48d`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:04.112969 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-32aa2f28-26a9-496b-a2f6-9037b36e37d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:04.130507 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798697f-00bf-4725-ab48-8b05b6d90c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:04.131202 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798697f-00bf-4725-ab48-8b05b6d90c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:04.131480 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798697f-00bf-4725-ab48-8b05b6d90c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:04.131747 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798697f-00bf-4725-ab48-8b05b6d90c7e admin admin] PATH_INFO: `/v3/projects/57df6a1276324a0f8fc9040f7808f5fe/users/fbc077d611c24fe1ad17bf1239249e37/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:04.147499 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798697f-00bf-4725-ab48-8b05b6d90c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=57df6a1276324a0f8fc9040f7808f5fe, user_id=fbc077d611c24fe1ad17bf1239249e37, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:04.150378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798697f-00bf-4725-ab48-8b05b6d90c7e admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:04.164097 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1235/2487] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:04 2022] PUT /identity/v3/projects/57df6a1276324a0f8fc9040f7808f5fe/users/fbc077d611c24fe1ad17bf1239249e37/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:38:04.176578 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bd11c-acc6-415d-bade-e0de9fddfe91 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:04.176861 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bd11c-acc6-415d-bade-e0de9fddfe91 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:04.177124 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bd11c-acc6-415d-bade-e0de9fddfe91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:04.180700 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1253/2488] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:38:04.185141 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa2f28-26a9-496b-a2f6-9037b36e37d7 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:04.196174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa2f28-26a9-496b-a2f6-9037b36e37d7 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:04.207456 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-ed2bd11c-acc6-415d-bade-e0de9fddfe91 None None] MFA Rules not processed for user `fbc077d611c24fe1ad17bf1239249e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:04.208654 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ed2bd11c-acc6-415d-bade-e0de9fddfe91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:04.246061 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:04.254554 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d66eb-82cf-4dec-a031-5429f8ddb782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:04.255355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d66eb-82cf-4dec-a031-5429f8ddb782 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:04.255801 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d66eb-82cf-4dec-a031-5429f8ddb782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:04.256404 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d66eb-82cf-4dec-a031-5429f8ddb782 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:04.257044 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d66eb-82cf-4dec-a031-5429f8ddb782 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:04.259076 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d66eb-82cf-4dec-a031-5429f8ddb782 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:04.275328 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1236/2489] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:38:04.280572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bd11c-acc6-415d-bade-e0de9fddfe91 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:04.287836 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1254/2490] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:38:04 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:38:04.291157 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bd11c-acc6-415d-bade-e0de9fddfe91 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:04.291997 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d66eb-82cf-4dec-a031-5429f8ddb782 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:04.320586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:04.352505 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28949253-96af-41ac-beff-eaa95ec98d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:04.354024 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28949253-96af-41ac-beff-eaa95ec98d02 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:04.354312 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28949253-96af-41ac-beff-eaa95ec98d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:04.354715 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28949253-96af-41ac-beff-eaa95ec98d02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:04.355519 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28949253-96af-41ac-beff-eaa95ec98d02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:04.357032 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d66eb-82cf-4dec-a031-5429f8ddb782 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:04.357761 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28949253-96af-41ac-beff-eaa95ec98d02 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:04.362018 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbc8f6-17a1-4aea-bb4f-4525f4330639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:04.363004 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbc8f6-17a1-4aea-bb4f-4525f4330639 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:04.363563 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbc8f6-17a1-4aea-bb4f-4525f4330639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:04.363979 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbc8f6-17a1-4aea-bb4f-4525f4330639 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:04.364753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbc8f6-17a1-4aea-bb4f-4525f4330639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:04.366901 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbc8f6-17a1-4aea-bb4f-4525f4330639 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:04.391136 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1237/2491] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:38:04 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:04.394335 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1255/2492] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:38:04 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:04.395265 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbc8f6-17a1-4aea-bb4f-4525f4330639 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:04.395494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28949253-96af-41ac-beff-eaa95ec98d02 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:04.405844 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbc8f6-17a1-4aea-bb4f-4525f4330639 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:04.463405 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28949253-96af-41ac-beff-eaa95ec98d02 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:04.470347 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87c8a9-7f50-4f17-972b-31ad359fce74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:04.470969 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87c8a9-7f50-4f17-972b-31ad359fce74 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:04.471290 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87c8a9-7f50-4f17-972b-31ad359fce74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:04.471593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87c8a9-7f50-4f17-972b-31ad359fce74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:04.471726 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846b454-ae26-48ec-995e-def069a1c84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:04.472242 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87c8a9-7f50-4f17-972b-31ad359fce74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:04.472370 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846b454-ae26-48ec-995e-def069a1c84e admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:04.472546 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846b454-ae26-48ec-995e-def069a1c84e admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:04.472800 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846b454-ae26-48ec-995e-def069a1c84e admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:04.473434 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846b454-ae26-48ec-995e-def069a1c84e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:04.474022 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87c8a9-7f50-4f17-972b-31ad359fce74 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:04.475688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846b454-ae26-48ec-995e-def069a1c84e admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:04.485282 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1256/2493] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:38:04.489207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87c8a9-7f50-4f17-972b-31ad359fce74 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:04.500326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87c8a9-7f50-4f17-972b-31ad359fce74 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:04.505604 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8435e13-405b-4cc8-9334-73bb8b109625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:04.505969 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1238/2494] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:38:04 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:04.507459 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8435e13-405b-4cc8-9334-73bb8b109625 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:04.507737 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8435e13-405b-4cc8-9334-73bb8b109625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:04.508013 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8435e13-405b-4cc8-9334-73bb8b109625 admin admin] PATH_INFO: `/v3/projects/0266b998438b4c2da1e768b958af6621/users/b51fefffa8a44b2b87d872c06f363c57/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:04.510028 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846b454-ae26-48ec-995e-def069a1c84e admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:04.523180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846b454-ae26-48ec-995e-def069a1c84e admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:04.528335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b91775-3808-4191-868a-50387d25cc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:04.528991 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b91775-3808-4191-868a-50387d25cc57 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:04.529265 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b91775-3808-4191-868a-50387d25cc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:04.529529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b91775-3808-4191-868a-50387d25cc57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:04.530834 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b91775-3808-4191-868a-50387d25cc57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:04.531988 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8435e13-405b-4cc8-9334-73bb8b109625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0266b998438b4c2da1e768b958af6621, user_id=b51fefffa8a44b2b87d872c06f363c57, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:04.532497 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b91775-3808-4191-868a-50387d25cc57 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:04.535031 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8435e13-405b-4cc8-9334-73bb8b109625 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:04.545386 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1239/2495] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:04.548879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1257/2496] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:04 2022] PUT /identity/v3/projects/0266b998438b4c2da1e768b958af6621/users/b51fefffa8a44b2b87d872c06f363c57/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:38:04.549777 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b91775-3808-4191-868a-50387d25cc57 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:04.552566 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8435e13-405b-4cc8-9334-73bb8b109625 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:04.560827 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b91775-3808-4191-868a-50387d25cc57 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:04.598237 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:04.618043 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8435e13-405b-4cc8-9334-73bb8b109625 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:04.620418 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f146722-d80c-4685-a82b-491fdab5f445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:04.621091 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f146722-d80c-4685-a82b-491fdab5f445 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:04.621367 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f146722-d80c-4685-a82b-491fdab5f445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:04.621683 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f146722-d80c-4685-a82b-491fdab5f445 admin admin] PATH_INFO: `/v3/projects/10ed273ba98d47c8bb3a758cf5f232ee/users/43688a92ed82468785c09195b502b28b/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:04.623657 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437db88e-058a-4ce0-809d-1c8d97df8154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:04.624274 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437db88e-058a-4ce0-809d-1c8d97df8154 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:04.624581 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437db88e-058a-4ce0-809d-1c8d97df8154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:04.625781 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437db88e-058a-4ce0-809d-1c8d97df8154 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:04.626437 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437db88e-058a-4ce0-809d-1c8d97df8154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:04.628085 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437db88e-058a-4ce0-809d-1c8d97df8154 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:04.637301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f146722-d80c-4685-a82b-491fdab5f445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ed273ba98d47c8bb3a758cf5f232ee, user_id=43688a92ed82468785c09195b502b28b, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:04.638555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1258/2497] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:38:04.640374 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f146722-d80c-4685-a82b-491fdab5f445 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:04.642701 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437db88e-058a-4ce0-809d-1c8d97df8154 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:04.654005 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437db88e-058a-4ce0-809d-1c8d97df8154 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:04.655744 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1240/2498] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:04 2022] PUT /identity/v3/projects/10ed273ba98d47c8bb3a758cf5f232ee/users/43688a92ed82468785c09195b502b28b/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:04.660171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f146722-d80c-4685-a82b-491fdab5f445 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:04.680250 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:04.716749 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c01566-8ef2-4111-bc9d-18c27f3e5359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:04.717486 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c01566-8ef2-4111-bc9d-18c27f3e5359 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:04.717827 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c01566-8ef2-4111-bc9d-18c27f3e5359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:04.718102 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c01566-8ef2-4111-bc9d-18c27f3e5359 admin admin] PATH_INFO: `/v3/projects/0266b998438b4c2da1e768b958af6621/users/b51fefffa8a44b2b87d872c06f363c57/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:04.720197 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c01566-8ef2-4111-bc9d-18c27f3e5359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0266b998438b4c2da1e768b958af6621, user_id=b51fefffa8a44b2b87d872c06f363c57, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:04.723093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c01566-8ef2-4111-bc9d-18c27f3e5359 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:04.726481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f146722-d80c-4685-a82b-491fdab5f445 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:04.731142 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e20654-2f0f-406d-a4a4-d03c2f0c5042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:04.731747 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e20654-2f0f-406d-a4a4-d03c2f0c5042 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:04.732021 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e20654-2f0f-406d-a4a4-d03c2f0c5042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:04.732288 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e20654-2f0f-406d-a4a4-d03c2f0c5042 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:04.732924 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e20654-2f0f-406d-a4a4-d03c2f0c5042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:04.733578 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1259/2499] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:04 2022] PUT /identity/v3/projects/0266b998438b4c2da1e768b958af6621/users/b51fefffa8a44b2b87d872c06f363c57/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:38:04.734648 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e20654-2f0f-406d-a4a4-d03c2f0c5042 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:04.744847 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d2647-68d6-4e0a-8f5a-d6deb2b741b6 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:04.745050 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1241/2500] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:38:04.745384 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d2647-68d6-4e0a-8f5a-d6deb2b741b6 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:04.745658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d2647-68d6-4e0a-8f5a-d6deb2b741b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:04.749228 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e20654-2f0f-406d-a4a4-d03c2f0c5042 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:04.758941 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e20654-2f0f-406d-a4a4-d03c2f0c5042 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:04.775219 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-3d8d2647-68d6-4e0a-8f5a-d6deb2b741b6 None None] MFA Rules not processed for user `b51fefffa8a44b2b87d872c06f363c57`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:04.776439 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-3d8d2647-68d6-4e0a-8f5a-d6deb2b741b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:04.816250 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfc4cb-f2ad-4483-bc8b-b6a0238afb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:04.816916 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfc4cb-f2ad-4483-bc8b-b6a0238afb6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:04.817191 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfc4cb-f2ad-4483-bc8b-b6a0238afb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:04.817459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfc4cb-f2ad-4483-bc8b-b6a0238afb6b admin admin] PATH_INFO: `/v3/projects/10ed273ba98d47c8bb3a758cf5f232ee/users/43688a92ed82468785c09195b502b28b/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:04.819561 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfc4cb-f2ad-4483-bc8b-b6a0238afb6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ed273ba98d47c8bb3a758cf5f232ee, user_id=43688a92ed82468785c09195b502b28b, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:04.822257 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfc4cb-f2ad-4483-bc8b-b6a0238afb6b admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:04.832375 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1242/2501] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:04 2022] PUT /identity/v3/projects/10ed273ba98d47c8bb3a758cf5f232ee/users/43688a92ed82468785c09195b502b28b/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:04.842971 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b207fb4-4fff-45c0-9166-4603f0b57754 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:04.843348 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b207fb4-4fff-45c0-9166-4603f0b57754 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:04.843654 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b207fb4-4fff-45c0-9166-4603f0b57754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:04.851860 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1260/2502] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:38:04.860851 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d2647-68d6-4e0a-8f5a-d6deb2b741b6 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:04.862237 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-3d8d2647-68d6-4e0a-8f5a-d6deb2b741b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:04.871867 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-0b207fb4-4fff-45c0-9166-4603f0b57754 None None] MFA Rules not processed for user `43688a92ed82468785c09195b502b28b`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:04.872998 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-0b207fb4-4fff-45c0-9166-4603f0b57754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:04.928329 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d2647-68d6-4e0a-8f5a-d6deb2b741b6 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:04.939580 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:04.949327 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1243/2503] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:38:04.960958 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b207fb4-4fff-45c0-9166-4603f0b57754 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:04.962377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-0b207fb4-4fff-45c0-9166-4603f0b57754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:04.990784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3a02c-5ab0-4b9a-924d-848aa37b5b0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:04.991267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3a02c-5ab0-4b9a-924d-848aa37b5b0c service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:04.991547 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3a02c-5ab0-4b9a-924d-848aa37b5b0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:04.991813 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3a02c-5ab0-4b9a-924d-848aa37b5b0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:05.002835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:05.031258 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b207fb4-4fff-45c0-9166-4603f0b57754 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:05.035978 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c51604-be8c-410d-b35b-a037ab871aff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:05.036604 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c51604-be8c-410d-b35b-a037ab871aff service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:05.036883 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c51604-be8c-410d-b35b-a037ab871aff service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:05.037157 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c51604-be8c-410d-b35b-a037ab871aff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:05.048135 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c51604-be8c-410d-b35b-a037ab871aff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:05.049650 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c51604-be8c-410d-b35b-a037ab871aff service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:05.059137 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b3a02c-5ab0-4b9a-924d-848aa37b5b0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:05.060656 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1244/2504] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:38:05.062749 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b3a02c-5ab0-4b9a-924d-848aa37b5b0c service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:05.073333 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1261/2505] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:38:05.129834 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c51604-be8c-410d-b35b-a037ab871aff service cinder] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:05.138898 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c51604-be8c-410d-b35b-a037ab871aff service cinder] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:05.142560 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfe76b-06f2-4ea0-b200-1abfecf76dd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:05.143186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfe76b-06f2-4ea0-b200-1abfecf76dd7 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:05.143463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfe76b-06f2-4ea0-b200-1abfecf76dd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:05.143728 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfe76b-06f2-4ea0-b200-1abfecf76dd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:05.218938 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbfe76b-06f2-4ea0-b200-1abfecf76dd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:05.220957 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbfe76b-06f2-4ea0-b200-1abfecf76dd7 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:05.232420 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1245/2506] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:38:05.257065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426b85c-a4e3-4da4-908d-d4a1ca4f9c9b None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:05.257368 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426b85c-a4e3-4da4-908d-d4a1ca4f9c9b None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:05.257583 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426b85c-a4e3-4da4-908d-d4a1ca4f9c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:05.282428 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-9426b85c-a4e3-4da4-908d-d4a1ca4f9c9b None None] MFA Rules not processed for user `05cfc9d62a244701a5df524d1c26f107`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:05.284315 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-9426b85c-a4e3-4da4-908d-d4a1ca4f9c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:05.351391 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1262/2507] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Oct 4 16:38:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:05.399960 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfe76b-06f2-4ea0-b200-1abfecf76dd7 service cinder] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:05.402534 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-bfbfe76b-06f2-4ea0-b200-1abfecf76dd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:05.494568 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfe76b-06f2-4ea0-b200-1abfecf76dd7 service cinder] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:05.508764 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f09102-8da0-48be-ac4f-8ca105baace3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6590cb6c1c964039b9dea771a647bdac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:05.509555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f09102-8da0-48be-ac4f-8ca105baace3 service swift] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:05.509978 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f09102-8da0-48be-ac4f-8ca105baace3 service swift] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:05.510550 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f09102-8da0-48be-ac4f-8ca105baace3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:05.524350 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f09102-8da0-48be-ac4f-8ca105baace3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:05.526894 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f09102-8da0-48be-ac4f-8ca105baace3 service swift] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:05.540543 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1246/2508] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Oct 4 16:38:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 16:38:06.101916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4dd6a3-2b9c-4e30-b3bb-718f03e84e14 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:06.103165 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4dd6a3-2b9c-4e30-b3bb-718f03e84e14 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:06.103738 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4dd6a3-2b9c-4e30-b3bb-718f03e84e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:06.127268 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-9c4dd6a3-2b9c-4e30-b3bb-718f03e84e14 None None] MFA Rules not processed for user `05cfc9d62a244701a5df524d1c26f107`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:06.127268 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-9c4dd6a3-2b9c-4e30-b3bb-718f03e84e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:06.134556 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1263/2509] 10.222.0.55 () {58 vars in 967 bytes} [Tue Oct 4 16:38:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:06.156783 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f09102-8da0-48be-ac4f-8ca105baace3 service swift] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:06.172922 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f09102-8da0-48be-ac4f-8ca105baace3 service swift] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:06.178663 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d20d1-e3a2-4323-bcc2-c26a4fd7ba79 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6590cb6c1c964039b9dea771a647bdac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:06.179304 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d20d1-e3a2-4323-bcc2-c26a4fd7ba79 service swift] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:06.180130 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d20d1-e3a2-4323-bcc2-c26a4fd7ba79 service swift] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:06.180130 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d20d1-e3a2-4323-bcc2-c26a4fd7ba79 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:06.192064 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d20d1-e3a2-4323-bcc2-c26a4fd7ba79 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:06.193668 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d20d1-e3a2-4323-bcc2-c26a4fd7ba79 service swift] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:06.203058 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1247/2510] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Oct 4 16:38:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 16:38:06.457333 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7a0be-58e1-4013-b507-ecede3325fe7 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:06.457614 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7a0be-58e1-4013-b507-ecede3325fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:06.457877 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7a0be-58e1-4013-b507-ecede3325fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:06.477274 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-0ec7a0be-58e1-4013-b507-ecede3325fe7 None None] MFA Rules not processed for user `05cfc9d62a244701a5df524d1c26f107`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:06.478869 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-0ec7a0be-58e1-4013-b507-ecede3325fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:06.486824 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1264/2511] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Oct 4 16:38:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:06.498805 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d20d1-e3a2-4323-bcc2-c26a4fd7ba79 service swift] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:06.509803 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d20d1-e3a2-4323-bcc2-c26a4fd7ba79 service swift] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:06.515353 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251e7df-bfdf-449f-800c-471fa76516b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6590cb6c1c964039b9dea771a647bdac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:06.516025 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251e7df-bfdf-449f-800c-471fa76516b6 service swift] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:06.516376 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251e7df-bfdf-449f-800c-471fa76516b6 service swift] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:06.516705 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251e7df-bfdf-449f-800c-471fa76516b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:06.525167 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251e7df-bfdf-449f-800c-471fa76516b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:06.526731 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251e7df-bfdf-449f-800c-471fa76516b6 service swift] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:06.535713 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1248/2512] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Oct 4 16:38:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 16:38:06.569797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7a0be-58e1-4013-b507-ecede3325fe7 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:06.646642 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:06.658368 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7a0be-58e1-4013-b507-ecede3325fe7 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:06.677592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2363f4-079f-45be-83bb-cba82d01c1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:06.678252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2363f4-079f-45be-83bb-cba82d01c1a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:06.678581 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2363f4-079f-45be-83bb-cba82d01c1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:06.678857 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2363f4-079f-45be-83bb-cba82d01c1a8 admin admin] PATH_INFO: `/v3/users/2e712cfb017f4fd884a8136e6847a48d` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:06.680014 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2363f4-079f-45be-83bb-cba82d01c1a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e712cfb017f4fd884a8136e6847a48d)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:06.682110 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2363f4-079f-45be-83bb-cba82d01c1a8 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:06.752085 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-7b2363f4-079f-45be-83bb-cba82d01c1a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e712cfb017f4fd884a8136e6847a48d'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:06.753465 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-7b2363f4-079f-45be-83bb-cba82d01c1a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e712cfb017f4fd884a8136e6847a48d'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:06.766051 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-7b2363f4-079f-45be-83bb-cba82d01c1a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e712cfb017f4fd884a8136e6847a48d'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:06.776522 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-7b2363f4-079f-45be-83bb-cba82d01c1a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e712cfb017f4fd884a8136e6847a48d'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:06.777801 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-7b2363f4-079f-45be-83bb-cba82d01c1a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e712cfb017f4fd884a8136e6847a48d'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:06.802420 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1265/2513] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:38:06 2022] DELETE /identity/v3/users/2e712cfb017f4fd884a8136e6847a48d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:06.807316 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29fa7b-9af7-425d-b6fa-05c38f657746 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:06.807479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29fa7b-9af7-425d-b6fa-05c38f657746 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:06.807752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29fa7b-9af7-425d-b6fa-05c38f657746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:06.833369 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-bf29fa7b-9af7-425d-b6fa-05c38f657746 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:06.834880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-bf29fa7b-9af7-425d-b6fa-05c38f657746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:06.880929 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:06.918705 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1249/2514] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:06.929571 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2363f4-079f-45be-83bb-cba82d01c1a8 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:06.931263 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-7b2363f4-079f-45be-83bb-cba82d01c1a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:06.991806 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b8cdd-2a59-4a30-8e54-6041158e7b1b None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:06.992456 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b8cdd-2a59-4a30-8e54-6041158e7b1b None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:06.992456 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b8cdd-2a59-4a30-8e54-6041158e7b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:07.031100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2363f4-079f-45be-83bb-cba82d01c1a8 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:07.034890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01874aa-cfe0-418a-8c76-a402fe64d06c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:07.035548 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01874aa-cfe0-418a-8c76-a402fe64d06c service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:07.035950 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01874aa-cfe0-418a-8c76-a402fe64d06c service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:07.036243 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01874aa-cfe0-418a-8c76-a402fe64d06c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:07.041312 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-f79b8cdd-2a59-4a30-8e54-6041158e7b1b None None] MFA Rules not processed for user `05cfc9d62a244701a5df524d1c26f107`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:07.042586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f79b8cdd-2a59-4a30-8e54-6041158e7b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:07.047833 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01874aa-cfe0-418a-8c76-a402fe64d06c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:07.049669 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01874aa-cfe0-418a-8c76-a402fe64d06c service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:07.060860 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1266/2515] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:38:07.125323 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1250/2516] 10.222.0.55 () {58 vars in 967 bytes} [Tue Oct 4 16:38:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:07.138819 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01874aa-cfe0-418a-8c76-a402fe64d06c service neutron] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:07.141339 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-c01874aa-cfe0-418a-8c76-a402fe64d06c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:07.260977 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01874aa-cfe0-418a-8c76-a402fe64d06c service neutron] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:07.270156 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0938c-12b2-4f0c-8bc0-e196fa060074 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6590cb6c1c964039b9dea771a647bdac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:07.272347 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0938c-12b2-4f0c-8bc0-e196fa060074 service swift] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:07.273002 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0938c-12b2-4f0c-8bc0-e196fa060074 service swift] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:07.273437 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0938c-12b2-4f0c-8bc0-e196fa060074 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:07.298448 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0938c-12b2-4f0c-8bc0-e196fa060074 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:07.319785 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0938c-12b2-4f0c-8bc0-e196fa060074 service swift] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:07.331677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1267/2517] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Oct 4 16:38:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 16:38:07.510226 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b8cdd-2a59-4a30-8e54-6041158e7b1b None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:07.513782 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f79b8cdd-2a59-4a30-8e54-6041158e7b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:07.545949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b8cdd-2a59-4a30-8e54-6041158e7b1b None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:07.572153 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ee2b7-e994-4a4b-a2e8-48bc68f493ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:07.573037 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ee2b7-e994-4a4b-a2e8-48bc68f493ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:07.573312 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ee2b7-e994-4a4b-a2e8-48bc68f493ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:07.573583 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ee2b7-e994-4a4b-a2e8-48bc68f493ce admin admin] PATH_INFO: `/v3/projects/27324b223cc64b098f9e005779566b63` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:07.575102 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ee2b7-e994-4a4b-a2e8-48bc68f493ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=27324b223cc64b098f9e005779566b63)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:07.577196 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ee2b7-e994-4a4b-a2e8-48bc68f493ce admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:07.651123 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-c76ee2b7-e994-4a4b-a2e8-48bc68f493ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27324b223cc64b098f9e005779566b63', 'request_id': 'req-c76ee2b7-e994-4a4b-a2e8-48bc68f493ce'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:07.664604 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-c76ee2b7-e994-4a4b-a2e8-48bc68f493ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27324b223cc64b098f9e005779566b63', 'request_id': 'req-c76ee2b7-e994-4a4b-a2e8-48bc68f493ce'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:07.672130 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-c76ee2b7-e994-4a4b-a2e8-48bc68f493ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27324b223cc64b098f9e005779566b63', 'request_id': 'req-c76ee2b7-e994-4a4b-a2e8-48bc68f493ce'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:07.687326 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-c76ee2b7-e994-4a4b-a2e8-48bc68f493ce admin admin] The token cache is being invalidate because project 27324b223cc64b098f9e005779566b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:38:07.687565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-c76ee2b7-e994-4a4b-a2e8-48bc68f493ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:07.688266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-c76ee2b7-e994-4a4b-a2e8-48bc68f493ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:07.689869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1251/2518] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:38:07 2022] DELETE /identity/v3/projects/27324b223cc64b098f9e005779566b63 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:07.693894 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0938c-12b2-4f0c-8bc0-e196fa060074 service swift] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:07.707608 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0938c-12b2-4f0c-8bc0-e196fa060074 service swift] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:07.710014 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:07.777131 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4351e34-9b3e-4e87-9b0c-8bbdc73078cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:07.777880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4351e34-9b3e-4e87-9b0c-8bbdc73078cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:07.778160 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4351e34-9b3e-4e87-9b0c-8bbdc73078cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:07.778584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4351e34-9b3e-4e87-9b0c-8bbdc73078cb admin admin] PATH_INFO: `/v3/users/b51fefffa8a44b2b87d872c06f363c57` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:07.779644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4351e34-9b3e-4e87-9b0c-8bbdc73078cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b51fefffa8a44b2b87d872c06f363c57)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:07.781584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4351e34-9b3e-4e87-9b0c-8bbdc73078cb admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:07.829838 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-b4351e34-9b3e-4e87-9b0c-8bbdc73078cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b51fefffa8a44b2b87d872c06f363c57'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:07.830500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-b4351e34-9b3e-4e87-9b0c-8bbdc73078cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b51fefffa8a44b2b87d872c06f363c57'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:07.837592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-b4351e34-9b3e-4e87-9b0c-8bbdc73078cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b51fefffa8a44b2b87d872c06f363c57'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:07.845708 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-b4351e34-9b3e-4e87-9b0c-8bbdc73078cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b51fefffa8a44b2b87d872c06f363c57'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:07.846351 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-b4351e34-9b3e-4e87-9b0c-8bbdc73078cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b51fefffa8a44b2b87d872c06f363c57'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:07.864284 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1268/2519] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:38:07 2022] DELETE /identity/v3/users/b51fefffa8a44b2b87d872c06f363c57 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:08.149577 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ee2b7-e994-4a4b-a2e8-48bc68f493ce admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:08.151176 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c76ee2b7-e994-4a4b-a2e8-48bc68f493ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:08.173760 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ee2b7-e994-4a4b-a2e8-48bc68f493ce admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:08.248852 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd246018-f887-457b-ae4a-126edf238a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:08.249599 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd246018-f887-457b-ae4a-126edf238a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:08.249972 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd246018-f887-457b-ae4a-126edf238a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:08.250342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd246018-f887-457b-ae4a-126edf238a60 admin admin] PATH_INFO: `/v3/projects/0266b998438b4c2da1e768b958af6621` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:08.251591 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd246018-f887-457b-ae4a-126edf238a60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0266b998438b4c2da1e768b958af6621)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:08.253600 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd246018-f887-457b-ae4a-126edf238a60 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:08.262661 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:08.329411 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-dd246018-f887-457b-ae4a-126edf238a60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0266b998438b4c2da1e768b958af6621', 'request_id': 'req-dd246018-f887-457b-ae4a-126edf238a60'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:08.341453 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-dd246018-f887-457b-ae4a-126edf238a60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0266b998438b4c2da1e768b958af6621', 'request_id': 'req-dd246018-f887-457b-ae4a-126edf238a60'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:08.350087 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-dd246018-f887-457b-ae4a-126edf238a60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0266b998438b4c2da1e768b958af6621', 'request_id': 'req-dd246018-f887-457b-ae4a-126edf238a60'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:08.370415 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-dd246018-f887-457b-ae4a-126edf238a60 admin admin] The token cache is being invalidate because project 0266b998438b4c2da1e768b958af6621 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:38:08.370711 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-dd246018-f887-457b-ae4a-126edf238a60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:08.371488 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-dd246018-f887-457b-ae4a-126edf238a60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:08.372992 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1252/2520] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:38:08 2022] DELETE /identity/v3/projects/0266b998438b4c2da1e768b958af6621 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:08.378758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe153add-911f-4f28-b28f-5009389ce668 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:08.379245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe153add-911f-4f28-b28f-5009389ce668 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:08.379338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe153add-911f-4f28-b28f-5009389ce668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:08.403862 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-fe153add-911f-4f28-b28f-5009389ce668 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:08.405097 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-fe153add-911f-4f28-b28f-5009389ce668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:08.484618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1269/2521] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:08.493310 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33badcff-1e09-4e90-8fe4-1c41ec9046b9 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:08.493589 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33badcff-1e09-4e90-8fe4-1c41ec9046b9 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:08.493859 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33badcff-1e09-4e90-8fe4-1c41ec9046b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:08.515746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-33badcff-1e09-4e90-8fe4-1c41ec9046b9 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:08.517173 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-33badcff-1e09-4e90-8fe4-1c41ec9046b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:08.527015 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1253/2522] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:08.530701 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe153add-911f-4f28-b28f-5009389ce668 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:08.541190 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe153add-911f-4f28-b28f-5009389ce668 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:08.549629 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209869f-dfbb-41d1-b7c7-fcb1e702045d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:08.550530 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209869f-dfbb-41d1-b7c7-fcb1e702045d admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:08.551161 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209869f-dfbb-41d1-b7c7-fcb1e702045d admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:08.551442 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209869f-dfbb-41d1-b7c7-fcb1e702045d admin admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:08.552272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209869f-dfbb-41d1-b7c7-fcb1e702045d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:38:08.552820 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209869f-dfbb-41d1-b7c7-fcb1e702045d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:08.557046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209869f-dfbb-41d1-b7c7-fcb1e702045d admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:08.567569 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1270/2523] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:38:08.571938 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33badcff-1e09-4e90-8fe4-1c41ec9046b9 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:08.585675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33badcff-1e09-4e90-8fe4-1c41ec9046b9 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:08.591307 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfef3c-4576-4883-b7fe-5ca0be18b7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:08.591927 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfef3c-4576-4883-b7fe-5ca0be18b7fc admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:08.592332 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfef3c-4576-4883-b7fe-5ca0be18b7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:08.592606 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfef3c-4576-4883-b7fe-5ca0be18b7fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:08.593376 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfef3c-4576-4883-b7fe-5ca0be18b7fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:08.595348 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfef3c-4576-4883-b7fe-5ca0be18b7fc admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:08.646967 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1254/2524] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:38:08 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:08.651013 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209869f-dfbb-41d1-b7c7-fcb1e702045d admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:08.666700 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209869f-dfbb-41d1-b7c7-fcb1e702045d admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:08.678126 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:08.743153 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7e812-9eac-4deb-bbac-72466e1b7446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:08.743998 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7e812-9eac-4deb-bbac-72466e1b7446 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:08.744270 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7e812-9eac-4deb-bbac-72466e1b7446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:08.744583 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7e812-9eac-4deb-bbac-72466e1b7446 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:08.745590 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7e812-9eac-4deb-bbac-72466e1b7446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:08.748165 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7e812-9eac-4deb-bbac-72466e1b7446 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:08.774158 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1271/2525] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:38:08 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:38:08.778572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfef3c-4576-4883-b7fe-5ca0be18b7fc admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:08.789582 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfef3c-4576-4883-b7fe-5ca0be18b7fc admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:08.795386 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7d80e-d8cc-44ee-8e80-a01e6bb3d2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:08.796290 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7d80e-d8cc-44ee-8e80-a01e6bb3d2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:08.796412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7d80e-d8cc-44ee-8e80-a01e6bb3d2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:08.796684 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7d80e-d8cc-44ee-8e80-a01e6bb3d2f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:08.797367 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7d80e-d8cc-44ee-8e80-a01e6bb3d2f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:08.799379 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7d80e-d8cc-44ee-8e80-a01e6bb3d2f9 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:08.810810 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1255/2526] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:08.815674 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7e812-9eac-4deb-bbac-72466e1b7446 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:08.827407 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7e812-9eac-4deb-bbac-72466e1b7446 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:08.832319 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb9cb4-6d1d-460b-acbc-268c61b11555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:08.832930 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb9cb4-6d1d-460b-acbc-268c61b11555 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:08.833234 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb9cb4-6d1d-460b-acbc-268c61b11555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:08.833493 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb9cb4-6d1d-460b-acbc-268c61b11555 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:08.834138 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb9cb4-6d1d-460b-acbc-268c61b11555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:08.835777 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb9cb4-6d1d-460b-acbc-268c61b11555 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:08.848572 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1272/2527] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:08.853403 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7d80e-d8cc-44ee-8e80-a01e6bb3d2f9 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:08.864432 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7d80e-d8cc-44ee-8e80-a01e6bb3d2f9 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:08.869683 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faeadb4-fe01-4f62-bb74-9e67e98405cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:08.870366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faeadb4-fe01-4f62-bb74-9e67e98405cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:08.870702 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faeadb4-fe01-4f62-bb74-9e67e98405cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:08.871006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faeadb4-fe01-4f62-bb74-9e67e98405cb admin admin] PATH_INFO: `/v3/projects/cd10a2b21c2949d390a1988e5adb2440/users/6fabefe287494f3988027593c1f381cb/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:08.888019 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faeadb4-fe01-4f62-bb74-9e67e98405cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd10a2b21c2949d390a1988e5adb2440, user_id=6fabefe287494f3988027593c1f381cb, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:08.890918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faeadb4-fe01-4f62-bb74-9e67e98405cb admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:08.906385 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1256/2528] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:08 2022] PUT /identity/v3/projects/cd10a2b21c2949d390a1988e5adb2440/users/6fabefe287494f3988027593c1f381cb/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:08.918084 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea398168-f979-4daa-bdf1-496825d8ed39 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:08.918430 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea398168-f979-4daa-bdf1-496825d8ed39 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:08.918782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea398168-f979-4daa-bdf1-496825d8ed39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:08.922680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faeadb4-fe01-4f62-bb74-9e67e98405cb admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:08.924440 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-0faeadb4-fe01-4f62-bb74-9e67e98405cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:08.947651 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-ea398168-f979-4daa-bdf1-496825d8ed39 None None] MFA Rules not processed for user `6fabefe287494f3988027593c1f381cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:08.948872 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ea398168-f979-4daa-bdf1-496825d8ed39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:08.991648 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faeadb4-fe01-4f62-bb74-9e67e98405cb admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:08.996490 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf91f1-b591-4b91-86bc-c6ea48d99a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:08.997135 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf91f1-b591-4b91-86bc-c6ea48d99a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:08.997404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf91f1-b591-4b91-86bc-c6ea48d99a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:08.997670 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf91f1-b591-4b91-86bc-c6ea48d99a9b admin admin] PATH_INFO: `/v3/users/fbc077d611c24fe1ad17bf1239249e37` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:08.998789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf91f1-b591-4b91-86bc-c6ea48d99a9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbc077d611c24fe1ad17bf1239249e37)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:09.000754 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf91f1-b591-4b91-86bc-c6ea48d99a9b admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:09.013591 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1273/2529] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:09.018073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea398168-f979-4daa-bdf1-496825d8ed39 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:09.029003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea398168-f979-4daa-bdf1-496825d8ed39 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:09.034022 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b2e18-bfb0-4334-befd-023c5e47777e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:09.034636 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b2e18-bfb0-4334-befd-023c5e47777e admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:09.034915 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b2e18-bfb0-4334-befd-023c5e47777e admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:09.035284 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b2e18-bfb0-4334-befd-023c5e47777e admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:09.035954 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b2e18-bfb0-4334-befd-023c5e47777e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:09.037856 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b2e18-bfb0-4334-befd-023c5e47777e admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:09.040300 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:09.052951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ecbf91f1-b591-4b91-86bc-c6ea48d99a9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbc077d611c24fe1ad17bf1239249e37'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:09.053737 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ecbf91f1-b591-4b91-86bc-c6ea48d99a9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbc077d611c24fe1ad17bf1239249e37'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:09.061746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ecbf91f1-b591-4b91-86bc-c6ea48d99a9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbc077d611c24fe1ad17bf1239249e37'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:09.062429 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ecbf91f1-b591-4b91-86bc-c6ea48d99a9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbc077d611c24fe1ad17bf1239249e37'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:09.068191 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1274/2530] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:38:09 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:38:09.070660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ecbf91f1-b591-4b91-86bc-c6ea48d99a9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbc077d611c24fe1ad17bf1239249e37'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:09.072406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b2e18-bfb0-4334-befd-023c5e47777e admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:09.074317 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-968b2e18-bfb0-4334-befd-023c5e47777e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:09.089508 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1257/2531] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:38:08 2022] DELETE /identity/v3/users/fbc077d611c24fe1ad17bf1239249e37 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:09.093932 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0a72c-3636-4d08-b33b-e55dc1cda327 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:09.094221 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0a72c-3636-4d08-b33b-e55dc1cda327 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:09.094490 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0a72c-3636-4d08-b33b-e55dc1cda327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:09.112895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-24e0a72c-3636-4d08-b33b-e55dc1cda327 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:09.114263 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-24e0a72c-3636-4d08-b33b-e55dc1cda327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:09.141965 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b2e18-bfb0-4334-befd-023c5e47777e admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:09.145631 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:09.174222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1258/2532] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:09.184338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0a72c-3636-4d08-b33b-e55dc1cda327 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:09.185810 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-24e0a72c-3636-4d08-b33b-e55dc1cda327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:09.198245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff8c8d-1e9f-475d-ab65-b2dcfae2af88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:09.198865 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff8c8d-1e9f-475d-ab65-b2dcfae2af88 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:09.199176 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff8c8d-1e9f-475d-ab65-b2dcfae2af88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:09.199453 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff8c8d-1e9f-475d-ab65-b2dcfae2af88 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:09.200118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff8c8d-1e9f-475d-ab65-b2dcfae2af88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:09.202049 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff8c8d-1e9f-475d-ab65-b2dcfae2af88 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:09.227313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1275/2533] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:38:09 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:38:09.231152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff8c8d-1e9f-475d-ab65-b2dcfae2af88 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:09.240862 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff8c8d-1e9f-475d-ab65-b2dcfae2af88 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:09.245754 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09084d6-b90b-4efa-b01c-f5b94dd87c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:09.246275 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09084d6-b90b-4efa-b01c-f5b94dd87c2d admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:09.246623 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09084d6-b90b-4efa-b01c-f5b94dd87c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:09.246928 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09084d6-b90b-4efa-b01c-f5b94dd87c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:09.247715 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09084d6-b90b-4efa-b01c-f5b94dd87c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:09.249360 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09084d6-b90b-4efa-b01c-f5b94dd87c2d admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:09.250422 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0a72c-3636-4d08-b33b-e55dc1cda327 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:09.254128 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244ea53-43a6-4088-a4f9-da42f4565325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:09.255216 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244ea53-43a6-4088-a4f9-da42f4565325 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:09.255507 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244ea53-43a6-4088-a4f9-da42f4565325 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:09.255778 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244ea53-43a6-4088-a4f9-da42f4565325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:09.263109 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1276/2534] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:38:09.264072 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09084d6-b90b-4efa-b01c-f5b94dd87c2d admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:09.266056 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244ea53-43a6-4088-a4f9-da42f4565325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:09.267574 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244ea53-43a6-4088-a4f9-da42f4565325 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:09.274015 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09084d6-b90b-4efa-b01c-f5b94dd87c2d admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:09.278014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1259/2535] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:38:09.279848 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd9336-75ec-416f-849d-59fcde42b732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:09.280654 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd9336-75ec-416f-849d-59fcde42b732 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:09.280929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd9336-75ec-416f-849d-59fcde42b732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:09.281279 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd9336-75ec-416f-849d-59fcde42b732 admin admin] PATH_INFO: `/v3/projects/fcb5e68a743c4d939df58b101b89a1fe/users/f060148945a944b7add3452894700cb6/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:09.298391 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd9336-75ec-416f-849d-59fcde42b732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcb5e68a743c4d939df58b101b89a1fe, user_id=f060148945a944b7add3452894700cb6, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:09.301065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd9336-75ec-416f-849d-59fcde42b732 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:09.316540 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1277/2536] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:09 2022] PUT /identity/v3/projects/fcb5e68a743c4d939df58b101b89a1fe/users/f060148945a944b7add3452894700cb6/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:09.320602 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244ea53-43a6-4088-a4f9-da42f4565325 service neutron] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:09.330880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244ea53-43a6-4088-a4f9-da42f4565325 service neutron] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:09.401997 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:09.412003 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf4b7b-92a9-40cd-9bbb-b700018280e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:09.413096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf4b7b-92a9-40cd-9bbb-b700018280e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:09.413378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf4b7b-92a9-40cd-9bbb-b700018280e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:09.413697 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf4b7b-92a9-40cd-9bbb-b700018280e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:09.414377 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf4b7b-92a9-40cd-9bbb-b700018280e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:09.417272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf4b7b-92a9-40cd-9bbb-b700018280e8 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:09.428641 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1260/2537] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:09.433122 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd9336-75ec-416f-849d-59fcde42b732 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:09.445685 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd9336-75ec-416f-849d-59fcde42b732 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:09.453416 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb701a-6c72-4577-9930-c4356dc2725c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:09.454187 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb701a-6c72-4577-9930-c4356dc2725c admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:09.454483 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb701a-6c72-4577-9930-c4356dc2725c admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:09.454816 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb701a-6c72-4577-9930-c4356dc2725c admin admin] PATH_INFO: `/v3/projects/fcb5e68a743c4d939df58b101b89a1fe/users/f060148945a944b7add3452894700cb6/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:09.456998 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb701a-6c72-4577-9930-c4356dc2725c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcb5e68a743c4d939df58b101b89a1fe, user_id=f060148945a944b7add3452894700cb6, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:09.459804 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb701a-6c72-4577-9930-c4356dc2725c admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:09.474341 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1278/2538] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:09 2022] PUT /identity/v3/projects/fcb5e68a743c4d939df58b101b89a1fe/users/f060148945a944b7add3452894700cb6/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:38:09.486219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc607eb1-9f42-461b-a3db-ed361a26b46d None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:09.486503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc607eb1-9f42-461b-a3db-ed361a26b46d None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:09.486778 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc607eb1-9f42-461b-a3db-ed361a26b46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:09.519822 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-fc607eb1-9f42-461b-a3db-ed361a26b46d None None] MFA Rules not processed for user `f060148945a944b7add3452894700cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:09.521341 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-fc607eb1-9f42-461b-a3db-ed361a26b46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:09.608114 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb701a-6c72-4577-9930-c4356dc2725c admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:09.610025 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-f4eb701a-6c72-4577-9930-c4356dc2725c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:09.630594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1261/2539] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:09 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:09.649749 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc607eb1-9f42-461b-a3db-ed361a26b46d None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:09.651829 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-fc607eb1-9f42-461b-a3db-ed361a26b46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:09.698684 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb701a-6c72-4577-9930-c4356dc2725c admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:09.704820 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d44e6e-2834-4208-bebc-5ed024edbb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:09.705466 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d44e6e-2834-4208-bebc-5ed024edbb66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:09.705744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d44e6e-2834-4208-bebc-5ed024edbb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:09.706545 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d44e6e-2834-4208-bebc-5ed024edbb66 admin admin] PATH_INFO: `/v3/projects/57df6a1276324a0f8fc9040f7808f5fe` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:09.709049 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d44e6e-2834-4208-bebc-5ed024edbb66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57df6a1276324a0f8fc9040f7808f5fe)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:09.711768 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d44e6e-2834-4208-bebc-5ed024edbb66 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:09.725538 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc607eb1-9f42-461b-a3db-ed361a26b46d None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:09.729562 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76f25c-ae46-44a2-8a8e-e1c9e5375ba4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:09.730366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76f25c-ae46-44a2-8a8e-e1c9e5375ba4 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:09.730757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76f25c-ae46-44a2-8a8e-e1c9e5375ba4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:09.731131 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76f25c-ae46-44a2-8a8e-e1c9e5375ba4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:09.741176 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76f25c-ae46-44a2-8a8e-e1c9e5375ba4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:09.742862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76f25c-ae46-44a2-8a8e-e1c9e5375ba4 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:09.755501 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1262/2540] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:38:09.756763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76f25c-ae46-44a2-8a8e-e1c9e5375ba4 service cinder] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:09.758443 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-7a76f25c-ae46-44a2-8a8e-e1c9e5375ba4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:09.778082 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76f25c-ae46-44a2-8a8e-e1c9e5375ba4 service cinder] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:09.786176 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e5d44e6e-2834-4208-bebc-5ed024edbb66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57df6a1276324a0f8fc9040f7808f5fe', 'request_id': 'req-e5d44e6e-2834-4208-bebc-5ed024edbb66'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:09.793382 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:09.800253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e5d44e6e-2834-4208-bebc-5ed024edbb66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57df6a1276324a0f8fc9040f7808f5fe', 'request_id': 'req-e5d44e6e-2834-4208-bebc-5ed024edbb66'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:09.825929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e5d44e6e-2834-4208-bebc-5ed024edbb66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57df6a1276324a0f8fc9040f7808f5fe', 'request_id': 'req-e5d44e6e-2834-4208-bebc-5ed024edbb66'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:09.858425 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88caee2b-eb7c-454e-8169-fb89fc974e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:09.858425 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88caee2b-eb7c-454e-8169-fb89fc974e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:09.858770 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88caee2b-eb7c-454e-8169-fb89fc974e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:09.859310 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88caee2b-eb7c-454e-8169-fb89fc974e8e admin admin] PATH_INFO: `/v3/users/c4fee990d0e14d6eaaf0e7348ddeb39c` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:09.860700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88caee2b-eb7c-454e-8169-fb89fc974e8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4fee990d0e14d6eaaf0e7348ddeb39c)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:09.862784 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88caee2b-eb7c-454e-8169-fb89fc974e8e admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:09.863057 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e5d44e6e-2834-4208-bebc-5ed024edbb66 admin admin] The token cache is being invalidate because project 57df6a1276324a0f8fc9040f7808f5fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:38:09.863359 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e5d44e6e-2834-4208-bebc-5ed024edbb66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:09.866743 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e5d44e6e-2834-4208-bebc-5ed024edbb66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:09.882353 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1279/2541] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:38:09 2022] DELETE /identity/v3/projects/57df6a1276324a0f8fc9040f7808f5fe => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:38:09.883190 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d44e6e-2834-4208-bebc-5ed024edbb66 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:09.884955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-e5d44e6e-2834-4208-bebc-5ed024edbb66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:09.892557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:09.951877 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-88caee2b-eb7c-454e-8169-fb89fc974e8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4fee990d0e14d6eaaf0e7348ddeb39c'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:09.952874 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-88caee2b-eb7c-454e-8169-fb89fc974e8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4fee990d0e14d6eaaf0e7348ddeb39c'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:09.961185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-88caee2b-eb7c-454e-8169-fb89fc974e8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4fee990d0e14d6eaaf0e7348ddeb39c'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:09.962041 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-88caee2b-eb7c-454e-8169-fb89fc974e8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4fee990d0e14d6eaaf0e7348ddeb39c'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:09.962548 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d44e6e-2834-4208-bebc-5ed024edbb66 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:09.966450 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149cdcf5-a170-4ad9-aec1-c0f877fab050 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:09.967168 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cdcf5-a170-4ad9-aec1-c0f877fab050 service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:09.967491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cdcf5-a170-4ad9-aec1-c0f877fab050 service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:09.967975 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cdcf5-a170-4ad9-aec1-c0f877fab050 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:09.970039 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-149cdcf5-a170-4ad9-aec1-c0f877fab050 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:09.971692 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-88caee2b-eb7c-454e-8169-fb89fc974e8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4fee990d0e14d6eaaf0e7348ddeb39c'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:09.992952 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1263/2542] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:38:09 2022] DELETE /identity/v3/users/c4fee990d0e14d6eaaf0e7348ddeb39c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:09.994163 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88caee2b-eb7c-454e-8169-fb89fc974e8e admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:09.996739 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-88caee2b-eb7c-454e-8169-fb89fc974e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:10.033381 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149cdcf5-a170-4ad9-aec1-c0f877fab050 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:10.034743 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149cdcf5-a170-4ad9-aec1-c0f877fab050 service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:10.059332 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1280/2543] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:38:10.062116 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefdaf8-5332-4609-a47b-df6b509a1bb0 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:10.062618 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefdaf8-5332-4609-a47b-df6b509a1bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:10.063189 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefdaf8-5332-4609-a47b-df6b509a1bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:10.099378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88caee2b-eb7c-454e-8169-fb89fc974e8e admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:10.099516 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-2fefdaf8-5332-4609-a47b-df6b509a1bb0 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:10.100728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-2fefdaf8-5332-4609-a47b-df6b509a1bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:10.108273 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe23c01-17e5-4495-a216-dc36a4dce78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:10.109367 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe23c01-17e5-4495-a216-dc36a4dce78b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:10.109840 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe23c01-17e5-4495-a216-dc36a4dce78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:10.110207 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe23c01-17e5-4495-a216-dc36a4dce78b admin admin] PATH_INFO: `/v3/users/43688a92ed82468785c09195b502b28b` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:10.111563 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1281/2544] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:10.115153 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe23c01-17e5-4495-a216-dc36a4dce78b admin admin] RBAC: Authorizing `identity:delete_user(user_id=43688a92ed82468785c09195b502b28b)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:10.117519 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe23c01-17e5-4495-a216-dc36a4dce78b admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:10.123319 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefdaf8-5332-4609-a47b-df6b509a1bb0 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:10.125461 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-2fefdaf8-5332-4609-a47b-df6b509a1bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:10.180721 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-bbe23c01-17e5-4495-a216-dc36a4dce78b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43688a92ed82468785c09195b502b28b'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:10.181490 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-bbe23c01-17e5-4495-a216-dc36a4dce78b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43688a92ed82468785c09195b502b28b'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:10.198400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-bbe23c01-17e5-4495-a216-dc36a4dce78b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43688a92ed82468785c09195b502b28b'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:10.203240 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-bbe23c01-17e5-4495-a216-dc36a4dce78b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43688a92ed82468785c09195b502b28b'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:10.220817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefdaf8-5332-4609-a47b-df6b509a1bb0 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:10.228059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-bbe23c01-17e5-4495-a216-dc36a4dce78b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43688a92ed82468785c09195b502b28b'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:10.231725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a3e4c-1396-47e9-92c2-b861c94086e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:10.232605 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a3e4c-1396-47e9-92c2-b861c94086e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:10.233139 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a3e4c-1396-47e9-92c2-b861c94086e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:10.233626 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a3e4c-1396-47e9-92c2-b861c94086e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:10.236048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b61a3e4c-1396-47e9-92c2-b861c94086e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:10.251195 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a3e4c-1396-47e9-92c2-b861c94086e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:10.252991 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a3e4c-1396-47e9-92c2-b861c94086e9 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:10.263885 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1264/2545] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:38:09 2022] DELETE /identity/v3/users/43688a92ed82468785c09195b502b28b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:10.269332 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1282/2546] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:38:10.423345 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe23c01-17e5-4495-a216-dc36a4dce78b admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:10.425885 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-bbe23c01-17e5-4495-a216-dc36a4dce78b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:10.451485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:10.502787 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe23c01-17e5-4495-a216-dc36a4dce78b admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:10.507760 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf0770-286f-426e-bd85-2b0fce7426ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:10.508404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf0770-286f-426e-bd85-2b0fce7426ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:10.508682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf0770-286f-426e-bd85-2b0fce7426ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:10.508951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf0770-286f-426e-bd85-2b0fce7426ec admin admin] PATH_INFO: `/v3/users/6fabefe287494f3988027593c1f381cb` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:10.510069 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf0770-286f-426e-bd85-2b0fce7426ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fabefe287494f3988027593c1f381cb)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:10.512601 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf0770-286f-426e-bd85-2b0fce7426ec admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:10.573369 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-4fdf0770-286f-426e-bd85-2b0fce7426ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fabefe287494f3988027593c1f381cb'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:10.575818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-4fdf0770-286f-426e-bd85-2b0fce7426ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fabefe287494f3988027593c1f381cb'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:10.587016 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-4fdf0770-286f-426e-bd85-2b0fce7426ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fabefe287494f3988027593c1f381cb'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:10.587796 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-4fdf0770-286f-426e-bd85-2b0fce7426ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fabefe287494f3988027593c1f381cb'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:10.596454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-4fdf0770-286f-426e-bd85-2b0fce7426ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fabefe287494f3988027593c1f381cb'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:10.612103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a3e4c-1396-47e9-92c2-b861c94086e9 service neutron] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:10.613694 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b61a3e4c-1396-47e9-92c2-b861c94086e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:10.624327 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1265/2547] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:38:10 2022] DELETE /identity/v3/users/6fabefe287494f3988027593c1f381cb => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:10.628805 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17012c-14a0-4631-848c-3e9a04b0fa0a None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:10.629182 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17012c-14a0-4631-848c-3e9a04b0fa0a None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:10.629555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17012c-14a0-4631-848c-3e9a04b0fa0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:10.646569 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a3e4c-1396-47e9-92c2-b861c94086e9 service neutron] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:10.651687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-ba17012c-14a0-4631-848c-3e9a04b0fa0a None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:10.653344 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ba17012c-14a0-4631-848c-3e9a04b0fa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:10.676440 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:10.713909 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f9ae0-20cf-4396-99f0-d67fe3fa5315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:10.714552 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f9ae0-20cf-4396-99f0-d67fe3fa5315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:10.714831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f9ae0-20cf-4396-99f0-d67fe3fa5315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:10.715372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f9ae0-20cf-4396-99f0-d67fe3fa5315 admin admin] PATH_INFO: `/v3/projects/61ee4c2113204a858e17aa559459a6af` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:10.716891 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f9ae0-20cf-4396-99f0-d67fe3fa5315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61ee4c2113204a858e17aa559459a6af)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:10.718844 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f9ae0-20cf-4396-99f0-d67fe3fa5315 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:10.725157 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1266/2548] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:10.731578 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17012c-14a0-4631-848c-3e9a04b0fa0a None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:10.732989 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ba17012c-14a0-4631-848c-3e9a04b0fa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:10.746054 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17012c-14a0-4631-848c-3e9a04b0fa0a None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:10.754767 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff44c83-05e1-4271-941c-5faa4fa802c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:10.755599 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff44c83-05e1-4271-941c-5faa4fa802c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:10.756023 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff44c83-05e1-4271-941c-5faa4fa802c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:10.756300 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff44c83-05e1-4271-941c-5faa4fa802c5 admin admin] PATH_INFO: `/v3/projects/10ed273ba98d47c8bb3a758cf5f232ee` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:10.757556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff44c83-05e1-4271-941c-5faa4fa802c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10ed273ba98d47c8bb3a758cf5f232ee)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:10.759537 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff44c83-05e1-4271-941c-5faa4fa802c5 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:10.775173 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-fd7f9ae0-20cf-4396-99f0-d67fe3fa5315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61ee4c2113204a858e17aa559459a6af', 'request_id': 'req-fd7f9ae0-20cf-4396-99f0-d67fe3fa5315'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:10.783050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-fd7f9ae0-20cf-4396-99f0-d67fe3fa5315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61ee4c2113204a858e17aa559459a6af', 'request_id': 'req-fd7f9ae0-20cf-4396-99f0-d67fe3fa5315'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:10.789794 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-fd7f9ae0-20cf-4396-99f0-d67fe3fa5315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61ee4c2113204a858e17aa559459a6af', 'request_id': 'req-fd7f9ae0-20cf-4396-99f0-d67fe3fa5315'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:10.797606 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:10.800631 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-fd7f9ae0-20cf-4396-99f0-d67fe3fa5315 admin admin] The token cache is being invalidate because project 61ee4c2113204a858e17aa559459a6af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:38:10.800918 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-fd7f9ae0-20cf-4396-99f0-d67fe3fa5315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:10.801573 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-fd7f9ae0-20cf-4396-99f0-d67fe3fa5315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:10.803172 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1283/2549] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:38:10 2022] DELETE /identity/v3/projects/61ee4c2113204a858e17aa559459a6af => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:38:10.812746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-1ff44c83-05e1-4271-941c-5faa4fa802c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10ed273ba98d47c8bb3a758cf5f232ee', 'request_id': 'req-1ff44c83-05e1-4271-941c-5faa4fa802c5'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:10.813561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f9ae0-20cf-4396-99f0-d67fe3fa5315 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:10.815137 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-fd7f9ae0-20cf-4396-99f0-d67fe3fa5315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:10.828426 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-1ff44c83-05e1-4271-941c-5faa4fa802c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10ed273ba98d47c8bb3a758cf5f232ee', 'request_id': 'req-1ff44c83-05e1-4271-941c-5faa4fa802c5'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:10.837556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-1ff44c83-05e1-4271-941c-5faa4fa802c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10ed273ba98d47c8bb3a758cf5f232ee', 'request_id': 'req-1ff44c83-05e1-4271-941c-5faa4fa802c5'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:10.850880 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-1ff44c83-05e1-4271-941c-5faa4fa802c5 admin admin] The token cache is being invalidate because project 10ed273ba98d47c8bb3a758cf5f232ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:38:10.851461 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-1ff44c83-05e1-4271-941c-5faa4fa802c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:10.852374 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-1ff44c83-05e1-4271-941c-5faa4fa802c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:10.857639 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1267/2550] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:38:10 2022] DELETE /identity/v3/projects/10ed273ba98d47c8bb3a758cf5f232ee => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:38:10.859450 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbf065-0a22-466d-8bc8-ce40a25b3125 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:10.859936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbf065-0a22-466d-8bc8-ce40a25b3125 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:10.860437 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbf065-0a22-466d-8bc8-ce40a25b3125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:10.881333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-cbcbf065-0a22-466d-8bc8-ce40a25b3125 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:10.882738 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-cbcbf065-0a22-466d-8bc8-ce40a25b3125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:10.896478 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f9ae0-20cf-4396-99f0-d67fe3fa5315 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:10.951452 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1268/2551] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:10.959409 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897a521-af53-428d-87cf-27818968cbbd None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:10.959742 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897a521-af53-428d-87cf-27818968cbbd None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:10.959996 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897a521-af53-428d-87cf-27818968cbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:10.961441 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd47d8-5386-4b95-bfb6-5a38dbffc9d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:10.962495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd47d8-5386-4b95-bfb6-5a38dbffc9d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:10.963011 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd47d8-5386-4b95-bfb6-5a38dbffc9d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:10.963510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd47d8-5386-4b95-bfb6-5a38dbffc9d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:10.965728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b1dd47d8-5386-4b95-bfb6-5a38dbffc9d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:10.981484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd47d8-5386-4b95-bfb6-5a38dbffc9d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:10.981920 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-7897a521-af53-428d-87cf-27818968cbbd None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:10.983208 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-7897a521-af53-428d-87cf-27818968cbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:10.984072 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd47d8-5386-4b95-bfb6-5a38dbffc9d3 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:10.991416 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1269/2552] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:38:10.995744 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897a521-af53-428d-87cf-27818968cbbd None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:10.997259 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1284/2553] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:38:11.005443 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897a521-af53-428d-87cf-27818968cbbd None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:11.010288 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7207c13-f7f9-416c-a8ac-a4d3e3c7a6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:11.010935 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7207c13-f7f9-416c-a8ac-a4d3e3c7a6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:11.011269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7207c13-f7f9-416c-a8ac-a4d3e3c7a6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:11.011531 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7207c13-f7f9-416c-a8ac-a4d3e3c7a6d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:11.012590 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7207c13-f7f9-416c-a8ac-a4d3e3c7a6d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:38:11.013008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7207c13-f7f9-416c-a8ac-a4d3e3c7a6d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:11.014543 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7207c13-f7f9-416c-a8ac-a4d3e3c7a6d9 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:11.027897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1270/2554] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:38:11.032916 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd47d8-5386-4b95-bfb6-5a38dbffc9d3 service neutron] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:11.044649 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd47d8-5386-4b95-bfb6-5a38dbffc9d3 service neutron] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:11.050634 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a921cb-08a9-4f2c-9628-4f5ddabfecd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:11.051310 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a921cb-08a9-4f2c-9628-4f5ddabfecd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:11.051587 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a921cb-08a9-4f2c-9628-4f5ddabfecd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:11.051855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a921cb-08a9-4f2c-9628-4f5ddabfecd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:11.052524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a921cb-08a9-4f2c-9628-4f5ddabfecd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:11.054610 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a921cb-08a9-4f2c-9628-4f5ddabfecd4 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:11.087608 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:11.110257 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1285/2555] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:38:11 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:11.111318 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7207c13-f7f9-416c-a8ac-a4d3e3c7a6d9 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:11.122264 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7207c13-f7f9-416c-a8ac-a4d3e3c7a6d9 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:11.182581 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d38fd-4a77-4b18-8510-3262d5c1183f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:11.183228 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d38fd-4a77-4b18-8510-3262d5c1183f admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:11.183497 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d38fd-4a77-4b18-8510-3262d5c1183f admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:11.183781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d38fd-4a77-4b18-8510-3262d5c1183f admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:11.184455 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d38fd-4a77-4b18-8510-3262d5c1183f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:11.186490 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d38fd-4a77-4b18-8510-3262d5c1183f admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:11.229170 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1271/2556] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:38:11 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:38:11.233290 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a921cb-08a9-4f2c-9628-4f5ddabfecd4 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:11.244726 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a921cb-08a9-4f2c-9628-4f5ddabfecd4 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:11.250213 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585810bb-94e0-4a8e-a6fb-4ae655227f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:11.250847 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585810bb-94e0-4a8e-a6fb-4ae655227f2e admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:11.251162 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585810bb-94e0-4a8e-a6fb-4ae655227f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:11.251424 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585810bb-94e0-4a8e-a6fb-4ae655227f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:11.252445 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585810bb-94e0-4a8e-a6fb-4ae655227f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:11.255022 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585810bb-94e0-4a8e-a6fb-4ae655227f2e admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:11.270956 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1286/2557] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:38:11.274831 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d38fd-4a77-4b18-8510-3262d5c1183f admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:11.291008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d38fd-4a77-4b18-8510-3262d5c1183f admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:11.291008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6d62e-2e12-4064-8a02-cc94f9197fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:11.291443 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6d62e-2e12-4064-8a02-cc94f9197fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:11.291808 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6d62e-2e12-4064-8a02-cc94f9197fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:11.291984 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6d62e-2e12-4064-8a02-cc94f9197fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:11.295514 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6d62e-2e12-4064-8a02-cc94f9197fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:11.295514 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6d62e-2e12-4064-8a02-cc94f9197fe2 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:11.305090 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1272/2558] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:38:11.309559 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585810bb-94e0-4a8e-a6fb-4ae655227f2e admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:11.319912 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585810bb-94e0-4a8e-a6fb-4ae655227f2e admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:11.324686 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83107679-6873-4c2c-82b3-b34e9480e5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:11.325493 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83107679-6873-4c2c-82b3-b34e9480e5d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:11.325762 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83107679-6873-4c2c-82b3-b34e9480e5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:11.326028 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83107679-6873-4c2c-82b3-b34e9480e5d2 admin admin] PATH_INFO: `/v3/projects/5cfc9ce59aa5480fb262c8b2ddab6634/users/e5e88df703c64584b7cf2c2dcc37a7cb/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:11.342003 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83107679-6873-4c2c-82b3-b34e9480e5d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cfc9ce59aa5480fb262c8b2ddab6634, user_id=e5e88df703c64584b7cf2c2dcc37a7cb, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:11.344099 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83107679-6873-4c2c-82b3-b34e9480e5d2 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:11.349066 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6d62e-2e12-4064-8a02-cc94f9197fe2 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:11.350881 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-e7d6d62e-2e12-4064-8a02-cc94f9197fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:11.363014 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1287/2559] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:11 2022] PUT /identity/v3/projects/5cfc9ce59aa5480fb262c8b2ddab6634/users/e5e88df703c64584b7cf2c2dcc37a7cb/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:11.365069 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6d62e-2e12-4064-8a02-cc94f9197fe2 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:11.373057 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2205a3-3c94-469c-a49d-4798e33c9cf5 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:11.373500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2205a3-3c94-469c-a49d-4798e33c9cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:11.373775 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2205a3-3c94-469c-a49d-4798e33c9cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:11.382325 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:11.405979 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-1f2205a3-3c94-469c-a49d-4798e33c9cf5 None None] MFA Rules not processed for user `e5e88df703c64584b7cf2c2dcc37a7cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:11.407223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-1f2205a3-3c94-469c-a49d-4798e33c9cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:11.426548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082325f-7adb-40e6-ac48-d12a76c35153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:11.427227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082325f-7adb-40e6-ac48-d12a76c35153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:11.427508 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082325f-7adb-40e6-ac48-d12a76c35153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:11.427780 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082325f-7adb-40e6-ac48-d12a76c35153 admin admin] PATH_INFO: `/v3/projects/cd10a2b21c2949d390a1988e5adb2440` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:11.428930 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082325f-7adb-40e6-ac48-d12a76c35153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd10a2b21c2949d390a1988e5adb2440)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:11.430848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082325f-7adb-40e6-ac48-d12a76c35153 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:11.474905 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1288/2560] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:11.479253 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-c082325f-7adb-40e6-ac48-d12a76c35153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd10a2b21c2949d390a1988e5adb2440', 'request_id': 'req-c082325f-7adb-40e6-ac48-d12a76c35153'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:11.479496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2205a3-3c94-469c-a49d-4798e33c9cf5 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:11.487770 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-c082325f-7adb-40e6-ac48-d12a76c35153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd10a2b21c2949d390a1988e5adb2440', 'request_id': 'req-c082325f-7adb-40e6-ac48-d12a76c35153'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:11.491172 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2205a3-3c94-469c-a49d-4798e33c9cf5 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:11.494302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-c082325f-7adb-40e6-ac48-d12a76c35153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd10a2b21c2949d390a1988e5adb2440', 'request_id': 'req-c082325f-7adb-40e6-ac48-d12a76c35153'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:11.505875 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-c082325f-7adb-40e6-ac48-d12a76c35153 admin admin] The token cache is being invalidate because project cd10a2b21c2949d390a1988e5adb2440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:38:11.506164 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-c082325f-7adb-40e6-ac48-d12a76c35153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:11.506823 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-c082325f-7adb-40e6-ac48-d12a76c35153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:11.508365 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1273/2561] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:38:11 2022] DELETE /identity/v3/projects/cd10a2b21c2949d390a1988e5adb2440 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:11.512811 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082325f-7adb-40e6-ac48-d12a76c35153 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:11.514290 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c082325f-7adb-40e6-ac48-d12a76c35153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:11.551364 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d08cc-23ec-480b-b08d-2e9f0b5d4e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:11.552385 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d08cc-23ec-480b-b08d-2e9f0b5d4e76 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:11.552850 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d08cc-23ec-480b-b08d-2e9f0b5d4e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:11.553338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d08cc-23ec-480b-b08d-2e9f0b5d4e76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:11.554438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d08cc-23ec-480b-b08d-2e9f0b5d4e76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:11.558271 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d08cc-23ec-480b-b08d-2e9f0b5d4e76 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:11.579959 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082325f-7adb-40e6-ac48-d12a76c35153 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:11.585714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155952b-9765-430b-9534-5d5cebeffc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:11.586638 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155952b-9765-430b-9534-5d5cebeffc3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:11.586924 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155952b-9765-430b-9534-5d5cebeffc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:11.587246 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155952b-9765-430b-9534-5d5cebeffc3a admin admin] PATH_INFO: `/v3/users/f060148945a944b7add3452894700cb6` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:11.588497 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155952b-9765-430b-9534-5d5cebeffc3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f060148945a944b7add3452894700cb6)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:11.590408 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155952b-9765-430b-9534-5d5cebeffc3a admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:11.603150 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1289/2562] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:38:11 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:38:11.606654 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d08cc-23ec-480b-b08d-2e9f0b5d4e76 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:11.609181 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-823d08cc-23ec-480b-b08d-2e9f0b5d4e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:11.639534 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-8155952b-9765-430b-9534-5d5cebeffc3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f060148945a944b7add3452894700cb6'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:11.640216 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-8155952b-9765-430b-9534-5d5cebeffc3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f060148945a944b7add3452894700cb6'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:11.644938 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:11.648271 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-8155952b-9765-430b-9534-5d5cebeffc3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f060148945a944b7add3452894700cb6'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:11.648947 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-8155952b-9765-430b-9534-5d5cebeffc3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f060148945a944b7add3452894700cb6'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:11.653606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:11.660314 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-8155952b-9765-430b-9534-5d5cebeffc3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f060148945a944b7add3452894700cb6'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:11.679431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1274/2563] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:38:11 2022] DELETE /identity/v3/users/f060148945a944b7add3452894700cb6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:38:11.680447 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d08cc-23ec-480b-b08d-2e9f0b5d4e76 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:11.737435 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15865f78-ec3e-4031-ae8b-7051f85c5c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:11.738049 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15865f78-ec3e-4031-ae8b-7051f85c5c9f admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:11.738334 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15865f78-ec3e-4031-ae8b-7051f85c5c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:11.738603 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15865f78-ec3e-4031-ae8b-7051f85c5c9f admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:11.739273 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15865f78-ec3e-4031-ae8b-7051f85c5c9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:11.741241 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15865f78-ec3e-4031-ae8b-7051f85c5c9f admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:11.765981 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1290/2564] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:38:11 2022] POST /identity/v3/users => generated 296 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:38:11.767330 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155952b-9765-430b-9534-5d5cebeffc3a admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:11.768855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-8155952b-9765-430b-9534-5d5cebeffc3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:11.783175 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155952b-9765-430b-9534-5d5cebeffc3a admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:11.787933 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84037e9a-154c-45e1-a6ac-74349a82a866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:11.788567 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84037e9a-154c-45e1-a6ac-74349a82a866 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:11.788837 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84037e9a-154c-45e1-a6ac-74349a82a866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:11.789098 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84037e9a-154c-45e1-a6ac-74349a82a866 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:11.789789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84037e9a-154c-45e1-a6ac-74349a82a866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:11.791361 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84037e9a-154c-45e1-a6ac-74349a82a866 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:11.802267 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1275/2565] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:11.806598 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15865f78-ec3e-4031-ae8b-7051f85c5c9f admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:11.817035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15865f78-ec3e-4031-ae8b-7051f85c5c9f admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:11.822262 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d091d1d-7400-45c7-aaed-2087c1496802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:11.822937 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d091d1d-7400-45c7-aaed-2087c1496802 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:11.823247 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d091d1d-7400-45c7-aaed-2087c1496802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:11.823960 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d091d1d-7400-45c7-aaed-2087c1496802 admin admin] PATH_INFO: `/v3/projects/c872400542134d84ad8f97329a0e4373/users/6265d1df9bfd47cfba891a0ab290986d/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:11.840742 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d091d1d-7400-45c7-aaed-2087c1496802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c872400542134d84ad8f97329a0e4373, user_id=6265d1df9bfd47cfba891a0ab290986d, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:11.843541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d091d1d-7400-45c7-aaed-2087c1496802 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:11.857797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1291/2566] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:11 2022] PUT /identity/v3/projects/c872400542134d84ad8f97329a0e4373/users/6265d1df9bfd47cfba891a0ab290986d/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:38:11.861938 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84037e9a-154c-45e1-a6ac-74349a82a866 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:11.871993 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84037e9a-154c-45e1-a6ac-74349a82a866 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:11.928624 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e24a9-1ea5-45e0-a42c-39487f985928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:11.929349 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e24a9-1ea5-45e0-a42c-39487f985928 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:11.929657 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e24a9-1ea5-45e0-a42c-39487f985928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:11.929904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e24a9-1ea5-45e0-a42c-39487f985928 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:11.931184 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e24a9-1ea5-45e0-a42c-39487f985928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:11.932861 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e24a9-1ea5-45e0-a42c-39487f985928 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:11.943629 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1276/2567] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:11.948087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d091d1d-7400-45c7-aaed-2087c1496802 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:11.957714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e24a9-1ea5-45e0-a42c-39487f985928 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:11.959791 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-283e24a9-1ea5-45e0-a42c-39487f985928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:11.960236 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d091d1d-7400-45c7-aaed-2087c1496802 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:11.965773 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0060e-5b13-470f-8af4-d60ae5f3d4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:11.966449 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0060e-5b13-470f-8af4-d60ae5f3d4a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:11.966725 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0060e-5b13-470f-8af4-d60ae5f3d4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:11.967022 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0060e-5b13-470f-8af4-d60ae5f3d4a4 admin admin] PATH_INFO: `/v3/projects/c872400542134d84ad8f97329a0e4373/users/6265d1df9bfd47cfba891a0ab290986d/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:11.969108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0060e-5b13-470f-8af4-d60ae5f3d4a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c872400542134d84ad8f97329a0e4373, user_id=6265d1df9bfd47cfba891a0ab290986d, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:11.972864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e24a9-1ea5-45e0-a42c-39487f985928 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:11.977526 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b8eb0-6730-4a20-8984-cecc3bd15bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:11.978166 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b8eb0-6730-4a20-8984-cecc3bd15bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:11.978445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b8eb0-6730-4a20-8984-cecc3bd15bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:11.978715 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b8eb0-6730-4a20-8984-cecc3bd15bec admin admin] PATH_INFO: `/v3/projects/fcb5e68a743c4d939df58b101b89a1fe` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:11.979917 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b8eb0-6730-4a20-8984-cecc3bd15bec admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcb5e68a743c4d939df58b101b89a1fe)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:11.981891 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b8eb0-6730-4a20-8984-cecc3bd15bec admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:11.983195 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0060e-5b13-470f-8af4-d60ae5f3d4a4 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:11.995844 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1292/2568] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:11 2022] PUT /identity/v3/projects/c872400542134d84ad8f97329a0e4373/users/6265d1df9bfd47cfba891a0ab290986d/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:12.006070 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacb554-459a-4846-9208-788756e9f89a None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:12.006445 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacb554-459a-4846-9208-788756e9f89a None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:12.006784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacb554-459a-4846-9208-788756e9f89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:12.038427 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-5cacb554-459a-4846-9208-788756e9f89a None None] MFA Rules not processed for user `6265d1df9bfd47cfba891a0ab290986d`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:12.039681 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-5cacb554-459a-4846-9208-788756e9f89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:12.039956 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f19b8eb0-6730-4a20-8984-cecc3bd15bec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcb5e68a743c4d939df58b101b89a1fe', 'request_id': 'req-f19b8eb0-6730-4a20-8984-cecc3bd15bec'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:12.048704 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f19b8eb0-6730-4a20-8984-cecc3bd15bec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcb5e68a743c4d939df58b101b89a1fe', 'request_id': 'req-f19b8eb0-6730-4a20-8984-cecc3bd15bec'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:12.056141 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f19b8eb0-6730-4a20-8984-cecc3bd15bec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcb5e68a743c4d939df58b101b89a1fe', 'request_id': 'req-f19b8eb0-6730-4a20-8984-cecc3bd15bec'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:12.067814 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f19b8eb0-6730-4a20-8984-cecc3bd15bec admin admin] The token cache is being invalidate because project fcb5e68a743c4d939df58b101b89a1fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:38:12.068253 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f19b8eb0-6730-4a20-8984-cecc3bd15bec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:12.069039 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f19b8eb0-6730-4a20-8984-cecc3bd15bec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:12.070935 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1277/2569] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:38:11 2022] DELETE /identity/v3/projects/fcb5e68a743c4d939df58b101b89a1fe => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:38:12.075893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d1d18-1cbe-484d-bb67-c0186d412ea1 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:12.076259 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d1d18-1cbe-484d-bb67-c0186d412ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:12.076601 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d1d18-1cbe-484d-bb67-c0186d412ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:12.097122 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-0e6d1d18-1cbe-484d-bb67-c0186d412ea1 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:12.098336 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-0e6d1d18-1cbe-484d-bb67-c0186d412ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:12.111945 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1293/2570] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:12 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:12.123885 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacb554-459a-4846-9208-788756e9f89a None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:12.125496 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-5cacb554-459a-4846-9208-788756e9f89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:12.132603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:12.154206 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:12.163196 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1278/2571] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:12.171378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f667c22-cbc8-45e4-962e-afd80a6dad1c None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:12.171700 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f667c22-cbc8-45e4-962e-afd80a6dad1c None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:12.171983 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f667c22-cbc8-45e4-962e-afd80a6dad1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:12.192319 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-2f667c22-cbc8-45e4-962e-afd80a6dad1c None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:12.193542 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-2f667c22-cbc8-45e4-962e-afd80a6dad1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:12.197962 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacb554-459a-4846-9208-788756e9f89a None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:12.201839 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000438ba-4e1d-4b83-8817-9d7e549625eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:12.202461 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000438ba-4e1d-4b83-8817-9d7e549625eb service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:12.202739 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000438ba-4e1d-4b83-8817-9d7e549625eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:12.203045 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000438ba-4e1d-4b83-8817-9d7e549625eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:12.204548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1279/2572] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:38:12.204801 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-000438ba-4e1d-4b83-8817-9d7e549625eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:12.208873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f667c22-cbc8-45e4-962e-afd80a6dad1c None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:12.218448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f667c22-cbc8-45e4-962e-afd80a6dad1c None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:12.223796 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5997d-b766-4d31-9023-582fa986d9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:12.224397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5997d-b766-4d31-9023-582fa986d9de admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:12.224674 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5997d-b766-4d31-9023-582fa986d9de admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:12.224947 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5997d-b766-4d31-9023-582fa986d9de admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:12.225593 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5997d-b766-4d31-9023-582fa986d9de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:38:12.225896 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5997d-b766-4d31-9023-582fa986d9de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:12.227572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5997d-b766-4d31-9023-582fa986d9de admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:12.239785 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1280/2573] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:38:12.244302 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5997d-b766-4d31-9023-582fa986d9de admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:12.255649 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5997d-b766-4d31-9023-582fa986d9de admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:12.260568 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15649df5-9a0c-4dbb-8b14-bc500ac98400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:12.261176 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15649df5-9a0c-4dbb-8b14-bc500ac98400 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:12.261459 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15649df5-9a0c-4dbb-8b14-bc500ac98400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:12.261995 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15649df5-9a0c-4dbb-8b14-bc500ac98400 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:12.263001 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15649df5-9a0c-4dbb-8b14-bc500ac98400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:12.265529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15649df5-9a0c-4dbb-8b14-bc500ac98400 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:12.265645 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000438ba-4e1d-4b83-8817-9d7e549625eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:12.267035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000438ba-4e1d-4b83-8817-9d7e549625eb service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:12.276046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1294/2574] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:38:12.298103 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1281/2575] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:38:12 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:12.302054 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000438ba-4e1d-4b83-8817-9d7e549625eb service cinder] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:12.313177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000438ba-4e1d-4b83-8817-9d7e549625eb service cinder] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:12.380593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1630a4d-2491-4ff3-8e9c-e243cc9d0207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:12.381328 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1630a4d-2491-4ff3-8e9c-e243cc9d0207 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:12.381661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1630a4d-2491-4ff3-8e9c-e243cc9d0207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:12.381997 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1630a4d-2491-4ff3-8e9c-e243cc9d0207 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:12.382716 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1630a4d-2491-4ff3-8e9c-e243cc9d0207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:12.384735 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1630a4d-2491-4ff3-8e9c-e243cc9d0207 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:12.409594 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1295/2576] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:38:12 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:12.413662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15649df5-9a0c-4dbb-8b14-bc500ac98400 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:12.425249 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15649df5-9a0c-4dbb-8b14-bc500ac98400 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:12.431376 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47678295-3b12-43db-a5f7-f570ffeb6da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:12.432117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47678295-3b12-43db-a5f7-f570ffeb6da4 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:12.432408 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47678295-3b12-43db-a5f7-f570ffeb6da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:12.432693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47678295-3b12-43db-a5f7-f570ffeb6da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:12.433477 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47678295-3b12-43db-a5f7-f570ffeb6da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:12.435576 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47678295-3b12-43db-a5f7-f570ffeb6da4 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:12.447763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1282/2577] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:12.452505 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1630a4d-2491-4ff3-8e9c-e243cc9d0207 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:12.465014 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1630a4d-2491-4ff3-8e9c-e243cc9d0207 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:12.470257 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25f250-4b84-4621-bb45-15b8126174e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:12.470831 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25f250-4b84-4621-bb45-15b8126174e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:12.471288 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25f250-4b84-4621-bb45-15b8126174e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:12.471569 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25f250-4b84-4621-bb45-15b8126174e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:12.472216 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25f250-4b84-4621-bb45-15b8126174e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:12.473997 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25f250-4b84-4621-bb45-15b8126174e9 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:12.486290 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1296/2578] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:12.490488 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47678295-3b12-43db-a5f7-f570ffeb6da4 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:12.501436 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47678295-3b12-43db-a5f7-f570ffeb6da4 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:12.506366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d48c9e-feb6-4948-8a40-3c1e14dedee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:12.507177 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d48c9e-feb6-4948-8a40-3c1e14dedee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:12.507369 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d48c9e-feb6-4948-8a40-3c1e14dedee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:12.507611 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d48c9e-feb6-4948-8a40-3c1e14dedee3 admin admin] PATH_INFO: `/v3/projects/8aab6a558d3e449da4729059de8d6a7e/users/09c59665212e44d0b7b68a35f680b5c2/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:12.524749 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d48c9e-feb6-4948-8a40-3c1e14dedee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aab6a558d3e449da4729059de8d6a7e, user_id=09c59665212e44d0b7b68a35f680b5c2, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:12.527907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d48c9e-feb6-4948-8a40-3c1e14dedee3 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:12.542193 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1283/2579] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:12 2022] PUT /identity/v3/projects/8aab6a558d3e449da4729059de8d6a7e/users/09c59665212e44d0b7b68a35f680b5c2/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:12.555298 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89ba42-a7f2-439f-97df-ea7b032785fc None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:12.555575 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89ba42-a7f2-439f-97df-ea7b032785fc None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:12.555844 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89ba42-a7f2-439f-97df-ea7b032785fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:12.628802 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-5a89ba42-a7f2-439f-97df-ea7b032785fc None None] MFA Rules not processed for user `09c59665212e44d0b7b68a35f680b5c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:12.630060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-5a89ba42-a7f2-439f-97df-ea7b032785fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:12.681997 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:12.709999 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1297/2580] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:12.714835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d48c9e-feb6-4948-8a40-3c1e14dedee3 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:12.782005 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d48c9e-feb6-4948-8a40-3c1e14dedee3 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:12.787137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35866e68-3d08-4a50-959c-76c0a80729a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:12.787749 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35866e68-3d08-4a50-959c-76c0a80729a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:12.788023 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35866e68-3d08-4a50-959c-76c0a80729a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:12.788297 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35866e68-3d08-4a50-959c-76c0a80729a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:12.788996 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35866e68-3d08-4a50-959c-76c0a80729a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:12.790934 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35866e68-3d08-4a50-959c-76c0a80729a1 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:12.818596 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1284/2581] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:38:12 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:38:12.822914 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89ba42-a7f2-439f-97df-ea7b032785fc None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:12.833743 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89ba42-a7f2-439f-97df-ea7b032785fc None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:12.895917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5793643-04b7-4358-a53d-8347921cc57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:12.896445 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5793643-04b7-4358-a53d-8347921cc57a admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:12.896721 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5793643-04b7-4358-a53d-8347921cc57a admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:12.896983 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5793643-04b7-4358-a53d-8347921cc57a admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:12.897612 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5793643-04b7-4358-a53d-8347921cc57a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:12.901115 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5793643-04b7-4358-a53d-8347921cc57a admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:12.929373 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1298/2582] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:38:12 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:38:12.934649 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35866e68-3d08-4a50-959c-76c0a80729a1 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:12.945461 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35866e68-3d08-4a50-959c-76c0a80729a1 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:12.950926 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bebce-1870-4c98-b463-d6b6ab753b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:12.951568 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bebce-1870-4c98-b463-d6b6ab753b8d admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:12.951852 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bebce-1870-4c98-b463-d6b6ab753b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:12.952103 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bebce-1870-4c98-b463-d6b6ab753b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:12.952749 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8bebce-1870-4c98-b463-d6b6ab753b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:12.954355 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8bebce-1870-4c98-b463-d6b6ab753b8d admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:12.965585 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1285/2583] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:12.969886 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5793643-04b7-4358-a53d-8347921cc57a admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:12.980320 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5793643-04b7-4358-a53d-8347921cc57a admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:12.985381 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed69d8-21e7-480f-bf00-1d908264bbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:12.986026 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed69d8-21e7-480f-bf00-1d908264bbde admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:12.986304 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed69d8-21e7-480f-bf00-1d908264bbde admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:12.986572 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed69d8-21e7-480f-bf00-1d908264bbde admin admin] PATH_INFO: `/v3/projects/f429fe329ba2457cafff0d31fd1f53c4/users/db62678415364630ad9733c283dfc39d/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:13.001854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed69d8-21e7-480f-bf00-1d908264bbde admin admin] RBAC: Authorizing `identity:create_grant(project_id=f429fe329ba2457cafff0d31fd1f53c4, user_id=db62678415364630ad9733c283dfc39d, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:13.004541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed69d8-21e7-480f-bf00-1d908264bbde admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:13.022678 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1299/2584] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:12 2022] PUT /identity/v3/projects/f429fe329ba2457cafff0d31fd1f53c4/users/db62678415364630ad9733c283dfc39d/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:13.028653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bebce-1870-4c98-b463-d6b6ab753b8d admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:13.039091 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bebce-1870-4c98-b463-d6b6ab753b8d admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:13.071263 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:13.097559 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8336be2-e960-4ac9-a3c2-9d45bc0d3c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:13.098222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8336be2-e960-4ac9-a3c2-9d45bc0d3c9e admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:13.098508 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8336be2-e960-4ac9-a3c2-9d45bc0d3c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:13.098829 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8336be2-e960-4ac9-a3c2-9d45bc0d3c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:13.099602 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8336be2-e960-4ac9-a3c2-9d45bc0d3c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:13.101219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8336be2-e960-4ac9-a3c2-9d45bc0d3c9e admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:13.111589 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1286/2585] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:38:13.117332 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed69d8-21e7-480f-bf00-1d908264bbde admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:13.128757 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed69d8-21e7-480f-bf00-1d908264bbde admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:13.134293 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3b621-403b-4106-8870-c1421116e7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:13.134955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3b621-403b-4106-8870-c1421116e7a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:13.135268 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3b621-403b-4106-8870-c1421116e7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:13.135542 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3b621-403b-4106-8870-c1421116e7a4 admin admin] PATH_INFO: `/v3/projects/f429fe329ba2457cafff0d31fd1f53c4/users/db62678415364630ad9733c283dfc39d/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:13.138064 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3b621-403b-4106-8870-c1421116e7a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f429fe329ba2457cafff0d31fd1f53c4, user_id=db62678415364630ad9733c283dfc39d, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:13.140742 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3b621-403b-4106-8870-c1421116e7a4 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:13.151883 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1300/2586] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:13 2022] PUT /identity/v3/projects/f429fe329ba2457cafff0d31fd1f53c4/users/db62678415364630ad9733c283dfc39d/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:13.162349 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6017d-4df5-4748-95d3-0c164b885d3f None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:13.162631 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6017d-4df5-4748-95d3-0c164b885d3f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:13.162900 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6017d-4df5-4748-95d3-0c164b885d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:13.194312 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-46e6017d-4df5-4748-95d3-0c164b885d3f None None] MFA Rules not processed for user `db62678415364630ad9733c283dfc39d`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:13.195681 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-46e6017d-4df5-4748-95d3-0c164b885d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:13.275551 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1287/2587] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:13.287833 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3b621-403b-4106-8870-c1421116e7a4 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:13.344898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3b621-403b-4106-8870-c1421116e7a4 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:13.348655 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b181f78-540a-415f-a519-2c03165e71b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:13.349265 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b181f78-540a-415f-a519-2c03165e71b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:13.349537 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b181f78-540a-415f-a519-2c03165e71b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:13.349808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b181f78-540a-415f-a519-2c03165e71b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:13.399784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:13.415301 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b181f78-540a-415f-a519-2c03165e71b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:13.417463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b181f78-540a-415f-a519-2c03165e71b8 service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:13.426745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1301/2588] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:38:13.712665 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6017d-4df5-4748-95d3-0c164b885d3f None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:13.723053 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6017d-4df5-4748-95d3-0c164b885d3f None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:13.727261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16922bb4-7719-4774-b873-01d88dcb18f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:13.727984 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16922bb4-7719-4774-b873-01d88dcb18f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:13.728324 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16922bb4-7719-4774-b873-01d88dcb18f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:13.728595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16922bb4-7719-4774-b873-01d88dcb18f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:13.808997 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16922bb4-7719-4774-b873-01d88dcb18f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:13.811105 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16922bb4-7719-4774-b873-01d88dcb18f4 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:13.823570 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1288/2589] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:38:17.690705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b181f78-540a-415f-a519-2c03165e71b8 service cinder] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:17.695238 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-5b181f78-540a-415f-a519-2c03165e71b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:17.761442 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16922bb4-7719-4774-b873-01d88dcb18f4 service cinder] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:17.769089 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b181f78-540a-415f-a519-2c03165e71b8 service cinder] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:17.770310 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16922bb4-7719-4774-b873-01d88dcb18f4 service cinder] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:17.773786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd529b6-1f71-4dd9-a619-04682b7b2c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:17.774028 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f6fba-e7a8-4b24-bf72-cf34fd820ebd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:17.774410 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd529b6-1f71-4dd9-a619-04682b7b2c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:17.774535 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f6fba-e7a8-4b24-bf72-cf34fd820ebd service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:17.774683 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd529b6-1f71-4dd9-a619-04682b7b2c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:17.774795 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f6fba-e7a8-4b24-bf72-cf34fd820ebd service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:17.774953 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd529b6-1f71-4dd9-a619-04682b7b2c6f admin admin] PATH_INFO: `/v3/users/e5e88df703c64584b7cf2c2dcc37a7cb` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:17.775081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f6fba-e7a8-4b24-bf72-cf34fd820ebd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:17.776098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd529b6-1f71-4dd9-a619-04682b7b2c6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5e88df703c64584b7cf2c2dcc37a7cb)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:17.778197 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd529b6-1f71-4dd9-a619-04682b7b2c6f admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:17.784922 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f6fba-e7a8-4b24-bf72-cf34fd820ebd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:17.786365 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f6fba-e7a8-4b24-bf72-cf34fd820ebd service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:17.796697 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1289/2590] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:38:17.827465 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-6bd529b6-1f71-4dd9-a619-04682b7b2c6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5e88df703c64584b7cf2c2dcc37a7cb'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:17.828143 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-6bd529b6-1f71-4dd9-a619-04682b7b2c6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5e88df703c64584b7cf2c2dcc37a7cb'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:17.836175 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-6bd529b6-1f71-4dd9-a619-04682b7b2c6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5e88df703c64584b7cf2c2dcc37a7cb'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:17.845274 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-6bd529b6-1f71-4dd9-a619-04682b7b2c6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5e88df703c64584b7cf2c2dcc37a7cb'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:17.845979 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-6bd529b6-1f71-4dd9-a619-04682b7b2c6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5e88df703c64584b7cf2c2dcc37a7cb'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:17.864153 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1302/2591] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:38:17 2022] DELETE /identity/v3/users/e5e88df703c64584b7cf2c2dcc37a7cb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:17.868949 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd5ec8-4a06-4ed6-9d27-2f08c146f19b None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:17.869320 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd5ec8-4a06-4ed6-9d27-2f08c146f19b None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:17.869669 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd5ec8-4a06-4ed6-9d27-2f08c146f19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:17.889972 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-f3cd5ec8-4a06-4ed6-9d27-2f08c146f19b None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:17.891258 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f3cd5ec8-4a06-4ed6-9d27-2f08c146f19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:17.925136 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:17.953846 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1290/2592] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:38:17.963832 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd529b6-1f71-4dd9-a619-04682b7b2c6f admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:17.965339 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-6bd529b6-1f71-4dd9-a619-04682b7b2c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:18.038009 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd529b6-1f71-4dd9-a619-04682b7b2c6f admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:18.041972 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2ceac-7c3e-448b-809e-32104dc989d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:18.042590 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2ceac-7c3e-448b-809e-32104dc989d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:18.042867 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2ceac-7c3e-448b-809e-32104dc989d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:18.043490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2ceac-7c3e-448b-809e-32104dc989d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:18.054952 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2ceac-7c3e-448b-809e-32104dc989d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:18.056600 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2ceac-7c3e-448b-809e-32104dc989d3 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:18.069968 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1303/2593] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:38:18.359966 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd5ec8-4a06-4ed6-9d27-2f08c146f19b None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:18.361689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f3cd5ec8-4a06-4ed6-9d27-2f08c146f19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:18.386597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd5ec8-4a06-4ed6-9d27-2f08c146f19b None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:18.392021 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de45a8e-3f4a-4965-a5bf-a20ff2179d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:18.392689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de45a8e-3f4a-4965-a5bf-a20ff2179d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:18.392958 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de45a8e-3f4a-4965-a5bf-a20ff2179d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:18.393221 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de45a8e-3f4a-4965-a5bf-a20ff2179d26 admin admin] PATH_INFO: `/v3/projects/5cfc9ce59aa5480fb262c8b2ddab6634` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:18.394371 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de45a8e-3f4a-4965-a5bf-a20ff2179d26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cfc9ce59aa5480fb262c8b2ddab6634)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:18.396366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de45a8e-3f4a-4965-a5bf-a20ff2179d26 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:18.444477 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-0de45a8e-3f4a-4965-a5bf-a20ff2179d26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cfc9ce59aa5480fb262c8b2ddab6634', 'request_id': 'req-0de45a8e-3f4a-4965-a5bf-a20ff2179d26'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:18.452871 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-0de45a8e-3f4a-4965-a5bf-a20ff2179d26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cfc9ce59aa5480fb262c8b2ddab6634', 'request_id': 'req-0de45a8e-3f4a-4965-a5bf-a20ff2179d26'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:18.459774 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-0de45a8e-3f4a-4965-a5bf-a20ff2179d26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cfc9ce59aa5480fb262c8b2ddab6634', 'request_id': 'req-0de45a8e-3f4a-4965-a5bf-a20ff2179d26'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:18.470296 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-0de45a8e-3f4a-4965-a5bf-a20ff2179d26 admin admin] The token cache is being invalidate because project 5cfc9ce59aa5480fb262c8b2ddab6634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:38:18.470574 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-0de45a8e-3f4a-4965-a5bf-a20ff2179d26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:18.471238 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-0de45a8e-3f4a-4965-a5bf-a20ff2179d26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:18.472766 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1291/2594] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:38:18 2022] DELETE /identity/v3/projects/5cfc9ce59aa5480fb262c8b2ddab6634 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:18.476987 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2ceac-7c3e-448b-809e-32104dc989d3 service neutron] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:18.487034 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2ceac-7c3e-448b-809e-32104dc989d3 service neutron] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:18.495074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:18.548279 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041337c-4bb3-4008-815b-d6cc3cc9a967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:18.548951 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041337c-4bb3-4008-815b-d6cc3cc9a967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:18.549233 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041337c-4bb3-4008-815b-d6cc3cc9a967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:18.549508 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041337c-4bb3-4008-815b-d6cc3cc9a967 admin admin] PATH_INFO: `/v3/users/6265d1df9bfd47cfba891a0ab290986d` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:18.550647 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041337c-4bb3-4008-815b-d6cc3cc9a967 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6265d1df9bfd47cfba891a0ab290986d)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:18.552726 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041337c-4bb3-4008-815b-d6cc3cc9a967 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:18.601516 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-2041337c-4bb3-4008-815b-d6cc3cc9a967 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6265d1df9bfd47cfba891a0ab290986d'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:18.602103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-2041337c-4bb3-4008-815b-d6cc3cc9a967 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6265d1df9bfd47cfba891a0ab290986d'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:18.609253 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-2041337c-4bb3-4008-815b-d6cc3cc9a967 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6265d1df9bfd47cfba891a0ab290986d'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:18.617272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-2041337c-4bb3-4008-815b-d6cc3cc9a967 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6265d1df9bfd47cfba891a0ab290986d'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:18.617956 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-2041337c-4bb3-4008-815b-d6cc3cc9a967 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6265d1df9bfd47cfba891a0ab290986d'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:18.636185 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1304/2595] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:38:18 2022] DELETE /identity/v3/users/6265d1df9bfd47cfba891a0ab290986d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:18.916108 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de45a8e-3f4a-4965-a5bf-a20ff2179d26 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:18.917567 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-0de45a8e-3f4a-4965-a5bf-a20ff2179d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:18.932921 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de45a8e-3f4a-4965-a5bf-a20ff2179d26 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:18.992232 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8285c71-7e3e-41d8-a392-2cc48f6e060a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:18.992872 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8285c71-7e3e-41d8-a392-2cc48f6e060a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:18.993152 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8285c71-7e3e-41d8-a392-2cc48f6e060a admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:18.993424 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8285c71-7e3e-41d8-a392-2cc48f6e060a admin admin] PATH_INFO: `/v3/projects/c872400542134d84ad8f97329a0e4373` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:18.994635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8285c71-7e3e-41d8-a392-2cc48f6e060a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c872400542134d84ad8f97329a0e4373)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:18.996646 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8285c71-7e3e-41d8-a392-2cc48f6e060a admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:19.047535 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-d8285c71-7e3e-41d8-a392-2cc48f6e060a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c872400542134d84ad8f97329a0e4373', 'request_id': 'req-d8285c71-7e3e-41d8-a392-2cc48f6e060a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:19.055787 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-d8285c71-7e3e-41d8-a392-2cc48f6e060a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c872400542134d84ad8f97329a0e4373', 'request_id': 'req-d8285c71-7e3e-41d8-a392-2cc48f6e060a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:19.062160 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-d8285c71-7e3e-41d8-a392-2cc48f6e060a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c872400542134d84ad8f97329a0e4373', 'request_id': 'req-d8285c71-7e3e-41d8-a392-2cc48f6e060a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:19.064122 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:19.074262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-d8285c71-7e3e-41d8-a392-2cc48f6e060a admin admin] The token cache is being invalidate because project c872400542134d84ad8f97329a0e4373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:38:19.074546 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-d8285c71-7e3e-41d8-a392-2cc48f6e060a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:19.075210 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-d8285c71-7e3e-41d8-a392-2cc48f6e060a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:19.076781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1292/2596] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:38:18 2022] DELETE /identity/v3/projects/c872400542134d84ad8f97329a0e4373 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:19.081895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506ccb3-a485-4658-b176-2031c94f9fa7 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:19.082370 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506ccb3-a485-4658-b176-2031c94f9fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:19.082466 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506ccb3-a485-4658-b176-2031c94f9fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:19.104280 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-8506ccb3-a485-4658-b176-2031c94f9fa7 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:19.105565 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8506ccb3-a485-4658-b176-2031c94f9fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:19.169539 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1305/2597] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:19.178609 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44159ec3-aa31-4073-acfc-e8cf9d1a281e None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:19.179157 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44159ec3-aa31-4073-acfc-e8cf9d1a281e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:19.179430 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44159ec3-aa31-4073-acfc-e8cf9d1a281e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:19.200863 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-44159ec3-aa31-4073-acfc-e8cf9d1a281e None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:19.202187 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-44159ec3-aa31-4073-acfc-e8cf9d1a281e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:19.210293 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1293/2598] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:19.214668 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506ccb3-a485-4658-b176-2031c94f9fa7 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:19.224642 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506ccb3-a485-4658-b176-2031c94f9fa7 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:19.229353 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bdaa8-86b4-4ea6-8edd-178d8f862276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:19.229974 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bdaa8-86b4-4ea6-8edd-178d8f862276 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:19.230283 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bdaa8-86b4-4ea6-8edd-178d8f862276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:19.230678 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bdaa8-86b4-4ea6-8edd-178d8f862276 admin admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:19.231492 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bdaa8-86b4-4ea6-8edd-178d8f862276 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:38:19.231794 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bdaa8-86b4-4ea6-8edd-178d8f862276 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:19.233381 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bdaa8-86b4-4ea6-8edd-178d8f862276 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:19.245538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1306/2599] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:38:19.250205 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44159ec3-aa31-4073-acfc-e8cf9d1a281e None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:19.259596 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44159ec3-aa31-4073-acfc-e8cf9d1a281e None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:19.265070 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4b2d2-1b7b-490b-af94-ce69137b7104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:19.265673 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4b2d2-1b7b-490b-af94-ce69137b7104 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:19.265950 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4b2d2-1b7b-490b-af94-ce69137b7104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:19.266217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4b2d2-1b7b-490b-af94-ce69137b7104 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:19.266844 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4b2d2-1b7b-490b-af94-ce69137b7104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:19.268861 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4b2d2-1b7b-490b-af94-ce69137b7104 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:19.298711 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1294/2600] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:38:19 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:19.303216 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bdaa8-86b4-4ea6-8edd-178d8f862276 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:19.313976 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bdaa8-86b4-4ea6-8edd-178d8f862276 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:19.329945 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:19.380736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a507484-e505-4d4d-ac1d-cb23d2fcf599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:19.381393 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a507484-e505-4d4d-ac1d-cb23d2fcf599 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:19.381667 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a507484-e505-4d4d-ac1d-cb23d2fcf599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:19.385186 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a507484-e505-4d4d-ac1d-cb23d2fcf599 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:19.385186 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a507484-e505-4d4d-ac1d-cb23d2fcf599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:19.385580 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a507484-e505-4d4d-ac1d-cb23d2fcf599 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:19.408842 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1307/2601] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:38:19 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:19.413187 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4b2d2-1b7b-490b-af94-ce69137b7104 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:19.424299 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4b2d2-1b7b-490b-af94-ce69137b7104 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:19.431173 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3303145-8faf-4cc9-9bd7-985d6a02e811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:19.431173 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3303145-8faf-4cc9-9bd7-985d6a02e811 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:19.431173 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3303145-8faf-4cc9-9bd7-985d6a02e811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:19.431173 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3303145-8faf-4cc9-9bd7-985d6a02e811 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:19.431566 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3303145-8faf-4cc9-9bd7-985d6a02e811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:19.432839 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3303145-8faf-4cc9-9bd7-985d6a02e811 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:19.445082 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1295/2602] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:19.449048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a507484-e505-4d4d-ac1d-cb23d2fcf599 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:19.460055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a507484-e505-4d4d-ac1d-cb23d2fcf599 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:19.465451 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885b383-66ae-44c2-afd1-eacdd69cb819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:19.466244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885b383-66ae-44c2-afd1-eacdd69cb819 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:19.466666 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885b383-66ae-44c2-afd1-eacdd69cb819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:19.466947 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885b383-66ae-44c2-afd1-eacdd69cb819 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:19.467703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885b383-66ae-44c2-afd1-eacdd69cb819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:19.469356 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885b383-66ae-44c2-afd1-eacdd69cb819 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:19.482028 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1308/2603] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:38:19.486547 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3303145-8faf-4cc9-9bd7-985d6a02e811 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:19.497419 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3303145-8faf-4cc9-9bd7-985d6a02e811 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:19.502287 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d14f7-f801-4594-85da-34bed694b0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:19.503023 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d14f7-f801-4594-85da-34bed694b0c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:19.503256 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d14f7-f801-4594-85da-34bed694b0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:19.503524 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d14f7-f801-4594-85da-34bed694b0c1 admin admin] PATH_INFO: `/v3/projects/c686b334d8174ee7acf8d374aef9ab44/users/c665a5c97ec64e5fb34be62718e65913/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:19.519011 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d14f7-f801-4594-85da-34bed694b0c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c686b334d8174ee7acf8d374aef9ab44, user_id=c665a5c97ec64e5fb34be62718e65913, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:19.521758 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d14f7-f801-4594-85da-34bed694b0c1 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:19.536558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1296/2604] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:19 2022] PUT /identity/v3/projects/c686b334d8174ee7acf8d374aef9ab44/users/c665a5c97ec64e5fb34be62718e65913/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:38:19.547755 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef9207-92c9-4e20-823f-cf9e77d909e3 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:19.548143 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef9207-92c9-4e20-823f-cf9e77d909e3 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:19.548421 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef9207-92c9-4e20-823f-cf9e77d909e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:19.583584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-c1ef9207-92c9-4e20-823f-cf9e77d909e3 None None] MFA Rules not processed for user `c665a5c97ec64e5fb34be62718e65913`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:19.584943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-c1ef9207-92c9-4e20-823f-cf9e77d909e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:19.653839 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1309/2605] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:38:19.659000 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d14f7-f801-4594-85da-34bed694b0c1 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:19.723484 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d14f7-f801-4594-85da-34bed694b0c1 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:19.728301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450c83c-a326-4749-bac2-b00db33ae06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:19.728905 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450c83c-a326-4749-bac2-b00db33ae06f admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:19.729171 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450c83c-a326-4749-bac2-b00db33ae06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:19.729439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450c83c-a326-4749-bac2-b00db33ae06f admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:19.730077 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e450c83c-a326-4749-bac2-b00db33ae06f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:19.732092 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e450c83c-a326-4749-bac2-b00db33ae06f admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:19.762719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1297/2606] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:38:19 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:38:19.767560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef9207-92c9-4e20-823f-cf9e77d909e3 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:19.780401 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef9207-92c9-4e20-823f-cf9e77d909e3 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:19.842170 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20731287-be47-4537-a115-8a6d7a3bcaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:19.842784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20731287-be47-4537-a115-8a6d7a3bcaa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:19.843108 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20731287-be47-4537-a115-8a6d7a3bcaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:19.843379 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20731287-be47-4537-a115-8a6d7a3bcaa9 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:19.844004 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20731287-be47-4537-a115-8a6d7a3bcaa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:19.845923 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20731287-be47-4537-a115-8a6d7a3bcaa9 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:19.867507 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1310/2607] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:38:19 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:38:19.871732 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450c83c-a326-4749-bac2-b00db33ae06f admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:19.882304 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450c83c-a326-4749-bac2-b00db33ae06f admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:19.888029 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a0121-82f1-46d7-b280-6938e6766980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:19.888626 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a0121-82f1-46d7-b280-6938e6766980 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:19.888902 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a0121-82f1-46d7-b280-6938e6766980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:19.889170 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a0121-82f1-46d7-b280-6938e6766980 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:19.889807 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a0121-82f1-46d7-b280-6938e6766980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:19.891478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a0121-82f1-46d7-b280-6938e6766980 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:19.902200 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1298/2608] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:19.906587 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20731287-be47-4537-a115-8a6d7a3bcaa9 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:19.917070 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20731287-be47-4537-a115-8a6d7a3bcaa9 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:19.922458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ad786-0d9c-4760-9407-6c8de221877b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:19.923130 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ad786-0d9c-4760-9407-6c8de221877b admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:19.923417 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ad786-0d9c-4760-9407-6c8de221877b admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:19.923684 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ad786-0d9c-4760-9407-6c8de221877b admin admin] PATH_INFO: `/v3/projects/6d4845d1fcbf49f7bff006af1556b9d8/users/39cca99f0d404ef997c1608f32c0f5a3/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:19.937195 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:19.940596 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ad786-0d9c-4760-9407-6c8de221877b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d4845d1fcbf49f7bff006af1556b9d8, user_id=39cca99f0d404ef997c1608f32c0f5a3, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:19.943658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ad786-0d9c-4760-9407-6c8de221877b admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:19.957769 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1311/2609] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:19 2022] PUT /identity/v3/projects/6d4845d1fcbf49f7bff006af1556b9d8/users/39cca99f0d404ef997c1608f32c0f5a3/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:38:19.961778 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a0121-82f1-46d7-b280-6938e6766980 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:19.972247 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a0121-82f1-46d7-b280-6938e6766980 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:20.030316 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ad52d-4e66-4053-a4ed-14bfb372177d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:20.030929 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ad52d-4e66-4053-a4ed-14bfb372177d admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:20.031234 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ad52d-4e66-4053-a4ed-14bfb372177d admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:20.031501 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ad52d-4e66-4053-a4ed-14bfb372177d admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:20.032136 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ad52d-4e66-4053-a4ed-14bfb372177d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:20.033883 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ad52d-4e66-4053-a4ed-14bfb372177d admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:20.036193 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:20.045999 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1299/2610] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:20.050065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ad786-0d9c-4760-9407-6c8de221877b admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:20.063155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ad786-0d9c-4760-9407-6c8de221877b admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:20.068734 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b793fa-c7e3-4329-accd-798cd33f1e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:20.069422 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b793fa-c7e3-4329-accd-798cd33f1e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:20.069692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b793fa-c7e3-4329-accd-798cd33f1e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:20.069954 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b793fa-c7e3-4329-accd-798cd33f1e5a admin admin] PATH_INFO: `/v3/projects/6d4845d1fcbf49f7bff006af1556b9d8/users/39cca99f0d404ef997c1608f32c0f5a3/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:20.072130 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b793fa-c7e3-4329-accd-798cd33f1e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d4845d1fcbf49f7bff006af1556b9d8, user_id=39cca99f0d404ef997c1608f32c0f5a3, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:20.074890 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b793fa-c7e3-4329-accd-798cd33f1e5a admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:20.086752 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1312/2611] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:20 2022] PUT /identity/v3/projects/6d4845d1fcbf49f7bff006af1556b9d8/users/39cca99f0d404ef997c1608f32c0f5a3/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:38:20.097472 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a04e94-a8b6-40cc-ab80-be2f648728ec None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:20.097760 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a04e94-a8b6-40cc-ab80-be2f648728ec None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:20.098057 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a04e94-a8b6-40cc-ab80-be2f648728ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:20.127441 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-45a04e94-a8b6-40cc-ab80-be2f648728ec None None] MFA Rules not processed for user `39cca99f0d404ef997c1608f32c0f5a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:20.128666 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-45a04e94-a8b6-40cc-ab80-be2f648728ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:20.198105 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1300/2612] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:20 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:20.211007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b793fa-c7e3-4329-accd-798cd33f1e5a admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:20.212903 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-d4b793fa-c7e3-4329-accd-798cd33f1e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:20.273705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b793fa-c7e3-4329-accd-798cd33f1e5a admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:20.278371 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689a075-9018-4e92-8a25-38fef407e77e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:20.279384 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689a075-9018-4e92-8a25-38fef407e77e service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:20.279794 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689a075-9018-4e92-8a25-38fef407e77e service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:20.280072 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689a075-9018-4e92-8a25-38fef407e77e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:20.289945 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689a075-9018-4e92-8a25-38fef407e77e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:20.291434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689a075-9018-4e92-8a25-38fef407e77e service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:20.301558 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1313/2613] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:20 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:38:20.624491 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a04e94-a8b6-40cc-ab80-be2f648728ec None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:20.626100 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-45a04e94-a8b6-40cc-ab80-be2f648728ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:20.663902 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689a075-9018-4e92-8a25-38fef407e77e service cinder] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:20.674372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689a075-9018-4e92-8a25-38fef407e77e service cinder] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:20.679901 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92c50e-1a5f-4f04-8ec2-a7f39e218bdc tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cca99f0d404ef997c1608f32c0f5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d4845d1fcbf49f7bff006af1556b9d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:20.680523 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92c50e-1a5f-4f04-8ec2-a7f39e218bdc tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:20.680808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92c50e-1a5f-4f04-8ec2-a7f39e218bdc tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:20.681086 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92c50e-1a5f-4f04-8ec2-a7f39e218bdc tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:20.681736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92c50e-1a5f-4f04-8ec2-a7f39e218bdc tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:38:20.682041 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92c50e-1a5f-4f04-8ec2-a7f39e218bdc tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:20.683684 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92c50e-1a5f-4f04-8ec2-a7f39e218bdc tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:20.696433 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1314/2614] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:38:20.700811 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92c50e-1a5f-4f04-8ec2-a7f39e218bdc tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:20.706435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a04e94-a8b6-40cc-ab80-be2f648728ec None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:20.711127 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92c50e-1a5f-4f04-8ec2-a7f39e218bdc tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:20.712183 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc183677-b3cb-4641-b986-20e778f15c66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:20.712802 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc183677-b3cb-4641-b986-20e778f15c66 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:20.713080 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc183677-b3cb-4641-b986-20e778f15c66 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:20.713351 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc183677-b3cb-4641-b986-20e778f15c66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:20.715172 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-dc183677-b3cb-4641-b986-20e778f15c66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:20.715864 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d731fd9-df67-421f-9a8f-7e080b69a955 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cca99f0d404ef997c1608f32c0f5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d4845d1fcbf49f7bff006af1556b9d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:20.716517 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d731fd9-df67-421f-9a8f-7e080b69a955 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:20.716798 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d731fd9-df67-421f-9a8f-7e080b69a955 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:20.717075 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d731fd9-df67-421f-9a8f-7e080b69a955 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:20.717735 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d731fd9-df67-421f-9a8f-7e080b69a955 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:20.719868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d731fd9-df67-421f-9a8f-7e080b69a955 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:20.748252 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1315/2615] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:38:20 2022] POST /identity/v3/projects => generated 354 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:20.752294 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d731fd9-df67-421f-9a8f-7e080b69a955 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:20.785237 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc183677-b3cb-4641-b986-20e778f15c66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:20.786947 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc183677-b3cb-4641-b986-20e778f15c66 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:20.796751 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1301/2616] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:20 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:38:20.821215 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d731fd9-df67-421f-9a8f-7e080b69a955 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:20.826034 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53dd6a-8adc-45a0-83e8-f99166cf1be8 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cca99f0d404ef997c1608f32c0f5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d4845d1fcbf49f7bff006af1556b9d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:20.826661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53dd6a-8adc-45a0-83e8-f99166cf1be8 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:20.826945 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53dd6a-8adc-45a0-83e8-f99166cf1be8 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:20.827296 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53dd6a-8adc-45a0-83e8-f99166cf1be8 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:20.827949 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53dd6a-8adc-45a0-83e8-f99166cf1be8 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:38:20.828515 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53dd6a-8adc-45a0-83e8-f99166cf1be8 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:20.829819 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53dd6a-8adc-45a0-83e8-f99166cf1be8 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:20.845948 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1316/2617] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:38:20.883412 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc183677-b3cb-4641-b986-20e778f15c66 service nova] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:20.894403 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc183677-b3cb-4641-b986-20e778f15c66 service nova] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:20.898961 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce654b-41eb-46fd-8c3b-bd660d81a029 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cca99f0d404ef997c1608f32c0f5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d4845d1fcbf49f7bff006af1556b9d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:20.899692 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce654b-41eb-46fd-8c3b-bd660d81a029 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:20.900051 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce654b-41eb-46fd-8c3b-bd660d81a029 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:20.900382 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce654b-41eb-46fd-8c3b-bd660d81a029 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] PATH_INFO: `/v3/projects/960a99a8d83747edaff13c2960c8a4f8` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:20.901578 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce654b-41eb-46fd-8c3b-bd660d81a029 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] RBAC: Authorizing `identity:delete_project(project_id=960a99a8d83747edaff13c2960c8a4f8)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:20.903600 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce654b-41eb-46fd-8c3b-bd660d81a029 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:20.920267 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:20.954765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-0cce654b-41eb-46fd-8c3b-bd660d81a029 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '960a99a8d83747edaff13c2960c8a4f8', 'request_id': 'req-0cce654b-41eb-46fd-8c3b-bd660d81a029'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:20.964140 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-0cce654b-41eb-46fd-8c3b-bd660d81a029 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '960a99a8d83747edaff13c2960c8a4f8', 'request_id': 'req-0cce654b-41eb-46fd-8c3b-bd660d81a029'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:20.973060 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-0cce654b-41eb-46fd-8c3b-bd660d81a029 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '960a99a8d83747edaff13c2960c8a4f8', 'request_id': 'req-0cce654b-41eb-46fd-8c3b-bd660d81a029'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:20.983799 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-0cce654b-41eb-46fd-8c3b-bd660d81a029 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] The token cache is being invalidate because project 960a99a8d83747edaff13c2960c8a4f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:38:20.984082 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-0cce654b-41eb-46fd-8c3b-bd660d81a029 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:20.984772 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-0cce654b-41eb-46fd-8c3b-bd660d81a029 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:20.986305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1302/2618] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:38:20 2022] DELETE /identity/v3/projects/960a99a8d83747edaff13c2960c8a4f8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:21.190267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53dd6a-8adc-45a0-83e8-f99166cf1be8 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:21.192272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-2d53dd6a-8adc-45a0-83e8-f99166cf1be8 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:21.237493 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:21.261123 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53dd6a-8adc-45a0-83e8-f99166cf1be8 tempest-VolumeQuotaClassesTest-1580406029 tempest-VolumeQuotaClassesTest-1580406029-project-admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:21.320559 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016936f5-f02f-4f84-b6cd-4665ca03b32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:21.321219 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016936f5-f02f-4f84-b6cd-4665ca03b32f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:21.321613 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016936f5-f02f-4f84-b6cd-4665ca03b32f admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:21.321897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016936f5-f02f-4f84-b6cd-4665ca03b32f admin admin] PATH_INFO: `/v3/users/c665a5c97ec64e5fb34be62718e65913` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:21.323131 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016936f5-f02f-4f84-b6cd-4665ca03b32f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c665a5c97ec64e5fb34be62718e65913)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:21.325104 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016936f5-f02f-4f84-b6cd-4665ca03b32f admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:21.379423 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-016936f5-f02f-4f84-b6cd-4665ca03b32f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c665a5c97ec64e5fb34be62718e65913'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:21.380111 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-016936f5-f02f-4f84-b6cd-4665ca03b32f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c665a5c97ec64e5fb34be62718e65913'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:21.388567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-016936f5-f02f-4f84-b6cd-4665ca03b32f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c665a5c97ec64e5fb34be62718e65913'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:21.397349 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-016936f5-f02f-4f84-b6cd-4665ca03b32f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c665a5c97ec64e5fb34be62718e65913'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:21.397949 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-016936f5-f02f-4f84-b6cd-4665ca03b32f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c665a5c97ec64e5fb34be62718e65913'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:21.415822 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1317/2619] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:38:21 2022] DELETE /identity/v3/users/c665a5c97ec64e5fb34be62718e65913 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:21.420305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804f589-7a46-4c98-aeb8-d506b955053c None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:21.420653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804f589-7a46-4c98-aeb8-d506b955053c None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:21.420899 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804f589-7a46-4c98-aeb8-d506b955053c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:21.442147 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-b804f589-7a46-4c98-aeb8-d506b955053c None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:21.443425 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-b804f589-7a46-4c98-aeb8-d506b955053c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:21.506594 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1303/2620] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:21.516933 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016936f5-f02f-4f84-b6cd-4665ca03b32f admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:21.518347 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-016936f5-f02f-4f84-b6cd-4665ca03b32f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:21.578294 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016936f5-f02f-4f84-b6cd-4665ca03b32f admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:21.582520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2bc74-52de-4cfb-8954-3dfeb4cf2c1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:21.583205 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2bc74-52de-4cfb-8954-3dfeb4cf2c1d service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:21.583486 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2bc74-52de-4cfb-8954-3dfeb4cf2c1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:21.583762 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2bc74-52de-4cfb-8954-3dfeb4cf2c1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:21.593877 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2bc74-52de-4cfb-8954-3dfeb4cf2c1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:21.595806 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2bc74-52de-4cfb-8954-3dfeb4cf2c1d service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:21.610867 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1318/2621] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:38:21.892354 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804f589-7a46-4c98-aeb8-d506b955053c None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:21.893894 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-b804f589-7a46-4c98-aeb8-d506b955053c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:21.906526 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804f589-7a46-4c98-aeb8-d506b955053c None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:21.911865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d7b1d-b137-440c-8a3e-6298fe6a6470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:21.912492 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d7b1d-b137-440c-8a3e-6298fe6a6470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:21.912791 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d7b1d-b137-440c-8a3e-6298fe6a6470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:21.913086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d7b1d-b137-440c-8a3e-6298fe6a6470 admin admin] PATH_INFO: `/v3/projects/c686b334d8174ee7acf8d374aef9ab44` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:21.914348 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d7b1d-b137-440c-8a3e-6298fe6a6470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c686b334d8174ee7acf8d374aef9ab44)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:21.917194 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d7b1d-b137-440c-8a3e-6298fe6a6470 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:21.967646 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-3a8d7b1d-b137-440c-8a3e-6298fe6a6470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c686b334d8174ee7acf8d374aef9ab44', 'request_id': 'req-3a8d7b1d-b137-440c-8a3e-6298fe6a6470'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:21.976483 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-3a8d7b1d-b137-440c-8a3e-6298fe6a6470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c686b334d8174ee7acf8d374aef9ab44', 'request_id': 'req-3a8d7b1d-b137-440c-8a3e-6298fe6a6470'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:21.983379 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-3a8d7b1d-b137-440c-8a3e-6298fe6a6470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c686b334d8174ee7acf8d374aef9ab44', 'request_id': 'req-3a8d7b1d-b137-440c-8a3e-6298fe6a6470'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:21.995107 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-3a8d7b1d-b137-440c-8a3e-6298fe6a6470 admin admin] The token cache is being invalidate because project c686b334d8174ee7acf8d374aef9ab44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:38:21.995405 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-3a8d7b1d-b137-440c-8a3e-6298fe6a6470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:21.996180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-3a8d7b1d-b137-440c-8a3e-6298fe6a6470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:21.997867 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1304/2622] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:38:21 2022] DELETE /identity/v3/projects/c686b334d8174ee7acf8d374aef9ab44 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:22.002017 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2bc74-52de-4cfb-8954-3dfeb4cf2c1d service neutron] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:22.012570 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2bc74-52de-4cfb-8954-3dfeb4cf2c1d service neutron] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:22.024416 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:22.084292 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b6eae-7e3d-4e72-95ae-00236fb022a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:22.085440 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b6eae-7e3d-4e72-95ae-00236fb022a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:22.085440 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b6eae-7e3d-4e72-95ae-00236fb022a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:22.085766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b6eae-7e3d-4e72-95ae-00236fb022a9 admin admin] PATH_INFO: `/v3/users/39cca99f0d404ef997c1608f32c0f5a3` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:22.087325 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b6eae-7e3d-4e72-95ae-00236fb022a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39cca99f0d404ef997c1608f32c0f5a3)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:22.089394 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b6eae-7e3d-4e72-95ae-00236fb022a9 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:22.156789 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f09b6eae-7e3d-4e72-95ae-00236fb022a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39cca99f0d404ef997c1608f32c0f5a3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:22.157632 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f09b6eae-7e3d-4e72-95ae-00236fb022a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39cca99f0d404ef997c1608f32c0f5a3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:22.173801 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f09b6eae-7e3d-4e72-95ae-00236fb022a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39cca99f0d404ef997c1608f32c0f5a3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:22.187478 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f09b6eae-7e3d-4e72-95ae-00236fb022a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39cca99f0d404ef997c1608f32c0f5a3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:22.188186 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-f09b6eae-7e3d-4e72-95ae-00236fb022a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39cca99f0d404ef997c1608f32c0f5a3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:22.206238 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1319/2623] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:38:22 2022] DELETE /identity/v3/users/39cca99f0d404ef997c1608f32c0f5a3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:22.494050 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d7b1d-b137-440c-8a3e-6298fe6a6470 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:22.495632 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-3a8d7b1d-b137-440c-8a3e-6298fe6a6470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:22.508889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d7b1d-b137-440c-8a3e-6298fe6a6470 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:22.535622 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:22.570718 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9cc70-7db0-4d9f-9231-fe465891b6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:22.571390 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9cc70-7db0-4d9f-9231-fe465891b6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:22.571668 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9cc70-7db0-4d9f-9231-fe465891b6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:22.571942 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9cc70-7db0-4d9f-9231-fe465891b6bf admin admin] PATH_INFO: `/v3/projects/6d4845d1fcbf49f7bff006af1556b9d8` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:22.573084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9cc70-7db0-4d9f-9231-fe465891b6bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d4845d1fcbf49f7bff006af1556b9d8)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:22.575004 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9cc70-7db0-4d9f-9231-fe465891b6bf admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:22.623548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-32f9cc70-7db0-4d9f-9231-fe465891b6bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d4845d1fcbf49f7bff006af1556b9d8', 'request_id': 'req-32f9cc70-7db0-4d9f-9231-fe465891b6bf'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:22.633263 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-32f9cc70-7db0-4d9f-9231-fe465891b6bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d4845d1fcbf49f7bff006af1556b9d8', 'request_id': 'req-32f9cc70-7db0-4d9f-9231-fe465891b6bf'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:22.640469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-32f9cc70-7db0-4d9f-9231-fe465891b6bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d4845d1fcbf49f7bff006af1556b9d8', 'request_id': 'req-32f9cc70-7db0-4d9f-9231-fe465891b6bf'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:22.651472 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-32f9cc70-7db0-4d9f-9231-fe465891b6bf admin admin] The token cache is being invalidate because project 6d4845d1fcbf49f7bff006af1556b9d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:38:22.651757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-32f9cc70-7db0-4d9f-9231-fe465891b6bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:22.652446 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-32f9cc70-7db0-4d9f-9231-fe465891b6bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:22.654062 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1305/2624] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:38:22 2022] DELETE /identity/v3/projects/6d4845d1fcbf49f7bff006af1556b9d8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:22.660170 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb5854-7787-4e12-a238-78fb5b8ebe24 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:22.660457 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb5854-7787-4e12-a238-78fb5b8ebe24 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:22.660734 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb5854-7787-4e12-a238-78fb5b8ebe24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:22.681062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-07eb5854-7787-4e12-a238-78fb5b8ebe24 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:22.682272 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-07eb5854-7787-4e12-a238-78fb5b8ebe24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:22.743425 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1320/2625] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:22.750034 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9cc70-7db0-4d9f-9231-fe465891b6bf admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:22.751588 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-32f9cc70-7db0-4d9f-9231-fe465891b6bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:22.752324 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85837756-6657-4b29-b57e-1aba3f55e96e None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:22.752626 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85837756-6657-4b29-b57e-1aba3f55e96e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:22.752899 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85837756-6657-4b29-b57e-1aba3f55e96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:22.764992 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9cc70-7db0-4d9f-9231-fe465891b6bf admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:22.769758 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a85115-9fea-4c15-859b-6b79b2e34cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:22.770392 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a85115-9fea-4c15-859b-6b79b2e34cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:22.770664 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a85115-9fea-4c15-859b-6b79b2e34cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:22.770933 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a85115-9fea-4c15-859b-6b79b2e34cab admin admin] PATH_INFO: `/v3/users/09c59665212e44d0b7b68a35f680b5c2` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:22.772233 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a85115-9fea-4c15-859b-6b79b2e34cab admin admin] RBAC: Authorizing `identity:delete_user(user_id=09c59665212e44d0b7b68a35f680b5c2)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:22.774156 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a85115-9fea-4c15-859b-6b79b2e34cab admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:22.774296 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-85837756-6657-4b29-b57e-1aba3f55e96e None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:22.775390 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-85837756-6657-4b29-b57e-1aba3f55e96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:22.785434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1321/2626] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:22.789484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85837756-6657-4b29-b57e-1aba3f55e96e None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:22.798799 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85837756-6657-4b29-b57e-1aba3f55e96e None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:22.804620 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac4cef-60c5-479f-82ef-4acb5206f394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:22.805303 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac4cef-60c5-479f-82ef-4acb5206f394 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:22.805668 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac4cef-60c5-479f-82ef-4acb5206f394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:22.805939 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac4cef-60c5-479f-82ef-4acb5206f394 admin admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:22.806668 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac4cef-60c5-479f-82ef-4acb5206f394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:38:22.806967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac4cef-60c5-479f-82ef-4acb5206f394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:22.808878 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac4cef-60c5-479f-82ef-4acb5206f394 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:22.825586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1322/2627] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:38:22.825759 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-93a85115-9fea-4c15-859b-6b79b2e34cab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09c59665212e44d0b7b68a35f680b5c2'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:22.826028 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-93a85115-9fea-4c15-859b-6b79b2e34cab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09c59665212e44d0b7b68a35f680b5c2'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:22.826473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac4cef-60c5-479f-82ef-4acb5206f394 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:22.833986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-93a85115-9fea-4c15-859b-6b79b2e34cab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09c59665212e44d0b7b68a35f680b5c2'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:22.834788 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-93a85115-9fea-4c15-859b-6b79b2e34cab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09c59665212e44d0b7b68a35f680b5c2'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:22.836752 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac4cef-60c5-479f-82ef-4acb5206f394 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:22.842805 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041db01-1edc-42c3-9ccd-9d4a8f979d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:22.843449 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041db01-1edc-42c3-9ccd-9d4a8f979d0b admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:22.843770 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041db01-1edc-42c3-9ccd-9d4a8f979d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:22.844093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041db01-1edc-42c3-9ccd-9d4a8f979d0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:22.844196 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-93a85115-9fea-4c15-859b-6b79b2e34cab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09c59665212e44d0b7b68a35f680b5c2'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:22.844792 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041db01-1edc-42c3-9ccd-9d4a8f979d0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:22.846708 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041db01-1edc-42c3-9ccd-9d4a8f979d0b admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:22.852179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:22.864748 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1306/2628] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:38:22 2022] DELETE /identity/v3/users/09c59665212e44d0b7b68a35f680b5c2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:22.869408 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1e25e-b0ed-4fc7-83b1-f61d33ea36dc None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:22.869693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1e25e-b0ed-4fc7-83b1-f61d33ea36dc None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:22.870034 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1e25e-b0ed-4fc7-83b1-f61d33ea36dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:22.880745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1323/2629] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:38:22 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:38:22.884840 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041db01-1edc-42c3-9ccd-9d4a8f979d0b admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:22.886611 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-9041db01-1edc-42c3-9ccd-9d4a8f979d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:22.891252 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-f9a1e25e-b0ed-4fc7-83b1-f61d33ea36dc None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:22.892429 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f9a1e25e-b0ed-4fc7-83b1-f61d33ea36dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:22.916217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:22.951861 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041db01-1edc-42c3-9ccd-9d4a8f979d0b admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:22.953543 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1307/2630] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:38:22.956961 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707648c6-5e93-4c60-a540-50a5cf0dca50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:22.957727 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707648c6-5e93-4c60-a540-50a5cf0dca50 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:22.957826 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707648c6-5e93-4c60-a540-50a5cf0dca50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:22.958143 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707648c6-5e93-4c60-a540-50a5cf0dca50 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:22.958779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707648c6-5e93-4c60-a540-50a5cf0dca50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:22.960771 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707648c6-5e93-4c60-a540-50a5cf0dca50 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:22.963436 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1e25e-b0ed-4fc7-83b1-f61d33ea36dc None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:22.964894 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f9a1e25e-b0ed-4fc7-83b1-f61d33ea36dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:22.988308 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1324/2631] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:38:22 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:22.989336 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707648c6-5e93-4c60-a540-50a5cf0dca50 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:23.000282 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707648c6-5e93-4c60-a540-50a5cf0dca50 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:23.005123 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7db9c-16d8-44e0-b94f-767376283ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:23.005720 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7db9c-16d8-44e0-b94f-767376283ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:23.005999 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7db9c-16d8-44e0-b94f-767376283ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:23.006271 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7db9c-16d8-44e0-b94f-767376283ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:23.006947 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7db9c-16d8-44e0-b94f-767376283ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:23.008576 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7db9c-16d8-44e0-b94f-767376283ad9 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:23.020378 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1325/2632] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:23.025580 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7db9c-16d8-44e0-b94f-767376283ad9 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:23.027339 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1e25e-b0ed-4fc7-83b1-f61d33ea36dc None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:23.031010 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1342e-2573-4d47-8497-ecf9728cf8eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:23.031711 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1342e-2573-4d47-8497-ecf9728cf8eb service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:23.031992 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1342e-2573-4d47-8497-ecf9728cf8eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:23.032887 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1342e-2573-4d47-8497-ecf9728cf8eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:23.037344 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7db9c-16d8-44e0-b94f-767376283ad9 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:23.042335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1342e-2573-4d47-8497-ecf9728cf8eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:23.042484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcb0b3-2a16-41fd-91d4-c9921967a8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:23.043528 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcb0b3-2a16-41fd-91d4-c9921967a8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:23.043830 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcb0b3-2a16-41fd-91d4-c9921967a8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:23.043941 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1342e-2573-4d47-8497-ecf9728cf8eb service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:23.044166 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcb0b3-2a16-41fd-91d4-c9921967a8b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:23.044841 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bcb0b3-2a16-41fd-91d4-c9921967a8b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:23.046480 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bcb0b3-2a16-41fd-91d4-c9921967a8b0 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:23.053821 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1308/2633] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:38:23.058662 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1326/2634] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:23.062791 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1342e-2573-4d47-8497-ecf9728cf8eb service neutron] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:23.072578 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1342e-2573-4d47-8497-ecf9728cf8eb service neutron] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:23.078622 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5492b8-353c-4c8b-9556-ba2512968bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:23.079366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5492b8-353c-4c8b-9556-ba2512968bc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:23.079763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5492b8-353c-4c8b-9556-ba2512968bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:23.080039 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5492b8-353c-4c8b-9556-ba2512968bc0 admin admin] PATH_INFO: `/v3/projects/2d0fb618d1cc4b8ba9222e8b0a2f24f2/users/ff0d5c2aac1a48ceaa7baa4fb0c6c0bd/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:23.095691 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5492b8-353c-4c8b-9556-ba2512968bc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d0fb618d1cc4b8ba9222e8b0a2f24f2, user_id=ff0d5c2aac1a48ceaa7baa4fb0c6c0bd, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:23.098408 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5492b8-353c-4c8b-9556-ba2512968bc0 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:23.112143 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1309/2635] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:23 2022] PUT /identity/v3/projects/2d0fb618d1cc4b8ba9222e8b0a2f24f2/users/ff0d5c2aac1a48ceaa7baa4fb0c6c0bd/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:23.123149 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858901b-e8f6-4264-b16b-ec246656e54b None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:23.123434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858901b-e8f6-4264-b16b-ec246656e54b None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:23.123707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858901b-e8f6-4264-b16b-ec246656e54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:23.157888 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-6858901b-e8f6-4264-b16b-ec246656e54b None None] MFA Rules not processed for user `ff0d5c2aac1a48ceaa7baa4fb0c6c0bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:23.159178 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-6858901b-e8f6-4264-b16b-ec246656e54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:23.362206 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1327/2636] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:23.373816 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5492b8-353c-4c8b-9556-ba2512968bc0 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:23.375595 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-bb5492b8-353c-4c8b-9556-ba2512968bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:23.451709 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5492b8-353c-4c8b-9556-ba2512968bc0 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:23.452962 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858901b-e8f6-4264-b16b-ec246656e54b None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:23.454540 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-6858901b-e8f6-4264-b16b-ec246656e54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:23.455695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18f2a0-7a13-475b-8ca0-7f7c83ff49ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:23.456409 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18f2a0-7a13-475b-8ca0-7f7c83ff49ae service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:23.456686 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18f2a0-7a13-475b-8ca0-7f7c83ff49ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:23.456955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18f2a0-7a13-475b-8ca0-7f7c83ff49ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:23.465867 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18f2a0-7a13-475b-8ca0-7f7c83ff49ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:23.467451 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18f2a0-7a13-475b-8ca0-7f7c83ff49ae service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:23.476914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1310/2637] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:38:23.511040 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:23.531520 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858901b-e8f6-4264-b16b-ec246656e54b None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:23.536177 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2b237-90be-4e92-abe1-7130ef39481d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:23.536964 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2b237-90be-4e92-abe1-7130ef39481d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:23.537101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2b237-90be-4e92-abe1-7130ef39481d admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:23.537321 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2b237-90be-4e92-abe1-7130ef39481d admin admin] PATH_INFO: `/v3/projects/8aab6a558d3e449da4729059de8d6a7e` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:23.538469 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2b237-90be-4e92-abe1-7130ef39481d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aab6a558d3e449da4729059de8d6a7e)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:23.540385 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2b237-90be-4e92-abe1-7130ef39481d admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:23.592886 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-21b2b237-90be-4e92-abe1-7130ef39481d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aab6a558d3e449da4729059de8d6a7e', 'request_id': 'req-21b2b237-90be-4e92-abe1-7130ef39481d'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:23.601249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-21b2b237-90be-4e92-abe1-7130ef39481d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aab6a558d3e449da4729059de8d6a7e', 'request_id': 'req-21b2b237-90be-4e92-abe1-7130ef39481d'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:23.609314 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-21b2b237-90be-4e92-abe1-7130ef39481d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aab6a558d3e449da4729059de8d6a7e', 'request_id': 'req-21b2b237-90be-4e92-abe1-7130ef39481d'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:23.620125 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-21b2b237-90be-4e92-abe1-7130ef39481d admin admin] The token cache is being invalidate because project 8aab6a558d3e449da4729059de8d6a7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:38:23.620413 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-21b2b237-90be-4e92-abe1-7130ef39481d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:23.621068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-21b2b237-90be-4e92-abe1-7130ef39481d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:23.622900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1328/2638] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:38:23 2022] DELETE /identity/v3/projects/8aab6a558d3e449da4729059de8d6a7e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:38:23.627305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18f2a0-7a13-475b-8ca0-7f7c83ff49ae service cinder] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:23.640251 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18f2a0-7a13-475b-8ca0-7f7c83ff49ae service cinder] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:23.689122 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:23.699621 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c832f-376e-4f7c-82d7-182e02ad8da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:23.700368 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c832f-376e-4f7c-82d7-182e02ad8da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:23.700645 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c832f-376e-4f7c-82d7-182e02ad8da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:23.701063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c832f-376e-4f7c-82d7-182e02ad8da1 admin admin] PATH_INFO: `/v3/users/db62678415364630ad9733c283dfc39d` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:23.702239 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c832f-376e-4f7c-82d7-182e02ad8da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db62678415364630ad9733c283dfc39d)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:23.704404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c832f-376e-4f7c-82d7-182e02ad8da1 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:23.760062 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-722c832f-376e-4f7c-82d7-182e02ad8da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db62678415364630ad9733c283dfc39d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:23.760795 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-722c832f-376e-4f7c-82d7-182e02ad8da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db62678415364630ad9733c283dfc39d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:23.773691 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-722c832f-376e-4f7c-82d7-182e02ad8da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db62678415364630ad9733c283dfc39d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:23.774511 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-722c832f-376e-4f7c-82d7-182e02ad8da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db62678415364630ad9733c283dfc39d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:23.790301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-722c832f-376e-4f7c-82d7-182e02ad8da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db62678415364630ad9733c283dfc39d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:23.808661 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1311/2639] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:38:23 2022] DELETE /identity/v3/users/db62678415364630ad9733c283dfc39d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:24.105477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2b237-90be-4e92-abe1-7130ef39481d admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:24.107099 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-21b2b237-90be-4e92-abe1-7130ef39481d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:24.123730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2b237-90be-4e92-abe1-7130ef39481d admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:24.188996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f53b15-d123-48bf-8df7-5c7385c0e325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:24.189549 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f53b15-d123-48bf-8df7-5c7385c0e325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:24.189825 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f53b15-d123-48bf-8df7-5c7385c0e325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:24.190095 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f53b15-d123-48bf-8df7-5c7385c0e325 admin admin] PATH_INFO: `/v3/projects/f429fe329ba2457cafff0d31fd1f53c4` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:24.191257 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f53b15-d123-48bf-8df7-5c7385c0e325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f429fe329ba2457cafff0d31fd1f53c4)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:24.193163 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f53b15-d123-48bf-8df7-5c7385c0e325 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:24.241478 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-21f53b15-d123-48bf-8df7-5c7385c0e325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f429fe329ba2457cafff0d31fd1f53c4', 'request_id': 'req-21f53b15-d123-48bf-8df7-5c7385c0e325'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:24.249026 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-21f53b15-d123-48bf-8df7-5c7385c0e325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f429fe329ba2457cafff0d31fd1f53c4', 'request_id': 'req-21f53b15-d123-48bf-8df7-5c7385c0e325'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:24.255472 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-21f53b15-d123-48bf-8df7-5c7385c0e325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f429fe329ba2457cafff0d31fd1f53c4', 'request_id': 'req-21f53b15-d123-48bf-8df7-5c7385c0e325'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:24.267495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-21f53b15-d123-48bf-8df7-5c7385c0e325 admin admin] The token cache is being invalidate because project f429fe329ba2457cafff0d31fd1f53c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:38:24.267803 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-21f53b15-d123-48bf-8df7-5c7385c0e325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:24.268722 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-21f53b15-d123-48bf-8df7-5c7385c0e325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:24.270340 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1329/2640] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:38:24 2022] DELETE /identity/v3/projects/f429fe329ba2457cafff0d31fd1f53c4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:24.277135 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96857c78-88a7-4341-ab65-fa688bc81b96 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:24.278316 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96857c78-88a7-4341-ab65-fa688bc81b96 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:24.278316 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96857c78-88a7-4341-ab65-fa688bc81b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:24.299121 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-96857c78-88a7-4341-ab65-fa688bc81b96 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:24.300309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-96857c78-88a7-4341-ab65-fa688bc81b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:24.366381 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1312/2641] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:24.376290 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673442e-9abd-4421-9ef9-d370e62e2688 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:24.376839 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673442e-9abd-4421-9ef9-d370e62e2688 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:24.376839 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673442e-9abd-4421-9ef9-d370e62e2688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:24.386478 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:24.399744 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-a673442e-9abd-4421-9ef9-d370e62e2688 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:24.401863 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-a673442e-9abd-4421-9ef9-d370e62e2688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:24.412860 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1330/2642] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:24.418312 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96857c78-88a7-4341-ab65-fa688bc81b96 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:24.428678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96857c78-88a7-4341-ab65-fa688bc81b96 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:24.433978 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0b30a-3818-4888-ac59-fa751a651161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:24.434590 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0b30a-3818-4888-ac59-fa751a651161 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:24.434952 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0b30a-3818-4888-ac59-fa751a651161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:24.435247 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0b30a-3818-4888-ac59-fa751a651161 admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:24.435910 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0b30a-3818-4888-ac59-fa751a651161 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:38:24.436202 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0b30a-3818-4888-ac59-fa751a651161 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:24.437807 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0b30a-3818-4888-ac59-fa751a651161 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:24.449793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1313/2643] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:38:24.455019 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673442e-9abd-4421-9ef9-d370e62e2688 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:24.463765 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673442e-9abd-4421-9ef9-d370e62e2688 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:24.468962 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e154a2c-d16d-4162-abfa-8f89382fe787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:24.469626 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e154a2c-d16d-4162-abfa-8f89382fe787 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:24.469907 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e154a2c-d16d-4162-abfa-8f89382fe787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:24.470169 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e154a2c-d16d-4162-abfa-8f89382fe787 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:24.470789 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e154a2c-d16d-4162-abfa-8f89382fe787 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:24.472875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e154a2c-d16d-4162-abfa-8f89382fe787 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:24.502053 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1331/2644] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:38:24 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:24.506435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0b30a-3818-4888-ac59-fa751a651161 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:24.517515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0b30a-3818-4888-ac59-fa751a651161 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:24.571467 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:24.582878 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c749764-3a93-4e34-b547-c33005ff5f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:24.583497 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c749764-3a93-4e34-b547-c33005ff5f2f admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:24.583779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c749764-3a93-4e34-b547-c33005ff5f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:24.584050 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c749764-3a93-4e34-b547-c33005ff5f2f admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:24.584689 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c749764-3a93-4e34-b547-c33005ff5f2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:24.586702 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c749764-3a93-4e34-b547-c33005ff5f2f admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:24.610170 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1314/2645] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:38:24 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:24.614623 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e154a2c-d16d-4162-abfa-8f89382fe787 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:24.625824 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e154a2c-d16d-4162-abfa-8f89382fe787 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:24.630341 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1a8bc-4c78-43e6-b4bf-0fed2a90cf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:24.630949 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1a8bc-4c78-43e6-b4bf-0fed2a90cf53 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:24.631258 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1a8bc-4c78-43e6-b4bf-0fed2a90cf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:24.631524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1a8bc-4c78-43e6-b4bf-0fed2a90cf53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:24.632166 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1a8bc-4c78-43e6-b4bf-0fed2a90cf53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:24.633729 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1a8bc-4c78-43e6-b4bf-0fed2a90cf53 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:24.644542 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1332/2646] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:24.649185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c749764-3a93-4e34-b547-c33005ff5f2f admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:24.659953 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c749764-3a93-4e34-b547-c33005ff5f2f admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:24.665111 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023c358-e5af-457c-8d92-72e07240e446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:24.665752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023c358-e5af-457c-8d92-72e07240e446 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:24.666032 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023c358-e5af-457c-8d92-72e07240e446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:24.666303 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023c358-e5af-457c-8d92-72e07240e446 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:24.666946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023c358-e5af-457c-8d92-72e07240e446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:24.668631 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023c358-e5af-457c-8d92-72e07240e446 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:24.679526 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1315/2647] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:38:24.683799 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1a8bc-4c78-43e6-b4bf-0fed2a90cf53 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:24.693685 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1a8bc-4c78-43e6-b4bf-0fed2a90cf53 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:24.698301 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6314ca-a160-4ce0-b3e4-3122c97e68fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:24.698959 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6314ca-a160-4ce0-b3e4-3122c97e68fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:24.699250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6314ca-a160-4ce0-b3e4-3122c97e68fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:24.699522 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6314ca-a160-4ce0-b3e4-3122c97e68fb admin admin] PATH_INFO: `/v3/projects/16c61ba5ead54c5c9bbdf1446a1c794d/users/df871f8cc92f4a8b95b39f2ebaffd74a/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:24.716726 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6314ca-a160-4ce0-b3e4-3122c97e68fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=16c61ba5ead54c5c9bbdf1446a1c794d, user_id=df871f8cc92f4a8b95b39f2ebaffd74a, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:24.720747 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6314ca-a160-4ce0-b3e4-3122c97e68fb admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:24.738290 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1333/2648] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:24 2022] PUT /identity/v3/projects/16c61ba5ead54c5c9bbdf1446a1c794d/users/df871f8cc92f4a8b95b39f2ebaffd74a/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:38:24.805856 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9408c8d-2424-4498-ae79-f526d427d482 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:24.806113 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9408c8d-2424-4498-ae79-f526d427d482 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:24.806410 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9408c8d-2424-4498-ae79-f526d427d482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:24.835631 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-d9408c8d-2424-4498-ae79-f526d427d482 None None] MFA Rules not processed for user `df871f8cc92f4a8b95b39f2ebaffd74a`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:24.836859 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-d9408c8d-2424-4498-ae79-f526d427d482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:24.901685 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1316/2649] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:24.913293 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6314ca-a160-4ce0-b3e4-3122c97e68fb admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:24.915620 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-2a6314ca-a160-4ce0-b3e4-3122c97e68fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:24.980077 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6314ca-a160-4ce0-b3e4-3122c97e68fb admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:24.984531 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d18bb-5e9a-4c50-bb8b-e7dad5f3fee7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:24.985344 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d18bb-5e9a-4c50-bb8b-e7dad5f3fee7 service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:24.985647 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d18bb-5e9a-4c50-bb8b-e7dad5f3fee7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:24.986019 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d18bb-5e9a-4c50-bb8b-e7dad5f3fee7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:25.000023 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d18bb-5e9a-4c50-bb8b-e7dad5f3fee7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:25.001819 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d18bb-5e9a-4c50-bb8b-e7dad5f3fee7 service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:25.012638 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1334/2650] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:38:25.036138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9408c8d-2424-4498-ae79-f526d427d482 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:25.098788 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9408c8d-2424-4498-ae79-f526d427d482 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:25.103454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb1e10-4ad8-4db8-9f9b-474dcdaeef3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:25.104099 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb1e10-4ad8-4db8-9f9b-474dcdaeef3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:25.104374 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb1e10-4ad8-4db8-9f9b-474dcdaeef3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:25.104645 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb1e10-4ad8-4db8-9f9b-474dcdaeef3b admin admin] PATH_INFO: `/v3/users/df871f8cc92f4a8b95b39f2ebaffd74a` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:25.105808 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb1e10-4ad8-4db8-9f9b-474dcdaeef3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=df871f8cc92f4a8b95b39f2ebaffd74a)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:25.107801 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb1e10-4ad8-4db8-9f9b-474dcdaeef3b admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:25.158716 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-25cb1e10-4ad8-4db8-9f9b-474dcdaeef3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df871f8cc92f4a8b95b39f2ebaffd74a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:25.159424 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-25cb1e10-4ad8-4db8-9f9b-474dcdaeef3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df871f8cc92f4a8b95b39f2ebaffd74a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:25.166285 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-25cb1e10-4ad8-4db8-9f9b-474dcdaeef3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df871f8cc92f4a8b95b39f2ebaffd74a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:25.166909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-25cb1e10-4ad8-4db8-9f9b-474dcdaeef3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df871f8cc92f4a8b95b39f2ebaffd74a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:25.174244 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-25cb1e10-4ad8-4db8-9f9b-474dcdaeef3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df871f8cc92f4a8b95b39f2ebaffd74a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:25.178954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:25.194841 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1317/2651] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:38:25 2022] DELETE /identity/v3/users/df871f8cc92f4a8b95b39f2ebaffd74a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:25.199749 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdd7b2-d6aa-4f5d-ae42-6cf31634ca68 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:25.200102 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdd7b2-d6aa-4f5d-ae42-6cf31634ca68 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:25.200402 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdd7b2-d6aa-4f5d-ae42-6cf31634ca68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:25.220502 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-1bcdd7b2-d6aa-4f5d-ae42-6cf31634ca68 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:25.221719 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-1bcdd7b2-d6aa-4f5d-ae42-6cf31634ca68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:25.285609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1335/2652] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:25.297775 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb1e10-4ad8-4db8-9f9b-474dcdaeef3b admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:25.299265 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-25cb1e10-4ad8-4db8-9f9b-474dcdaeef3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:25.358849 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb1e10-4ad8-4db8-9f9b-474dcdaeef3b admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:25.362914 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3bf74-3774-4bb3-a5ba-deeb34f8ee6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:25.363556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3bf74-3774-4bb3-a5ba-deeb34f8ee6f service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:25.363832 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3bf74-3774-4bb3-a5ba-deeb34f8ee6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:25.364096 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3bf74-3774-4bb3-a5ba-deeb34f8ee6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:25.373628 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3bf74-3774-4bb3-a5ba-deeb34f8ee6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:25.375114 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3bf74-3774-4bb3-a5ba-deeb34f8ee6f service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:25.384695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1318/2653] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:38:25.669094 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdd7b2-d6aa-4f5d-ae42-6cf31634ca68 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:25.671056 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-1bcdd7b2-d6aa-4f5d-ae42-6cf31634ca68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:25.688619 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdd7b2-d6aa-4f5d-ae42-6cf31634ca68 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:25.694397 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ce160-0775-4b2c-9dc6-6d65b1e20c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:25.695250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ce160-0775-4b2c-9dc6-6d65b1e20c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:25.695549 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ce160-0775-4b2c-9dc6-6d65b1e20c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:25.695884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ce160-0775-4b2c-9dc6-6d65b1e20c9c admin admin] PATH_INFO: `/v3/projects/16c61ba5ead54c5c9bbdf1446a1c794d` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:25.696938 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ce160-0775-4b2c-9dc6-6d65b1e20c9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=16c61ba5ead54c5c9bbdf1446a1c794d)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:25.701034 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ce160-0775-4b2c-9dc6-6d65b1e20c9c admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:25.742006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:25.751051 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-b67ce160-0775-4b2c-9dc6-6d65b1e20c9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16c61ba5ead54c5c9bbdf1446a1c794d', 'request_id': 'req-b67ce160-0775-4b2c-9dc6-6d65b1e20c9c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:25.760002 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-b67ce160-0775-4b2c-9dc6-6d65b1e20c9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16c61ba5ead54c5c9bbdf1446a1c794d', 'request_id': 'req-b67ce160-0775-4b2c-9dc6-6d65b1e20c9c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:25.767232 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-b67ce160-0775-4b2c-9dc6-6d65b1e20c9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16c61ba5ead54c5c9bbdf1446a1c794d', 'request_id': 'req-b67ce160-0775-4b2c-9dc6-6d65b1e20c9c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:25.777674 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-b67ce160-0775-4b2c-9dc6-6d65b1e20c9c admin admin] The token cache is being invalidate because project 16c61ba5ead54c5c9bbdf1446a1c794d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:38:25.777959 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-b67ce160-0775-4b2c-9dc6-6d65b1e20c9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:25.778680 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-b67ce160-0775-4b2c-9dc6-6d65b1e20c9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:25.780205 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1336/2654] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:38:25 2022] DELETE /identity/v3/projects/16c61ba5ead54c5c9bbdf1446a1c794d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:25.785169 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c81bb-720e-4cc6-9dd9-dddb5958f545 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:25.785452 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c81bb-720e-4cc6-9dd9-dddb5958f545 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:25.785728 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c81bb-720e-4cc6-9dd9-dddb5958f545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:25.805559 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-072c81bb-720e-4cc6-9dd9-dddb5958f545 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:25.806802 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-072c81bb-720e-4cc6-9dd9-dddb5958f545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:25.872202 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1319/2655] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:25.880124 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec28d5a-410f-4b55-9bbe-75eea4c6534f None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:25.880428 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec28d5a-410f-4b55-9bbe-75eea4c6534f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:25.880672 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec28d5a-410f-4b55-9bbe-75eea4c6534f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:25.901050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-1ec28d5a-410f-4b55-9bbe-75eea4c6534f None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:25.902233 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-1ec28d5a-410f-4b55-9bbe-75eea4c6534f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:25.911016 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1337/2656] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:25.915881 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c81bb-720e-4cc6-9dd9-dddb5958f545 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:25.930067 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c81bb-720e-4cc6-9dd9-dddb5958f545 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:25.936979 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8b42b-fcbc-4908-9d86-aae81f73a7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:25.937589 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8b42b-fcbc-4908-9d86-aae81f73a7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:25.937864 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8b42b-fcbc-4908-9d86-aae81f73a7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:25.938132 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8b42b-fcbc-4908-9d86-aae81f73a7c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:25.938779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8b42b-fcbc-4908-9d86-aae81f73a7c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:38:25.939107 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8b42b-fcbc-4908-9d86-aae81f73a7c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:25.940710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8b42b-fcbc-4908-9d86-aae81f73a7c9 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:25.952560 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1320/2657] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:38:25.956930 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec28d5a-410f-4b55-9bbe-75eea4c6534f None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:25.966422 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec28d5a-410f-4b55-9bbe-75eea4c6534f None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:25.972223 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5537bc8-c820-48e9-ac9e-e00f0a802d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:25.972820 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5537bc8-c820-48e9-ac9e-e00f0a802d42 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:25.973085 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5537bc8-c820-48e9-ac9e-e00f0a802d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:25.973345 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5537bc8-c820-48e9-ac9e-e00f0a802d42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:25.973976 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5537bc8-c820-48e9-ac9e-e00f0a802d42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:25.975904 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5537bc8-c820-48e9-ac9e-e00f0a802d42 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:26.004794 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1338/2658] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:38:25 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:26.008953 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8b42b-fcbc-4908-9d86-aae81f73a7c9 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:26.019518 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8b42b-fcbc-4908-9d86-aae81f73a7c9 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:26.078748 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ed5d5-9ba1-4485-b115-cc4cc13b0849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:26.079392 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ed5d5-9ba1-4485-b115-cc4cc13b0849 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:26.079671 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ed5d5-9ba1-4485-b115-cc4cc13b0849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:26.079916 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ed5d5-9ba1-4485-b115-cc4cc13b0849 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:26.080532 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ed5d5-9ba1-4485-b115-cc4cc13b0849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:26.082512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ed5d5-9ba1-4485-b115-cc4cc13b0849 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:26.104940 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1321/2659] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:38:26 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:26.109339 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5537bc8-c820-48e9-ac9e-e00f0a802d42 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:26.119504 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5537bc8-c820-48e9-ac9e-e00f0a802d42 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:26.124450 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec6535-13ba-4ab9-b237-86ff343145d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:26.125099 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec6535-13ba-4ab9-b237-86ff343145d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:26.125378 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec6535-13ba-4ab9-b237-86ff343145d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:26.125679 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec6535-13ba-4ab9-b237-86ff343145d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:26.126316 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec6535-13ba-4ab9-b237-86ff343145d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:26.128010 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec6535-13ba-4ab9-b237-86ff343145d7 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:26.139481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1339/2660] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:26.143789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ed5d5-9ba1-4485-b115-cc4cc13b0849 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:26.150448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:26.154603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ed5d5-9ba1-4485-b115-cc4cc13b0849 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:26.160495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9253a5-63b3-4e8c-a4a7-c3087726fb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:26.161242 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9253a5-63b3-4e8c-a4a7-c3087726fb4b admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:26.161829 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9253a5-63b3-4e8c-a4a7-c3087726fb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:26.162347 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9253a5-63b3-4e8c-a4a7-c3087726fb4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:26.163288 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9253a5-63b3-4e8c-a4a7-c3087726fb4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:26.165309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9253a5-63b3-4e8c-a4a7-c3087726fb4b admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:26.176818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1322/2661] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:26.181203 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec6535-13ba-4ab9-b237-86ff343145d7 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:26.199410 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec6535-13ba-4ab9-b237-86ff343145d7 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:26.204945 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfc5e0-08bd-4220-8d7f-cb672951840c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:26.205524 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfc5e0-08bd-4220-8d7f-cb672951840c admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:26.205796 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfc5e0-08bd-4220-8d7f-cb672951840c admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:26.206058 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfc5e0-08bd-4220-8d7f-cb672951840c admin admin] PATH_INFO: `/v3/projects/3966af4939d4451e963bdc9d44cb0736/users/f7c839bd54dc4cdfb04fb34e263ebf35/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:26.224695 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbfc5e0-08bd-4220-8d7f-cb672951840c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3966af4939d4451e963bdc9d44cb0736, user_id=f7c839bd54dc4cdfb04fb34e263ebf35, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:26.227461 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbfc5e0-08bd-4220-8d7f-cb672951840c admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:26.242975 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1340/2662] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:26 2022] PUT /identity/v3/projects/3966af4939d4451e963bdc9d44cb0736/users/f7c839bd54dc4cdfb04fb34e263ebf35/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:26.255549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b2a60-3f9f-4e6b-9f7c-9d70ce1a7552 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:26.255841 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b2a60-3f9f-4e6b-9f7c-9d70ce1a7552 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:26.256084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b2a60-3f9f-4e6b-9f7c-9d70ce1a7552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:26.285449 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-762b2a60-3f9f-4e6b-9f7c-9d70ce1a7552 None None] MFA Rules not processed for user `f7c839bd54dc4cdfb04fb34e263ebf35`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:26.286663 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-762b2a60-3f9f-4e6b-9f7c-9d70ce1a7552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:26.353825 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1323/2663] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:26.359116 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfc5e0-08bd-4220-8d7f-cb672951840c admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:26.427375 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfc5e0-08bd-4220-8d7f-cb672951840c admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:26.432315 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af1ae9-6c7c-43f9-af2f-2c5a0adc67c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:26.433044 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af1ae9-6c7c-43f9-af2f-2c5a0adc67c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:26.433368 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af1ae9-6c7c-43f9-af2f-2c5a0adc67c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:26.433631 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af1ae9-6c7c-43f9-af2f-2c5a0adc67c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:26.434337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af1ae9-6c7c-43f9-af2f-2c5a0adc67c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:26.436412 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af1ae9-6c7c-43f9-af2f-2c5a0adc67c1 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:26.462684 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1341/2664] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:38:26 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:26.467172 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b2a60-3f9f-4e6b-9f7c-9d70ce1a7552 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:26.478909 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b2a60-3f9f-4e6b-9f7c-9d70ce1a7552 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:26.541935 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28001455-4566-453b-afce-9fd4ffe548b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:26.542551 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28001455-4566-453b-afce-9fd4ffe548b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:26.542823 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28001455-4566-453b-afce-9fd4ffe548b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:26.543137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28001455-4566-453b-afce-9fd4ffe548b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:26.543743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28001455-4566-453b-afce-9fd4ffe548b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:26.545838 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28001455-4566-453b-afce-9fd4ffe548b5 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:26.567633 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1324/2665] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:38:26 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:38:26.571781 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af1ae9-6c7c-43f9-af2f-2c5a0adc67c1 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:26.583204 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af1ae9-6c7c-43f9-af2f-2c5a0adc67c1 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:26.588649 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12ca32-c2e4-4886-a27b-235c52d7ec59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:26.589254 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12ca32-c2e4-4886-a27b-235c52d7ec59 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:26.589531 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12ca32-c2e4-4886-a27b-235c52d7ec59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:26.589797 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12ca32-c2e4-4886-a27b-235c52d7ec59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:26.590484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12ca32-c2e4-4886-a27b-235c52d7ec59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:26.592287 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12ca32-c2e4-4886-a27b-235c52d7ec59 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:26.603722 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1342/2666] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:26.608184 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28001455-4566-453b-afce-9fd4ffe548b5 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:26.618680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28001455-4566-453b-afce-9fd4ffe548b5 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:26.625485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86c2ba-8905-42df-a607-73f9fa74d4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:26.626456 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86c2ba-8905-42df-a607-73f9fa74d4af admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:26.626780 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86c2ba-8905-42df-a607-73f9fa74d4af admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:26.627085 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86c2ba-8905-42df-a607-73f9fa74d4af admin admin] PATH_INFO: `/v3/projects/91496a7eb66a49eab8f79a5502d2ec80/users/caa44972021545199cbdf73a9442c6a5/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:26.650937 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86c2ba-8905-42df-a607-73f9fa74d4af admin admin] RBAC: Authorizing `identity:create_grant(project_id=91496a7eb66a49eab8f79a5502d2ec80, user_id=caa44972021545199cbdf73a9442c6a5, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:26.654858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86c2ba-8905-42df-a607-73f9fa74d4af admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:26.669257 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1325/2667] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:26 2022] PUT /identity/v3/projects/91496a7eb66a49eab8f79a5502d2ec80/users/caa44972021545199cbdf73a9442c6a5/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:26.673337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12ca32-c2e4-4886-a27b-235c52d7ec59 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:26.683872 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12ca32-c2e4-4886-a27b-235c52d7ec59 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:26.718630 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:26.744687 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1260c6-44e3-4bb2-8507-00e25fef8a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:26.745293 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1260c6-44e3-4bb2-8507-00e25fef8a1c admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:26.745561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1260c6-44e3-4bb2-8507-00e25fef8a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:26.745825 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1260c6-44e3-4bb2-8507-00e25fef8a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:26.746466 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1260c6-44e3-4bb2-8507-00e25fef8a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:26.748230 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1260c6-44e3-4bb2-8507-00e25fef8a1c admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:26.758568 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1343/2668] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:26.763378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86c2ba-8905-42df-a607-73f9fa74d4af admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:26.774419 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86c2ba-8905-42df-a607-73f9fa74d4af admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:26.779818 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f483c-009e-4dc7-8420-9fb3312650bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:26.780478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f483c-009e-4dc7-8420-9fb3312650bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:26.780749 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f483c-009e-4dc7-8420-9fb3312650bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:26.781028 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f483c-009e-4dc7-8420-9fb3312650bc admin admin] PATH_INFO: `/v3/projects/91496a7eb66a49eab8f79a5502d2ec80/users/caa44972021545199cbdf73a9442c6a5/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:26.783097 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f483c-009e-4dc7-8420-9fb3312650bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=91496a7eb66a49eab8f79a5502d2ec80, user_id=caa44972021545199cbdf73a9442c6a5, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:26.785716 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f483c-009e-4dc7-8420-9fb3312650bc admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:26.798401 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1326/2669] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:26 2022] PUT /identity/v3/projects/91496a7eb66a49eab8f79a5502d2ec80/users/caa44972021545199cbdf73a9442c6a5/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:26.808653 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e287f-61b6-4f4b-90ae-87d31e5adf99 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:26.808929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e287f-61b6-4f4b-90ae-87d31e5adf99 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:26.809197 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e287f-61b6-4f4b-90ae-87d31e5adf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:26.840689 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-561e287f-61b6-4f4b-90ae-87d31e5adf99 None None] MFA Rules not processed for user `caa44972021545199cbdf73a9442c6a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:26.842068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-561e287f-61b6-4f4b-90ae-87d31e5adf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:26.915667 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1344/2670] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:26.927530 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f483c-009e-4dc7-8420-9fb3312650bc admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:26.929474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-4a2f483c-009e-4dc7-8420-9fb3312650bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:26.971339 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:26.990613 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f483c-009e-4dc7-8420-9fb3312650bc admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:26.994907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695ef78-e574-4bba-8f94-c169c3f76dfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:26.995565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695ef78-e574-4bba-8f94-c169c3f76dfb service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:26.995843 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695ef78-e574-4bba-8f94-c169c3f76dfb service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:26.996107 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695ef78-e574-4bba-8f94-c169c3f76dfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:27.054198 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695ef78-e574-4bba-8f94-c169c3f76dfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:27.055681 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695ef78-e574-4bba-8f94-c169c3f76dfb service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:27.064714 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1327/2671] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:38:27.557532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232bdb9-5be4-466b-851f-9c994d472cd9 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:27.557907 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232bdb9-5be4-466b-851f-9c994d472cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:27.558221 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232bdb9-5be4-466b-851f-9c994d472cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:27.578141 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-c232bdb9-5be4-466b-851f-9c994d472cd9 None None] MFA Rules not processed for user `05cfc9d62a244701a5df524d1c26f107`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:27.579467 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-c232bdb9-5be4-466b-851f-9c994d472cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:27.635260 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1345/2672] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Oct 4 16:38:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:27.651494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695ef78-e574-4bba-8f94-c169c3f76dfb service cinder] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:27.653215 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c695ef78-e574-4bba-8f94-c169c3f76dfb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:27.723988 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695ef78-e574-4bba-8f94-c169c3f76dfb service cinder] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:27.729116 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ec750-5e14-43f2-a453-fda6e9ab65b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6590cb6c1c964039b9dea771a647bdac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:27.729716 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ec750-5e14-43f2-a453-fda6e9ab65b0 service swift] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:27.729986 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ec750-5e14-43f2-a453-fda6e9ab65b0 service swift] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:27.730244 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ec750-5e14-43f2-a453-fda6e9ab65b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:27.738484 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ec750-5e14-43f2-a453-fda6e9ab65b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:27.740079 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ec750-5e14-43f2-a453-fda6e9ab65b0 service swift] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:27.748622 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1328/2673] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Oct 4 16:38:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 16:38:29.760372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232bdb9-5be4-466b-851f-9c994d472cd9 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:29.835837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232bdb9-5be4-466b-851f-9c994d472cd9 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:29.840836 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183e787-024b-4d72-bbde-8a70135d5c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:29.841715 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183e787-024b-4d72-bbde-8a70135d5c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:29.841817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183e787-024b-4d72-bbde-8a70135d5c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:29.842024 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183e787-024b-4d72-bbde-8a70135d5c7e admin admin] PATH_INFO: `/v3/users/f7c839bd54dc4cdfb04fb34e263ebf35` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:29.843432 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183e787-024b-4d72-bbde-8a70135d5c7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7c839bd54dc4cdfb04fb34e263ebf35)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:29.845338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183e787-024b-4d72-bbde-8a70135d5c7e admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:29.865078 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:29.947608 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5183e787-024b-4d72-bbde-8a70135d5c7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7c839bd54dc4cdfb04fb34e263ebf35'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:29.949579 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5183e787-024b-4d72-bbde-8a70135d5c7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7c839bd54dc4cdfb04fb34e263ebf35'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:29.969451 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5183e787-024b-4d72-bbde-8a70135d5c7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7c839bd54dc4cdfb04fb34e263ebf35'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:30.002333 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5183e787-024b-4d72-bbde-8a70135d5c7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7c839bd54dc4cdfb04fb34e263ebf35'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:30.003407 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5183e787-024b-4d72-bbde-8a70135d5c7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7c839bd54dc4cdfb04fb34e263ebf35'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:30.034420 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1346/2674] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:38:29 2022] DELETE /identity/v3/users/f7c839bd54dc4cdfb04fb34e263ebf35 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:30.036552 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078218f-9138-46be-ad82-c3e57d3d4051 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:30.036552 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078218f-9138-46be-ad82-c3e57d3d4051 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:30.036552 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078218f-9138-46be-ad82-c3e57d3d4051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:30.101513 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-8078218f-9138-46be-ad82-c3e57d3d4051 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:30.103559 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-8078218f-9138-46be-ad82-c3e57d3d4051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:30.231936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1329/2675] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:30.244331 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183e787-024b-4d72-bbde-8a70135d5c7e admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:30.245876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-5183e787-024b-4d72-bbde-8a70135d5c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:30.307982 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183e787-024b-4d72-bbde-8a70135d5c7e admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:30.311735 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9907d26-e498-45a9-8cf0-4026558a83e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:30.312436 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9907d26-e498-45a9-8cf0-4026558a83e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:30.312791 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9907d26-e498-45a9-8cf0-4026558a83e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:30.313131 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9907d26-e498-45a9-8cf0-4026558a83e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:30.324210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9907d26-e498-45a9-8cf0-4026558a83e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:30.325748 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9907d26-e498-45a9-8cf0-4026558a83e7 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:30.336599 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1347/2676] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:38:30.743009 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078218f-9138-46be-ad82-c3e57d3d4051 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:30.744926 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-8078218f-9138-46be-ad82-c3e57d3d4051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:30.761198 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078218f-9138-46be-ad82-c3e57d3d4051 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:30.767014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de969b-a72e-4aac-af99-a5e1f5fcae4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:30.767719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de969b-a72e-4aac-af99-a5e1f5fcae4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:30.768061 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de969b-a72e-4aac-af99-a5e1f5fcae4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:30.768399 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de969b-a72e-4aac-af99-a5e1f5fcae4f admin admin] PATH_INFO: `/v3/projects/3966af4939d4451e963bdc9d44cb0736` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:30.769638 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de969b-a72e-4aac-af99-a5e1f5fcae4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3966af4939d4451e963bdc9d44cb0736)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:30.772129 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de969b-a72e-4aac-af99-a5e1f5fcae4f admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:30.792811 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:30.830365 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-32de969b-a72e-4aac-af99-a5e1f5fcae4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3966af4939d4451e963bdc9d44cb0736', 'request_id': 'req-32de969b-a72e-4aac-af99-a5e1f5fcae4f'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:30.841524 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-32de969b-a72e-4aac-af99-a5e1f5fcae4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3966af4939d4451e963bdc9d44cb0736', 'request_id': 'req-32de969b-a72e-4aac-af99-a5e1f5fcae4f'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:30.850229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-32de969b-a72e-4aac-af99-a5e1f5fcae4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3966af4939d4451e963bdc9d44cb0736', 'request_id': 'req-32de969b-a72e-4aac-af99-a5e1f5fcae4f'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:30.863744 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-32de969b-a72e-4aac-af99-a5e1f5fcae4f admin admin] The token cache is being invalidate because project 3966af4939d4451e963bdc9d44cb0736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:38:30.864076 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-32de969b-a72e-4aac-af99-a5e1f5fcae4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:30.864844 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-32de969b-a72e-4aac-af99-a5e1f5fcae4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:30.866756 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1330/2677] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:38:30 2022] DELETE /identity/v3/projects/3966af4939d4451e963bdc9d44cb0736 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:30.870674 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9907d26-e498-45a9-8cf0-4026558a83e7 service neutron] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:30.881602 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9907d26-e498-45a9-8cf0-4026558a83e7 service neutron] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:30.950664 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be75b11-0646-410f-b01b-cba990b9bf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:30.951732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be75b11-0646-410f-b01b-cba990b9bf84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:30.952207 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be75b11-0646-410f-b01b-cba990b9bf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:30.952677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be75b11-0646-410f-b01b-cba990b9bf84 admin admin] PATH_INFO: `/v3/users/caa44972021545199cbdf73a9442c6a5` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:30.953908 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be75b11-0646-410f-b01b-cba990b9bf84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caa44972021545199cbdf73a9442c6a5)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:30.955939 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be75b11-0646-410f-b01b-cba990b9bf84 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:30.988922 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:31.014269 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5be75b11-0646-410f-b01b-cba990b9bf84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caa44972021545199cbdf73a9442c6a5'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:31.015030 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5be75b11-0646-410f-b01b-cba990b9bf84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caa44972021545199cbdf73a9442c6a5'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:31.023165 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5be75b11-0646-410f-b01b-cba990b9bf84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caa44972021545199cbdf73a9442c6a5'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:31.033591 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5be75b11-0646-410f-b01b-cba990b9bf84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caa44972021545199cbdf73a9442c6a5'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:31.034487 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5be75b11-0646-410f-b01b-cba990b9bf84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caa44972021545199cbdf73a9442c6a5'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:31.057048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1348/2678] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:38:30 2022] DELETE /identity/v3/users/caa44972021545199cbdf73a9442c6a5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:38:31.659502 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de969b-a72e-4aac-af99-a5e1f5fcae4f admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:31.661494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-32de969b-a72e-4aac-af99-a5e1f5fcae4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:31.692359 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de969b-a72e-4aac-af99-a5e1f5fcae4f admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:31.767231 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce57e45-4bd2-4f64-ab73-1a003fafe8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:31.767977 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce57e45-4bd2-4f64-ab73-1a003fafe8ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:31.768622 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce57e45-4bd2-4f64-ab73-1a003fafe8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:31.768622 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce57e45-4bd2-4f64-ab73-1a003fafe8ac admin admin] PATH_INFO: `/v3/projects/91496a7eb66a49eab8f79a5502d2ec80` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:31.770797 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce57e45-4bd2-4f64-ab73-1a003fafe8ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=91496a7eb66a49eab8f79a5502d2ec80)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:31.774193 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce57e45-4bd2-4f64-ab73-1a003fafe8ac admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:31.838906 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-5ce57e45-4bd2-4f64-ab73-1a003fafe8ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91496a7eb66a49eab8f79a5502d2ec80', 'request_id': 'req-5ce57e45-4bd2-4f64-ab73-1a003fafe8ac'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:31.849789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-5ce57e45-4bd2-4f64-ab73-1a003fafe8ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91496a7eb66a49eab8f79a5502d2ec80', 'request_id': 'req-5ce57e45-4bd2-4f64-ab73-1a003fafe8ac'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:31.859087 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-5ce57e45-4bd2-4f64-ab73-1a003fafe8ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91496a7eb66a49eab8f79a5502d2ec80', 'request_id': 'req-5ce57e45-4bd2-4f64-ab73-1a003fafe8ac'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:31.871185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-5ce57e45-4bd2-4f64-ab73-1a003fafe8ac admin admin] The token cache is being invalidate because project 91496a7eb66a49eab8f79a5502d2ec80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:38:31.871589 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-5ce57e45-4bd2-4f64-ab73-1a003fafe8ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:31.872619 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-5ce57e45-4bd2-4f64-ab73-1a003fafe8ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:31.879251 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1331/2679] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:38:31 2022] DELETE /identity/v3/projects/91496a7eb66a49eab8f79a5502d2ec80 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:31.879670 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1474d-b8a9-4cff-823b-c9cd7d872133 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:31.880155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1474d-b8a9-4cff-823b-c9cd7d872133 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:31.880257 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1474d-b8a9-4cff-823b-c9cd7d872133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:31.904295 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-e5f1474d-b8a9-4cff-823b-c9cd7d872133 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:31.905869 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-e5f1474d-b8a9-4cff-823b-c9cd7d872133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:31.985440 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1349/2680] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:31.993938 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c139b-9ad9-4986-a9b7-5cc764874cd8 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:31.994211 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c139b-9ad9-4986-a9b7-5cc764874cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:31.994497 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c139b-9ad9-4986-a9b7-5cc764874cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:32.016737 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-077c139b-9ad9-4986-a9b7-5cc764874cd8 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:32.018217 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-077c139b-9ad9-4986-a9b7-5cc764874cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:32.036770 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1332/2681] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:32.040817 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1474d-b8a9-4cff-823b-c9cd7d872133 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:32.051126 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1474d-b8a9-4cff-823b-c9cd7d872133 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:32.057197 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae7574-f3d9-4940-99de-b81328f192bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:32.057933 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae7574-f3d9-4940-99de-b81328f192bb admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:32.058306 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae7574-f3d9-4940-99de-b81328f192bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:32.058677 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae7574-f3d9-4940-99de-b81328f192bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:32.059468 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae7574-f3d9-4940-99de-b81328f192bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:38:32.059901 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae7574-f3d9-4940-99de-b81328f192bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:32.061683 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae7574-f3d9-4940-99de-b81328f192bb admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:32.079466 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1350/2682] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 16:38:32.080734 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c139b-9ad9-4986-a9b7-5cc764874cd8 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:32.090279 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c139b-9ad9-4986-a9b7-5cc764874cd8 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:32.095385 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3efe9-02c6-427d-9db6-f9a4b064cec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:32.096127 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3efe9-02c6-427d-9db6-f9a4b064cec6 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:32.096405 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3efe9-02c6-427d-9db6-f9a4b064cec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:32.096921 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3efe9-02c6-427d-9db6-f9a4b064cec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:32.097493 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3efe9-02c6-427d-9db6-f9a4b064cec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:32.099611 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3efe9-02c6-427d-9db6-f9a4b064cec6 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:32.135558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1333/2683] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:38:32 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:32.137358 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae7574-f3d9-4940-99de-b81328f192bb admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:32.150780 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae7574-f3d9-4940-99de-b81328f192bb admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:32.212314 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b76da-18e0-4882-934c-139dff39793a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:32.213026 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b76da-18e0-4882-934c-139dff39793a admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:32.213327 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b76da-18e0-4882-934c-139dff39793a admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:32.213593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b76da-18e0-4882-934c-139dff39793a admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:32.214258 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b76da-18e0-4882-934c-139dff39793a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:32.216454 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b76da-18e0-4882-934c-139dff39793a admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:32.244824 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1351/2684] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:38:32 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:32.246404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3efe9-02c6-427d-9db6-f9a4b064cec6 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:32.254079 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:32.258895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3efe9-02c6-427d-9db6-f9a4b064cec6 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:32.266333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0eb9f-f037-42b6-b2d5-8e01a865110e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:32.267482 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0eb9f-f037-42b6-b2d5-8e01a865110e admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:32.268146 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0eb9f-f037-42b6-b2d5-8e01a865110e admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:32.268576 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0eb9f-f037-42b6-b2d5-8e01a865110e admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:32.269807 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0eb9f-f037-42b6-b2d5-8e01a865110e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:32.272122 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0eb9f-f037-42b6-b2d5-8e01a865110e admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:32.291203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1334/2685] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:32.293409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b76da-18e0-4882-934c-139dff39793a admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:32.303985 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b76da-18e0-4882-934c-139dff39793a admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:32.310880 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf6996-efb9-4b6b-91a5-1c1fb3a0cf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:32.311666 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf6996-efb9-4b6b-91a5-1c1fb3a0cf4f admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:32.312124 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf6996-efb9-4b6b-91a5-1c1fb3a0cf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:32.312409 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf6996-efb9-4b6b-91a5-1c1fb3a0cf4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:32.313038 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf6996-efb9-4b6b-91a5-1c1fb3a0cf4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:32.314621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf6996-efb9-4b6b-91a5-1c1fb3a0cf4f admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:32.326533 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1352/2686] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:38:32.331444 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0eb9f-f037-42b6-b2d5-8e01a865110e admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:32.342551 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0eb9f-f037-42b6-b2d5-8e01a865110e admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:32.347482 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f823483-15e9-4629-8d75-5a76d92d016f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:32.348219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f823483-15e9-4629-8d75-5a76d92d016f admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:32.348568 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f823483-15e9-4629-8d75-5a76d92d016f admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:32.348905 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f823483-15e9-4629-8d75-5a76d92d016f admin admin] PATH_INFO: `/v3/projects/1e39d22f0215451280646ad32a33bdb6/users/d984cf60d3254f46ab9b82a4346c39e5/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:32.390178 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f823483-15e9-4629-8d75-5a76d92d016f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e39d22f0215451280646ad32a33bdb6, user_id=d984cf60d3254f46ab9b82a4346c39e5, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:32.390178 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f823483-15e9-4629-8d75-5a76d92d016f admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:32.415050 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1335/2687] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:32 2022] PUT /identity/v3/projects/1e39d22f0215451280646ad32a33bdb6/users/d984cf60d3254f46ab9b82a4346c39e5/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:32.421267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40fa4e-f23f-4a96-b422-a9ee1fac6f00 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:32.421712 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40fa4e-f23f-4a96-b422-a9ee1fac6f00 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:32.422111 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40fa4e-f23f-4a96-b422-a9ee1fac6f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:32.446581 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:32.467653 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-4c40fa4e-f23f-4a96-b422-a9ee1fac6f00 None None] MFA Rules not processed for user `d984cf60d3254f46ab9b82a4346c39e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:32.470096 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-4c40fa4e-f23f-4a96-b422-a9ee1fac6f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:32.558617 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1353/2688] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:32.563861 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f823483-15e9-4629-8d75-5a76d92d016f admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:32.645620 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f823483-15e9-4629-8d75-5a76d92d016f admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:32.655201 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42202e3-f8a0-46e4-b78e-fc119cc55e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:32.656301 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42202e3-f8a0-46e4-b78e-fc119cc55e5d admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:32.656785 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42202e3-f8a0-46e4-b78e-fc119cc55e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:32.657275 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42202e3-f8a0-46e4-b78e-fc119cc55e5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:32.658071 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42202e3-f8a0-46e4-b78e-fc119cc55e5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:32.660148 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42202e3-f8a0-46e4-b78e-fc119cc55e5d admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:32.695021 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1336/2689] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:38:32 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:32.698073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40fa4e-f23f-4a96-b422-a9ee1fac6f00 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:32.712814 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40fa4e-f23f-4a96-b422-a9ee1fac6f00 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:32.835467 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d67368-091c-43f3-91c0-636658df14b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:32.836531 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d67368-091c-43f3-91c0-636658df14b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:32.836806 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d67368-091c-43f3-91c0-636658df14b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:32.837074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d67368-091c-43f3-91c0-636658df14b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:32.838011 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d67368-091c-43f3-91c0-636658df14b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:32.840101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d67368-091c-43f3-91c0-636658df14b3 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:32.869798 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1354/2690] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:38:32 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:38:32.873923 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42202e3-f8a0-46e4-b78e-fc119cc55e5d admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:32.886124 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42202e3-f8a0-46e4-b78e-fc119cc55e5d admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:32.892281 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb84d34-5514-46a8-8cff-28bb76eb9f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:32.892967 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb84d34-5514-46a8-8cff-28bb76eb9f9b admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:32.893277 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb84d34-5514-46a8-8cff-28bb76eb9f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:32.893551 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb84d34-5514-46a8-8cff-28bb76eb9f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:32.894203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb84d34-5514-46a8-8cff-28bb76eb9f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:32.895878 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb84d34-5514-46a8-8cff-28bb76eb9f9b admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:32.907326 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1337/2691] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:38:32.911833 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d67368-091c-43f3-91c0-636658df14b3 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:32.922085 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d67368-091c-43f3-91c0-636658df14b3 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:32.927257 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d88313-c19f-48c7-ad7a-a7a8c133824a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:32.927885 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d88313-c19f-48c7-ad7a-a7a8c133824a admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:32.928146 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d88313-c19f-48c7-ad7a-a7a8c133824a admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:32.928426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d88313-c19f-48c7-ad7a-a7a8c133824a admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:32.929068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d88313-c19f-48c7-ad7a-a7a8c133824a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:32.930771 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d88313-c19f-48c7-ad7a-a7a8c133824a admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:32.945259 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1355/2692] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:32.946264 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb84d34-5514-46a8-8cff-28bb76eb9f9b admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:32.957322 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb84d34-5514-46a8-8cff-28bb76eb9f9b admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:32.962222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67691ad-2e87-4e45-9487-f992da78594e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:32.962889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67691ad-2e87-4e45-9487-f992da78594e admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:32.963213 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67691ad-2e87-4e45-9487-f992da78594e admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:32.963496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67691ad-2e87-4e45-9487-f992da78594e admin admin] PATH_INFO: `/v3/projects/ff4f227d0320432fa4955b9e68819811/users/f8a310d612bd4c4f9754d66bb569097c/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:32.985209 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67691ad-2e87-4e45-9487-f992da78594e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff4f227d0320432fa4955b9e68819811, user_id=f8a310d612bd4c4f9754d66bb569097c, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:32.988738 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67691ad-2e87-4e45-9487-f992da78594e admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:33.015023 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1338/2693] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:32 2022] PUT /identity/v3/projects/ff4f227d0320432fa4955b9e68819811/users/f8a310d612bd4c4f9754d66bb569097c/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:33.018808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db531887-b4a6-4761-bb92-90f33b17c21c None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:33.019124 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db531887-b4a6-4761-bb92-90f33b17c21c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:33.019405 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db531887-b4a6-4761-bb92-90f33b17c21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:33.068587 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-db531887-b4a6-4761-bb92-90f33b17c21c None None] MFA Rules not processed for user `f8a310d612bd4c4f9754d66bb569097c`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:33.070184 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-db531887-b4a6-4761-bb92-90f33b17c21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:33.164801 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1356/2694] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:33.167366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67691ad-2e87-4e45-9487-f992da78594e admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:33.246332 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67691ad-2e87-4e45-9487-f992da78594e admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:33.252014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d11fe-4810-410b-a542-4fc74c302ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:33.253112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d11fe-4810-410b-a542-4fc74c302ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:33.253316 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d11fe-4810-410b-a542-4fc74c302ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:33.253851 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d11fe-4810-410b-a542-4fc74c302ac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:33.254931 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d11fe-4810-410b-a542-4fc74c302ac3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:33.257634 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d11fe-4810-410b-a542-4fc74c302ac3 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:33.292945 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1339/2695] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:38:33 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:33.298564 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db531887-b4a6-4761-bb92-90f33b17c21c None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:33.313489 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db531887-b4a6-4761-bb92-90f33b17c21c None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:33.321688 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:33.402216 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b2273-9498-4028-8780-4d3782500476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:33.403195 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b2273-9498-4028-8780-4d3782500476 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:33.403599 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b2273-9498-4028-8780-4d3782500476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:33.403895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b2273-9498-4028-8780-4d3782500476 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:33.404545 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b2273-9498-4028-8780-4d3782500476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:33.406501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b2273-9498-4028-8780-4d3782500476 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:33.432012 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1357/2696] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:38:33 2022] POST /identity/v3/users => generated 295 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:33.436095 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d11fe-4810-410b-a542-4fc74c302ac3 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:33.444136 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:33.451372 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d11fe-4810-410b-a542-4fc74c302ac3 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:33.459027 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae51569-703d-4478-9446-2943c640cea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:33.463277 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae51569-703d-4478-9446-2943c640cea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:33.463561 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae51569-703d-4478-9446-2943c640cea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:33.463836 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae51569-703d-4478-9446-2943c640cea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:33.464503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae51569-703d-4478-9446-2943c640cea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:33.466483 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae51569-703d-4478-9446-2943c640cea1 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:33.479623 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1340/2697] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:38:33.484082 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b2273-9498-4028-8780-4d3782500476 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:33.496204 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b2273-9498-4028-8780-4d3782500476 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:33.501210 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f9c9d-b492-43d2-914e-144ba7df93ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:33.501863 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f9c9d-b492-43d2-914e-144ba7df93ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:33.502141 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f9c9d-b492-43d2-914e-144ba7df93ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:33.502425 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f9c9d-b492-43d2-914e-144ba7df93ae admin admin] PATH_INFO: `/v3/projects/2c2c64a65d914318b6a6c30c61d84ec1/users/b9a7bd92c4f04b15b1903c6f7e35db21/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:33.522483 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f9c9d-b492-43d2-914e-144ba7df93ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c2c64a65d914318b6a6c30c61d84ec1, user_id=b9a7bd92c4f04b15b1903c6f7e35db21, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:33.525180 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f9c9d-b492-43d2-914e-144ba7df93ae admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:33.547269 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1358/2698] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:33 2022] PUT /identity/v3/projects/2c2c64a65d914318b6a6c30c61d84ec1/users/b9a7bd92c4f04b15b1903c6f7e35db21/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:33.550091 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae51569-703d-4478-9446-2943c640cea1 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:33.563635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae51569-703d-4478-9446-2943c640cea1 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:33.700325 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5239b-76ef-4e3a-8e78-1b97d3af7b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:33.701103 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5239b-76ef-4e3a-8e78-1b97d3af7b53 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:33.701286 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5239b-76ef-4e3a-8e78-1b97d3af7b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:33.701560 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5239b-76ef-4e3a-8e78-1b97d3af7b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:33.702238 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb5239b-76ef-4e3a-8e78-1b97d3af7b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:33.704269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb5239b-76ef-4e3a-8e78-1b97d3af7b53 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:33.725828 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1341/2699] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:33.736576 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f9c9d-b492-43d2-914e-144ba7df93ae admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:33.748963 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f9c9d-b492-43d2-914e-144ba7df93ae admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:33.755091 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764b36e-bc0e-4d1d-8881-a2a4646c59c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:33.755845 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764b36e-bc0e-4d1d-8881-a2a4646c59c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:33.756125 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764b36e-bc0e-4d1d-8881-a2a4646c59c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:33.756392 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764b36e-bc0e-4d1d-8881-a2a4646c59c2 admin admin] PATH_INFO: `/v3/projects/2c2c64a65d914318b6a6c30c61d84ec1/users/b9a7bd92c4f04b15b1903c6f7e35db21/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:33.758498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764b36e-bc0e-4d1d-8881-a2a4646c59c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c2c64a65d914318b6a6c30c61d84ec1, user_id=b9a7bd92c4f04b15b1903c6f7e35db21, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:33.761286 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764b36e-bc0e-4d1d-8881-a2a4646c59c2 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:33.787313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1359/2700] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:33 2022] PUT /identity/v3/projects/2c2c64a65d914318b6a6c30c61d84ec1/users/b9a7bd92c4f04b15b1903c6f7e35db21/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:33.798746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c9e32-b625-45a2-926b-fa9b52489996 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:33.799052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c9e32-b625-45a2-926b-fa9b52489996 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:33.799329 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c9e32-b625-45a2-926b-fa9b52489996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:33.853822 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-f29c9e32-b625-45a2-926b-fa9b52489996 None None] MFA Rules not processed for user `b9a7bd92c4f04b15b1903c6f7e35db21`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:33.855915 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f29c9e32-b625-45a2-926b-fa9b52489996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:33.948118 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1342/2701] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:38:33.957776 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764b36e-bc0e-4d1d-8881-a2a4646c59c2 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:33.959595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-1764b36e-bc0e-4d1d-8881-a2a4646c59c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:34.050929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764b36e-bc0e-4d1d-8881-a2a4646c59c2 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:34.061810 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9227d53-5664-4e3c-a008-2131a6898b06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:34.062553 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9227d53-5664-4e3c-a008-2131a6898b06 service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:34.062829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9227d53-5664-4e3c-a008-2131a6898b06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:34.063158 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9227d53-5664-4e3c-a008-2131a6898b06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:34.145702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9227d53-5664-4e3c-a008-2131a6898b06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:34.147176 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9227d53-5664-4e3c-a008-2131a6898b06 service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:34.159251 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1360/2702] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:38:35.848144 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c9e32-b625-45a2-926b-fa9b52489996 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:35.865650 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c9e32-b625-45a2-926b-fa9b52489996 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:35.870059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c9f29-f232-4326-8aac-822b7eeba71f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:35.870681 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c9f29-f232-4326-8aac-822b7eeba71f service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:35.870951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c9f29-f232-4326-8aac-822b7eeba71f service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:35.871276 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c9f29-f232-4326-8aac-822b7eeba71f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:35.940937 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c9f29-f232-4326-8aac-822b7eeba71f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:35.943043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c9f29-f232-4326-8aac-822b7eeba71f service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:35.954110 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1343/2703] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:38:36.551291 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9227d53-5664-4e3c-a008-2131a6898b06 service cinder] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:36.551291 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b9227d53-5664-4e3c-a008-2131a6898b06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:36.584152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:36.650007 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9227d53-5664-4e3c-a008-2131a6898b06 service cinder] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:36.660713 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c9f29-f232-4326-8aac-822b7eeba71f service cinder] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:36.670076 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ea2e4-f3db-41da-aefd-f22261014a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:36.670896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ea2e4-f3db-41da-aefd-f22261014a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:36.671391 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ea2e4-f3db-41da-aefd-f22261014a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:36.671770 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ea2e4-f3db-41da-aefd-f22261014a06 admin admin] PATH_INFO: `/v3/users/ff0d5c2aac1a48ceaa7baa4fb0c6c0bd` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:36.673947 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ea2e4-f3db-41da-aefd-f22261014a06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff0d5c2aac1a48ceaa7baa4fb0c6c0bd)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:36.675798 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ea2e4-f3db-41da-aefd-f22261014a06 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:36.685837 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c9f29-f232-4326-8aac-822b7eeba71f service cinder] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:36.705588 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b6db4-fe2d-4373-bb78-adc8fae6a4a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:36.706465 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b6db4-fe2d-4373-bb78-adc8fae6a4a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:36.706763 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b6db4-fe2d-4373-bb78-adc8fae6a4a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:36.707163 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b6db4-fe2d-4373-bb78-adc8fae6a4a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:36.734596 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b6db4-fe2d-4373-bb78-adc8fae6a4a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:36.736077 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b6db4-fe2d-4373-bb78-adc8fae6a4a4 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:36.749781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:36.765016 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1344/2704] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:38:36.766446 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-9b1ea2e4-f3db-41da-aefd-f22261014a06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff0d5c2aac1a48ceaa7baa4fb0c6c0bd'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:36.767261 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-9b1ea2e4-f3db-41da-aefd-f22261014a06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff0d5c2aac1a48ceaa7baa4fb0c6c0bd'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:36.777517 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-9b1ea2e4-f3db-41da-aefd-f22261014a06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff0d5c2aac1a48ceaa7baa4fb0c6c0bd'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:36.815219 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-9b1ea2e4-f3db-41da-aefd-f22261014a06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff0d5c2aac1a48ceaa7baa4fb0c6c0bd'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:36.816148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-9b1ea2e4-f3db-41da-aefd-f22261014a06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff0d5c2aac1a48ceaa7baa4fb0c6c0bd'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:36.848352 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1361/2705] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:38:36 2022] DELETE /identity/v3/users/ff0d5c2aac1a48ceaa7baa4fb0c6c0bd => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:36.852867 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f810d-6fab-4c66-bd4b-28f5c3b20b5c None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:36.853500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f810d-6fab-4c66-bd4b-28f5c3b20b5c None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:36.853633 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f810d-6fab-4c66-bd4b-28f5c3b20b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:36.875695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-cb8f810d-6fab-4c66-bd4b-28f5c3b20b5c None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:36.876744 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-cb8f810d-6fab-4c66-bd4b-28f5c3b20b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:36.992905 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1345/2706] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:37.000620 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ea2e4-f3db-41da-aefd-f22261014a06 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:37.002203 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-9b1ea2e4-f3db-41da-aefd-f22261014a06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:37.073936 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ea2e4-f3db-41da-aefd-f22261014a06 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:37.079610 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc37ef9-1192-4714-bc25-94410f294376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:37.080654 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc37ef9-1192-4714-bc25-94410f294376 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:37.081173 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc37ef9-1192-4714-bc25-94410f294376 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:37.081681 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc37ef9-1192-4714-bc25-94410f294376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:37.092457 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc37ef9-1192-4714-bc25-94410f294376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:37.093983 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc37ef9-1192-4714-bc25-94410f294376 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:37.105907 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1362/2707] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:38:37.423912 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f810d-6fab-4c66-bd4b-28f5c3b20b5c None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:37.425476 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-cb8f810d-6fab-4c66-bd4b-28f5c3b20b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:37.439500 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f810d-6fab-4c66-bd4b-28f5c3b20b5c None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:37.444930 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95593220-4e61-4900-b093-0ae7c345e2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:37.445698 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95593220-4e61-4900-b093-0ae7c345e2f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:37.445974 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95593220-4e61-4900-b093-0ae7c345e2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:37.446266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95593220-4e61-4900-b093-0ae7c345e2f1 admin admin] PATH_INFO: `/v3/projects/2d0fb618d1cc4b8ba9222e8b0a2f24f2` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:37.447534 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95593220-4e61-4900-b093-0ae7c345e2f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d0fb618d1cc4b8ba9222e8b0a2f24f2)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:37.449585 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95593220-4e61-4900-b093-0ae7c345e2f1 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:37.500105 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-95593220-4e61-4900-b093-0ae7c345e2f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d0fb618d1cc4b8ba9222e8b0a2f24f2', 'request_id': 'req-95593220-4e61-4900-b093-0ae7c345e2f1'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:37.511424 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-95593220-4e61-4900-b093-0ae7c345e2f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d0fb618d1cc4b8ba9222e8b0a2f24f2', 'request_id': 'req-95593220-4e61-4900-b093-0ae7c345e2f1'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:37.520742 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-95593220-4e61-4900-b093-0ae7c345e2f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d0fb618d1cc4b8ba9222e8b0a2f24f2', 'request_id': 'req-95593220-4e61-4900-b093-0ae7c345e2f1'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:37.535519 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-95593220-4e61-4900-b093-0ae7c345e2f1 admin admin] The token cache is being invalidate because project 2d0fb618d1cc4b8ba9222e8b0a2f24f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:38:37.535900 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-95593220-4e61-4900-b093-0ae7c345e2f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:37.536661 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-95593220-4e61-4900-b093-0ae7c345e2f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:37.538317 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1346/2708] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:38:37 2022] DELETE /identity/v3/projects/2d0fb618d1cc4b8ba9222e8b0a2f24f2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:37.543728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d77f7-34b9-47b9-8242-3bae2ca0b1da None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:37.544294 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d77f7-34b9-47b9-8242-3bae2ca0b1da None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:37.544659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d77f7-34b9-47b9-8242-3bae2ca0b1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:37.565854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-e82d77f7-34b9-47b9-8242-3bae2ca0b1da None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:37.567122 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-e82d77f7-34b9-47b9-8242-3bae2ca0b1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:37.611630 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:37.645777 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1363/2709] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:37.654466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe12db-0dc5-467e-9efa-d435198804d3 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:37.655055 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe12db-0dc5-467e-9efa-d435198804d3 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:37.655341 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe12db-0dc5-467e-9efa-d435198804d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:37.676506 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-7afe12db-0dc5-467e-9efa-d435198804d3 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:37.677801 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-7afe12db-0dc5-467e-9efa-d435198804d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:37.686230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1347/2710] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:37.691050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d77f7-34b9-47b9-8242-3bae2ca0b1da None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:37.701159 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d77f7-34b9-47b9-8242-3bae2ca0b1da None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:37.706189 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e9b94-cc36-42a3-9b13-00ad6d2d2251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:37.706786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e9b94-cc36-42a3-9b13-00ad6d2d2251 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:37.707087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e9b94-cc36-42a3-9b13-00ad6d2d2251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:37.707354 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e9b94-cc36-42a3-9b13-00ad6d2d2251 admin admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:37.708001 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e9b94-cc36-42a3-9b13-00ad6d2d2251 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:38:37.708297 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e9b94-cc36-42a3-9b13-00ad6d2d2251 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:37.709883 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e9b94-cc36-42a3-9b13-00ad6d2d2251 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:37.722475 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1364/2711] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:38:37.727278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe12db-0dc5-467e-9efa-d435198804d3 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:37.737097 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe12db-0dc5-467e-9efa-d435198804d3 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:37.742396 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21d476-39b2-4308-9912-9d7d55f4aea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:37.743013 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21d476-39b2-4308-9912-9d7d55f4aea7 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:37.743307 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21d476-39b2-4308-9912-9d7d55f4aea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:37.743569 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21d476-39b2-4308-9912-9d7d55f4aea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:37.744214 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21d476-39b2-4308-9912-9d7d55f4aea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:37.746091 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21d476-39b2-4308-9912-9d7d55f4aea7 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:37.774875 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1348/2712] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:38:37 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:37.779374 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e9b94-cc36-42a3-9b13-00ad6d2d2251 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:37.789383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e9b94-cc36-42a3-9b13-00ad6d2d2251 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:37.847032 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b904954-7c6d-4e57-9483-bc82524f3e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:37.847654 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b904954-7c6d-4e57-9483-bc82524f3e29 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:37.847935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b904954-7c6d-4e57-9483-bc82524f3e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:37.848196 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b904954-7c6d-4e57-9483-bc82524f3e29 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:37.848818 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b904954-7c6d-4e57-9483-bc82524f3e29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:37.850752 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b904954-7c6d-4e57-9483-bc82524f3e29 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:37.877303 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1365/2713] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:38:37 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:38:37.881620 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21d476-39b2-4308-9912-9d7d55f4aea7 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:37.892779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21d476-39b2-4308-9912-9d7d55f4aea7 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:37.897887 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a1725-57d4-43ef-8324-7b99c716a3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:37.898489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a1725-57d4-43ef-8324-7b99c716a3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:37.898764 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a1725-57d4-43ef-8324-7b99c716a3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:37.899075 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a1725-57d4-43ef-8324-7b99c716a3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:37.899744 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a1725-57d4-43ef-8324-7b99c716a3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:37.901380 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a1725-57d4-43ef-8324-7b99c716a3d3 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:37.911888 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1349/2714] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:38:37.916006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b904954-7c6d-4e57-9483-bc82524f3e29 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:37.926630 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b904954-7c6d-4e57-9483-bc82524f3e29 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:37.932291 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35484783-801e-4f4f-9c60-31729ad1081a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:37.933112 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35484783-801e-4f4f-9c60-31729ad1081a admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:37.933390 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35484783-801e-4f4f-9c60-31729ad1081a admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:37.933656 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35484783-801e-4f4f-9c60-31729ad1081a admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:37.934292 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35484783-801e-4f4f-9c60-31729ad1081a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:37.935990 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35484783-801e-4f4f-9c60-31729ad1081a admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:37.948001 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1366/2715] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:37.953546 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a1725-57d4-43ef-8324-7b99c716a3d3 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:37.964450 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a1725-57d4-43ef-8324-7b99c716a3d3 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:37.970226 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c9f3a-40eb-4cb1-998f-2bdef9f0b223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:37.970910 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c9f3a-40eb-4cb1-998f-2bdef9f0b223 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:37.971186 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c9f3a-40eb-4cb1-998f-2bdef9f0b223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:37.971453 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c9f3a-40eb-4cb1-998f-2bdef9f0b223 admin admin] PATH_INFO: `/v3/projects/eaf0dd1a6e174dd3bb6ab07e050fa5be/users/e32c3c752a8842338cdf6ce9e6d08946/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:37.998823 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c9f3a-40eb-4cb1-998f-2bdef9f0b223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaf0dd1a6e174dd3bb6ab07e050fa5be, user_id=e32c3c752a8842338cdf6ce9e6d08946, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:38.001698 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c9f3a-40eb-4cb1-998f-2bdef9f0b223 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:38.024743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1350/2716] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:37 2022] PUT /identity/v3/projects/eaf0dd1a6e174dd3bb6ab07e050fa5be/users/e32c3c752a8842338cdf6ce9e6d08946/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:38.028102 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7732ded-4511-48b8-8d46-e4db465f8834 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:38.028647 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7732ded-4511-48b8-8d46-e4db465f8834 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:38.028928 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7732ded-4511-48b8-8d46-e4db465f8834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:38.059370 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-c7732ded-4511-48b8-8d46-e4db465f8834 None None] MFA Rules not processed for user `e32c3c752a8842338cdf6ce9e6d08946`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:38.060848 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-c7732ded-4511-48b8-8d46-e4db465f8834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:38.131242 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1367/2717] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:38:38.143445 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c9f3a-40eb-4cb1-998f-2bdef9f0b223 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:38.145254 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-7e4c9f3a-40eb-4cb1-998f-2bdef9f0b223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:38.168667 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:38.210525 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c9f3a-40eb-4cb1-998f-2bdef9f0b223 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:38.217661 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921e724-06d0-419b-a691-58983a2e478d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:38.218737 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921e724-06d0-419b-a691-58983a2e478d service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:38.219112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921e724-06d0-419b-a691-58983a2e478d service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:38.219425 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921e724-06d0-419b-a691-58983a2e478d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:38.243556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921e724-06d0-419b-a691-58983a2e478d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:38.244962 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921e724-06d0-419b-a691-58983a2e478d service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:38.255730 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1351/2718] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:38:40.794480 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7732ded-4511-48b8-8d46-e4db465f8834 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:40.795977 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-c7732ded-4511-48b8-8d46-e4db465f8834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:40.832998 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:40.870599 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7732ded-4511-48b8-8d46-e4db465f8834 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:40.876018 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774775d6-6ac6-4fd9-9b67-e8a05c29a824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:40.876663 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774775d6-6ac6-4fd9-9b67-e8a05c29a824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:40.876941 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774775d6-6ac6-4fd9-9b67-e8a05c29a824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:40.877211 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774775d6-6ac6-4fd9-9b67-e8a05c29a824 admin admin] PATH_INFO: `/v3/users/d984cf60d3254f46ab9b82a4346c39e5` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:40.878451 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774775d6-6ac6-4fd9-9b67-e8a05c29a824 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d984cf60d3254f46ab9b82a4346c39e5)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:40.880495 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774775d6-6ac6-4fd9-9b67-e8a05c29a824 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:40.931134 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-774775d6-6ac6-4fd9-9b67-e8a05c29a824 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd984cf60d3254f46ab9b82a4346c39e5'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:40.931791 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-774775d6-6ac6-4fd9-9b67-e8a05c29a824 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd984cf60d3254f46ab9b82a4346c39e5'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:40.939361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-774775d6-6ac6-4fd9-9b67-e8a05c29a824 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd984cf60d3254f46ab9b82a4346c39e5'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:40.948513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-774775d6-6ac6-4fd9-9b67-e8a05c29a824 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd984cf60d3254f46ab9b82a4346c39e5'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:40.949161 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-774775d6-6ac6-4fd9-9b67-e8a05c29a824 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd984cf60d3254f46ab9b82a4346c39e5'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:40.966711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1368/2719] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:38:40 2022] DELETE /identity/v3/users/d984cf60d3254f46ab9b82a4346c39e5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:40.971469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548f6c5-35ab-44dd-8cfe-54a8b41e4030 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:40.971962 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548f6c5-35ab-44dd-8cfe-54a8b41e4030 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:40.971962 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548f6c5-35ab-44dd-8cfe-54a8b41e4030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:40.991533 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-7548f6c5-35ab-44dd-8cfe-54a8b41e4030 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:40.992753 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-7548f6c5-35ab-44dd-8cfe-54a8b41e4030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:41.054158 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1352/2720] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:41.065533 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774775d6-6ac6-4fd9-9b67-e8a05c29a824 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:41.067328 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-774775d6-6ac6-4fd9-9b67-e8a05c29a824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:41.127631 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774775d6-6ac6-4fd9-9b67-e8a05c29a824 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:41.131313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6ae46-da6b-4f58-afd4-7a2a1da02477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:41.131950 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6ae46-da6b-4f58-afd4-7a2a1da02477 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:41.132206 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6ae46-da6b-4f58-afd4-7a2a1da02477 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:41.132491 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6ae46-da6b-4f58-afd4-7a2a1da02477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:41.142020 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6ae46-da6b-4f58-afd4-7a2a1da02477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:41.143512 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6ae46-da6b-4f58-afd4-7a2a1da02477 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:41.153717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1369/2721] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:38:41.337053 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548f6c5-35ab-44dd-8cfe-54a8b41e4030 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:41.338682 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-7548f6c5-35ab-44dd-8cfe-54a8b41e4030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:41.352330 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548f6c5-35ab-44dd-8cfe-54a8b41e4030 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:41.357671 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a086e88-c4b1-459e-8056-19534d32b1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:41.358348 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a086e88-c4b1-459e-8056-19534d32b1cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:41.358886 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a086e88-c4b1-459e-8056-19534d32b1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:41.359059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a086e88-c4b1-459e-8056-19534d32b1cd admin admin] PATH_INFO: `/v3/users/e32c3c752a8842338cdf6ce9e6d08946` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:41.360181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a086e88-c4b1-459e-8056-19534d32b1cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e32c3c752a8842338cdf6ce9e6d08946)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:41.362476 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a086e88-c4b1-459e-8056-19534d32b1cd admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:41.412889 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-6a086e88-c4b1-459e-8056-19534d32b1cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e32c3c752a8842338cdf6ce9e6d08946'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:41.413618 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-6a086e88-c4b1-459e-8056-19534d32b1cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e32c3c752a8842338cdf6ce9e6d08946'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:41.421254 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-6a086e88-c4b1-459e-8056-19534d32b1cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e32c3c752a8842338cdf6ce9e6d08946'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:41.422062 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-6a086e88-c4b1-459e-8056-19534d32b1cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e32c3c752a8842338cdf6ce9e6d08946'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:41.429819 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-6a086e88-c4b1-459e-8056-19534d32b1cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e32c3c752a8842338cdf6ce9e6d08946'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:41.431455 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6ae46-da6b-4f58-afd4-7a2a1da02477 service neutron] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:41.433133 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-f2c6ae46-da6b-4f58-afd4-7a2a1da02477 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:41.447325 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6ae46-da6b-4f58-afd4-7a2a1da02477 service neutron] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:41.452340 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee297b-bd94-4227-a133-f7c15391ea23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:41.452891 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1353/2722] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:38:41 2022] DELETE /identity/v3/users/e32c3c752a8842338cdf6ce9e6d08946 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:41.453039 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee297b-bd94-4227-a133-f7c15391ea23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:41.453275 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee297b-bd94-4227-a133-f7c15391ea23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:41.453545 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee297b-bd94-4227-a133-f7c15391ea23 admin admin] PATH_INFO: `/v3/projects/1e39d22f0215451280646ad32a33bdb6` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:41.454696 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee297b-bd94-4227-a133-f7c15391ea23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e39d22f0215451280646ad32a33bdb6)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:41.456807 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee297b-bd94-4227-a133-f7c15391ea23 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:41.458120 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99594fc-e2af-441d-a4d9-98960afc0202 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:41.458508 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99594fc-e2af-441d-a4d9-98960afc0202 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:41.458803 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99594fc-e2af-441d-a4d9-98960afc0202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:41.479319 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-a99594fc-e2af-441d-a4d9-98960afc0202 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:41.480520 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a99594fc-e2af-441d-a4d9-98960afc0202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:41.504247 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-a0ee297b-bd94-4227-a133-f7c15391ea23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e39d22f0215451280646ad32a33bdb6', 'request_id': 'req-a0ee297b-bd94-4227-a133-f7c15391ea23'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:41.511318 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:41.513339 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:41.523267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-a0ee297b-bd94-4227-a133-f7c15391ea23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e39d22f0215451280646ad32a33bdb6', 'request_id': 'req-a0ee297b-bd94-4227-a133-f7c15391ea23'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:41.533789 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-a0ee297b-bd94-4227-a133-f7c15391ea23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e39d22f0215451280646ad32a33bdb6', 'request_id': 'req-a0ee297b-bd94-4227-a133-f7c15391ea23'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:41.546068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-a0ee297b-bd94-4227-a133-f7c15391ea23 admin admin] The token cache is being invalidate because project 1e39d22f0215451280646ad32a33bdb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:38:41.546352 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-a0ee297b-bd94-4227-a133-f7c15391ea23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:41.547031 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-a0ee297b-bd94-4227-a133-f7c15391ea23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:41.550781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1354/2724] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:41.551066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1370/2724] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:38:41 2022] DELETE /identity/v3/projects/1e39d22f0215451280646ad32a33bdb6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:38:41.552837 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99594fc-e2af-441d-a4d9-98960afc0202 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:41.554663 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a99594fc-e2af-441d-a4d9-98960afc0202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:41.562514 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee297b-bd94-4227-a133-f7c15391ea23 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:41.564049 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-a0ee297b-bd94-4227-a133-f7c15391ea23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:41.567757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99594fc-e2af-441d-a4d9-98960afc0202 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:41.637031 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6e46a-bf3c-4083-93c3-2840f909a1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:41.637903 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6e46a-bf3c-4083-93c3-2840f909a1d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:41.638176 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6e46a-bf3c-4083-93c3-2840f909a1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:41.638464 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6e46a-bf3c-4083-93c3-2840f909a1d7 admin admin] PATH_INFO: `/v3/users/f8a310d612bd4c4f9754d66bb569097c` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:41.639843 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6e46a-bf3c-4083-93c3-2840f909a1d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8a310d612bd4c4f9754d66bb569097c)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:41.640368 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee297b-bd94-4227-a133-f7c15391ea23 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:41.641930 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6e46a-bf3c-4083-93c3-2840f909a1d7 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:41.644562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754cc36-5e58-4f18-81da-7736df095a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:41.644876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754cc36-5e58-4f18-81da-7736df095a7d service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:41.645228 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754cc36-5e58-4f18-81da-7736df095a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:41.645532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754cc36-5e58-4f18-81da-7736df095a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:41.647457 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-0754cc36-5e58-4f18-81da-7736df095a7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:41.667158 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754cc36-5e58-4f18-81da-7736df095a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:41.668894 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754cc36-5e58-4f18-81da-7736df095a7d service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:41.680507 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1371/2725] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:38:41.696262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-2cd6e46a-bf3c-4083-93c3-2840f909a1d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8a310d612bd4c4f9754d66bb569097c'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:41.697476 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-2cd6e46a-bf3c-4083-93c3-2840f909a1d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8a310d612bd4c4f9754d66bb569097c'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:41.708828 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-2cd6e46a-bf3c-4083-93c3-2840f909a1d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8a310d612bd4c4f9754d66bb569097c'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:41.709650 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-2cd6e46a-bf3c-4083-93c3-2840f909a1d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8a310d612bd4c4f9754d66bb569097c'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:41.719262 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-2cd6e46a-bf3c-4083-93c3-2840f909a1d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8a310d612bd4c4f9754d66bb569097c'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:41.739998 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1355/2726] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:38:41 2022] DELETE /identity/v3/users/f8a310d612bd4c4f9754d66bb569097c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:38:41.981542 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754cc36-5e58-4f18-81da-7736df095a7d service neutron] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:41.983477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-0754cc36-5e58-4f18-81da-7736df095a7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:42.004827 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754cc36-5e58-4f18-81da-7736df095a7d service neutron] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:42.068478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6e46a-bf3c-4083-93c3-2840f909a1d7 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:42.070910 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-2cd6e46a-bf3c-4083-93c3-2840f909a1d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:42.089792 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15ea97-8edb-4248-ad3e-75855d697563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:42.090447 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15ea97-8edb-4248-ad3e-75855d697563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:42.090723 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15ea97-8edb-4248-ad3e-75855d697563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:42.091068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15ea97-8edb-4248-ad3e-75855d697563 admin admin] PATH_INFO: `/v3/projects/eaf0dd1a6e174dd3bb6ab07e050fa5be` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:42.092859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15ea97-8edb-4248-ad3e-75855d697563 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaf0dd1a6e174dd3bb6ab07e050fa5be)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:42.095214 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15ea97-8edb-4248-ad3e-75855d697563 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:42.174475 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:42.183813 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6e46a-bf3c-4083-93c3-2840f909a1d7 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:42.202829 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-ac15ea97-8edb-4248-ad3e-75855d697563 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaf0dd1a6e174dd3bb6ab07e050fa5be', 'request_id': 'req-ac15ea97-8edb-4248-ad3e-75855d697563'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:42.213643 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-ac15ea97-8edb-4248-ad3e-75855d697563 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaf0dd1a6e174dd3bb6ab07e050fa5be', 'request_id': 'req-ac15ea97-8edb-4248-ad3e-75855d697563'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:42.225465 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-ac15ea97-8edb-4248-ad3e-75855d697563 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaf0dd1a6e174dd3bb6ab07e050fa5be', 'request_id': 'req-ac15ea97-8edb-4248-ad3e-75855d697563'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:42.244209 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-ac15ea97-8edb-4248-ad3e-75855d697563 admin admin] The token cache is being invalidate because project eaf0dd1a6e174dd3bb6ab07e050fa5be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:38:42.244499 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-ac15ea97-8edb-4248-ad3e-75855d697563 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:42.245538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-ac15ea97-8edb-4248-ad3e-75855d697563 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:42.248094 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1372/2727] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:38:41 2022] DELETE /identity/v3/projects/eaf0dd1a6e174dd3bb6ab07e050fa5be => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:42.253058 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656beeb-3534-4824-8292-2440a19a4ede None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:42.253420 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656beeb-3534-4824-8292-2440a19a4ede None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:42.253748 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656beeb-3534-4824-8292-2440a19a4ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:42.277155 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-4656beeb-3534-4824-8292-2440a19a4ede None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:42.278471 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-4656beeb-3534-4824-8292-2440a19a4ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:42.285830 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:42.291227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d186b07-6934-4064-90ca-5acdf31dcf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:42.291966 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d186b07-6934-4064-90ca-5acdf31dcf62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:42.292694 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d186b07-6934-4064-90ca-5acdf31dcf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:42.292694 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d186b07-6934-4064-90ca-5acdf31dcf62 admin admin] PATH_INFO: `/v3/projects/ff4f227d0320432fa4955b9e68819811` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:42.294009 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d186b07-6934-4064-90ca-5acdf31dcf62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff4f227d0320432fa4955b9e68819811)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:42.296311 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d186b07-6934-4064-90ca-5acdf31dcf62 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:42.355016 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1373/2728] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:38:42.355190 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-3d186b07-6934-4064-90ca-5acdf31dcf62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff4f227d0320432fa4955b9e68819811', 'request_id': 'req-3d186b07-6934-4064-90ca-5acdf31dcf62'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:42.357558 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc2957-92a6-4f0f-a1d2-f12d5631f963 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:42.357705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc2957-92a6-4f0f-a1d2-f12d5631f963 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:42.358109 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc2957-92a6-4f0f-a1d2-f12d5631f963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:42.362185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-3d186b07-6934-4064-90ca-5acdf31dcf62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff4f227d0320432fa4955b9e68819811', 'request_id': 'req-3d186b07-6934-4064-90ca-5acdf31dcf62'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:42.369021 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-3d186b07-6934-4064-90ca-5acdf31dcf62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff4f227d0320432fa4955b9e68819811', 'request_id': 'req-3d186b07-6934-4064-90ca-5acdf31dcf62'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:42.382204 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-31cc2957-92a6-4f0f-a1d2-f12d5631f963 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:42.382439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-3d186b07-6934-4064-90ca-5acdf31dcf62 admin admin] The token cache is being invalidate because project ff4f227d0320432fa4955b9e68819811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:38:42.382789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-3d186b07-6934-4064-90ca-5acdf31dcf62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:42.383696 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-3d186b07-6934-4064-90ca-5acdf31dcf62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:42.385114 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-31cc2957-92a6-4f0f-a1d2-f12d5631f963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:42.386032 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1356/2729] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:38:42 2022] DELETE /identity/v3/projects/ff4f227d0320432fa4955b9e68819811 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:42.390056 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d186b07-6934-4064-90ca-5acdf31dcf62 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:42.391427 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-3d186b07-6934-4064-90ca-5acdf31dcf62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:42.456898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1374/2730] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:38:42.461758 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc2957-92a6-4f0f-a1d2-f12d5631f963 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:42.462094 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d186b07-6934-4064-90ca-5acdf31dcf62 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:42.467851 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ad671-5066-409f-beb4-9e8b63720531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:42.468376 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ad671-5066-409f-beb4-9e8b63720531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:42.468645 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ad671-5066-409f-beb4-9e8b63720531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:42.468916 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ad671-5066-409f-beb4-9e8b63720531 admin admin] PATH_INFO: `/v3/users/b9a7bd92c4f04b15b1903c6f7e35db21` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:42.470079 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ad671-5066-409f-beb4-9e8b63720531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9a7bd92c4f04b15b1903c6f7e35db21)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:42.472184 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ad671-5066-409f-beb4-9e8b63720531 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:42.472478 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc2957-92a6-4f0f-a1d2-f12d5631f963 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:42.477183 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd577064-abd9-46b3-91db-10005b45a9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:42.477788 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd577064-abd9-46b3-91db-10005b45a9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:42.478066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd577064-abd9-46b3-91db-10005b45a9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:42.478334 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd577064-abd9-46b3-91db-10005b45a9e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:42.478996 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd577064-abd9-46b3-91db-10005b45a9e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:38:42.479301 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd577064-abd9-46b3-91db-10005b45a9e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:42.480964 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd577064-abd9-46b3-91db-10005b45a9e4 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:42.493767 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1375/2731] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:38:42.498560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd577064-abd9-46b3-91db-10005b45a9e4 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:42.509930 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd577064-abd9-46b3-91db-10005b45a9e4 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:42.513559 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:42.522046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b6d95-78d0-4091-9396-cbcffa5b3d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:42.523479 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b6d95-78d0-4091-9396-cbcffa5b3d91 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:42.523952 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b6d95-78d0-4091-9396-cbcffa5b3d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:42.524414 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b60ad671-5066-409f-beb4-9e8b63720531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9a7bd92c4f04b15b1903c6f7e35db21'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:42.524705 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b6d95-78d0-4091-9396-cbcffa5b3d91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:42.525278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b60ad671-5066-409f-beb4-9e8b63720531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9a7bd92c4f04b15b1903c6f7e35db21'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:42.525810 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b6d95-78d0-4091-9396-cbcffa5b3d91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:42.527866 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b6d95-78d0-4091-9396-cbcffa5b3d91 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:42.533922 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b60ad671-5066-409f-beb4-9e8b63720531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9a7bd92c4f04b15b1903c6f7e35db21'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:42.536391 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b60ad671-5066-409f-beb4-9e8b63720531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9a7bd92c4f04b15b1903c6f7e35db21'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:42.546498 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b60ad671-5066-409f-beb4-9e8b63720531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9a7bd92c4f04b15b1903c6f7e35db21'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:42.568663 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1357/2732] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:38:42 2022] DELETE /identity/v3/users/b9a7bd92c4f04b15b1903c6f7e35db21 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:38:42.569449 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1376/2733] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:38:42 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:38:42.570443 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ad671-5066-409f-beb4-9e8b63720531 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:42.572043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-b60ad671-5066-409f-beb4-9e8b63720531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:42.668584 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ad671-5066-409f-beb4-9e8b63720531 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:42.673983 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d37a63-fdb0-4921-8bfa-bcd6ec757399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:42.674722 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d37a63-fdb0-4921-8bfa-bcd6ec757399 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:42.675021 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d37a63-fdb0-4921-8bfa-bcd6ec757399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:42.675365 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d37a63-fdb0-4921-8bfa-bcd6ec757399 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:42.676638 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d37a63-fdb0-4921-8bfa-bcd6ec757399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:42.678738 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d37a63-fdb0-4921-8bfa-bcd6ec757399 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:42.706087 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1358/2734] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:38:42 2022] POST /identity/v3/users => generated 287 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:38:42.708481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b6d95-78d0-4091-9396-cbcffa5b3d91 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:42.787840 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b6d95-78d0-4091-9396-cbcffa5b3d91 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:42.794379 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a4d51-6b26-478d-b615-a901e9cb1ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:42.795117 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a4d51-6b26-478d-b615-a901e9cb1ead admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:42.795467 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a4d51-6b26-478d-b615-a901e9cb1ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:42.795806 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a4d51-6b26-478d-b615-a901e9cb1ead admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:42.796855 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a4d51-6b26-478d-b615-a901e9cb1ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:42.798522 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a4d51-6b26-478d-b615-a901e9cb1ead admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:42.811427 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1377/2735] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:42.814686 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d37a63-fdb0-4921-8bfa-bcd6ec757399 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:42.826441 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d37a63-fdb0-4921-8bfa-bcd6ec757399 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:42.831779 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc4d7e-749e-486c-b24f-bbb46fe8d189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:42.833128 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc4d7e-749e-486c-b24f-bbb46fe8d189 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:42.833532 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc4d7e-749e-486c-b24f-bbb46fe8d189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:42.833813 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc4d7e-749e-486c-b24f-bbb46fe8d189 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:42.834570 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc4d7e-749e-486c-b24f-bbb46fe8d189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:42.836304 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc4d7e-749e-486c-b24f-bbb46fe8d189 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:42.849286 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1359/2736] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:38:42.853301 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a4d51-6b26-478d-b615-a901e9cb1ead admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:42.867534 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a4d51-6b26-478d-b615-a901e9cb1ead admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:42.876683 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30de3b-ab4f-405a-9dc6-7ab071b61818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:42.877879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30de3b-ab4f-405a-9dc6-7ab071b61818 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:42.878205 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30de3b-ab4f-405a-9dc6-7ab071b61818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:42.878566 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30de3b-ab4f-405a-9dc6-7ab071b61818 admin admin] PATH_INFO: `/v3/projects/ba0a2cd7baf44facae56f8967c574a4f/users/e7140703f2114c0ab5a2e897ae804d1f/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:42.895992 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:42.900088 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db30de3b-ab4f-405a-9dc6-7ab071b61818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba0a2cd7baf44facae56f8967c574a4f, user_id=e7140703f2114c0ab5a2e897ae804d1f, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:42.903404 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db30de3b-ab4f-405a-9dc6-7ab071b61818 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:42.921726 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1378/2737] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:38:42 2022] PUT /identity/v3/projects/ba0a2cd7baf44facae56f8967c574a4f/users/e7140703f2114c0ab5a2e897ae804d1f/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:38:42.932993 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd85a4-284e-4bb5-b806-03aa6e4a6831 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:42.933501 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd85a4-284e-4bb5-b806-03aa6e4a6831 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:42.933773 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd85a4-284e-4bb5-b806-03aa6e4a6831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:42.965163 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-7cdd85a4-284e-4bb5-b806-03aa6e4a6831 None None] MFA Rules not processed for user `e7140703f2114c0ab5a2e897ae804d1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:42.966639 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-7cdd85a4-284e-4bb5-b806-03aa6e4a6831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:42.969376 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30de3b-ab4f-405a-9dc6-7ab071b61818 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:42.971352 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-db30de3b-ab4f-405a-9dc6-7ab071b61818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:43.046642 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30de3b-ab4f-405a-9dc6-7ab071b61818 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:43.054628 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34c99c-8aba-4501-a144-0dc1eda141e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:43.055447 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34c99c-8aba-4501-a144-0dc1eda141e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:43.062541 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34c99c-8aba-4501-a144-0dc1eda141e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:43.063295 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1360/2738] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:43.066661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34c99c-8aba-4501-a144-0dc1eda141e7 admin admin] PATH_INFO: `/v3/projects/2c2c64a65d914318b6a6c30c61d84ec1` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:43.071383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34c99c-8aba-4501-a144-0dc1eda141e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c2c64a65d914318b6a6c30c61d84ec1)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:43.073450 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34c99c-8aba-4501-a144-0dc1eda141e7 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:43.075027 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd85a4-284e-4bb5-b806-03aa6e4a6831 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:43.076568 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-7cdd85a4-284e-4bb5-b806-03aa6e4a6831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:43.112481 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:43.128870 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3e34c99c-8aba-4501-a144-0dc1eda141e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c2c64a65d914318b6a6c30c61d84ec1', 'request_id': 'req-3e34c99c-8aba-4501-a144-0dc1eda141e7'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:43.138531 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3e34c99c-8aba-4501-a144-0dc1eda141e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c2c64a65d914318b6a6c30c61d84ec1', 'request_id': 'req-3e34c99c-8aba-4501-a144-0dc1eda141e7'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:43.145756 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3e34c99c-8aba-4501-a144-0dc1eda141e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c2c64a65d914318b6a6c30c61d84ec1', 'request_id': 'req-3e34c99c-8aba-4501-a144-0dc1eda141e7'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:43.157947 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd85a4-284e-4bb5-b806-03aa6e4a6831 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:43.158359 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3e34c99c-8aba-4501-a144-0dc1eda141e7 admin admin] The token cache is being invalidate because project 2c2c64a65d914318b6a6c30c61d84ec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:38:43.158621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3e34c99c-8aba-4501-a144-0dc1eda141e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:43.159316 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-3e34c99c-8aba-4501-a144-0dc1eda141e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:43.161150 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1379/2739] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:38:42 2022] DELETE /identity/v3/projects/2c2c64a65d914318b6a6c30c61d84ec1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:38:43.237869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e8c81-86b6-4e46-8038-c90c0f8593d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:43.238646 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e8c81-86b6-4e46-8038-c90c0f8593d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:43.239049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e8c81-86b6-4e46-8038-c90c0f8593d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:43.239465 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e8c81-86b6-4e46-8038-c90c0f8593d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:43.243129 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-fd0e8c81-86b6-4e46-8038-c90c0f8593d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:43.316640 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e8c81-86b6-4e46-8038-c90c0f8593d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:43.318174 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e8c81-86b6-4e46-8038-c90c0f8593d0 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:43.328509 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1361/2740] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:38:44.968782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b18d4f-a410-410e-b526-b9622ebb54db None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:44.969278 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b18d4f-a410-410e-b526-b9622ebb54db None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:44.969689 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b18d4f-a410-410e-b526-b9622ebb54db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:44.991434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-51b18d4f-a410-410e-b526-b9622ebb54db None None] MFA Rules not processed for user `05cfc9d62a244701a5df524d1c26f107`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:44.992907 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-51b18d4f-a410-410e-b526-b9622ebb54db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:45.056631 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1380/2741] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Oct 4 16:38:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:45.073111 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e8c81-86b6-4e46-8038-c90c0f8593d0 service cinder] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:45.073111 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-fd0e8c81-86b6-4e46-8038-c90c0f8593d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:45.150449 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e8c81-86b6-4e46-8038-c90c0f8593d0 service cinder] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:45.156220 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645a022-a0c7-4ac0-a615-d91f861bd7ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6590cb6c1c964039b9dea771a647bdac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:45.156828 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645a022-a0c7-4ac0-a615-d91f861bd7ce service swift] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:45.157107 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645a022-a0c7-4ac0-a615-d91f861bd7ce service swift] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:45.157376 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645a022-a0c7-4ac0-a615-d91f861bd7ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:45.165859 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645a022-a0c7-4ac0-a615-d91f861bd7ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:45.167483 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645a022-a0c7-4ac0-a615-d91f861bd7ce service swift] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:45.175879 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1362/2742] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Oct 4 16:38:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 16:38:49.838132 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b18d4f-a410-410e-b526-b9622ebb54db None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:49.839734 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-51b18d4f-a410-410e-b526-b9622ebb54db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:49.917889 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:50.063396 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b18d4f-a410-410e-b526-b9622ebb54db None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:50.084474 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e666a2-8aa2-4c27-a2e4-94cd2332b594 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:50.087340 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e666a2-8aa2-4c27-a2e4-94cd2332b594 service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:50.088229 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e666a2-8aa2-4c27-a2e4-94cd2332b594 service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:50.089483 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e666a2-8aa2-4c27-a2e4-94cd2332b594 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:50.100159 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-87e666a2-8aa2-4c27-a2e4-94cd2332b594 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:50.136119 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e666a2-8aa2-4c27-a2e4-94cd2332b594 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:50.138435 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e666a2-8aa2-4c27-a2e4-94cd2332b594 service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:50.168967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1381/2743] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:38:54.291245 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645a022-a0c7-4ac0-a615-d91f861bd7ce service swift] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:54.292927 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-0645a022-a0c7-4ac0-a615-d91f861bd7ce service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:54.316653 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:38:54.361358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645a022-a0c7-4ac0-a615-d91f861bd7ce service swift] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:54.366736 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2314ba5-614c-42b7-969d-01d4844c0384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:54.367349 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2314ba5-614c-42b7-969d-01d4844c0384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:54.367601 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2314ba5-614c-42b7-969d-01d4844c0384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:54.367903 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2314ba5-614c-42b7-969d-01d4844c0384 admin admin] PATH_INFO: `/v3/users/e7140703f2114c0ab5a2e897ae804d1f` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:54.369059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2314ba5-614c-42b7-969d-01d4844c0384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7140703f2114c0ab5a2e897ae804d1f)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:54.371026 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2314ba5-614c-42b7-969d-01d4844c0384 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:54.425060 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f2314ba5-614c-42b7-969d-01d4844c0384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7140703f2114c0ab5a2e897ae804d1f'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:54.425590 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f2314ba5-614c-42b7-969d-01d4844c0384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7140703f2114c0ab5a2e897ae804d1f'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:54.433854 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f2314ba5-614c-42b7-969d-01d4844c0384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7140703f2114c0ab5a2e897ae804d1f'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:54.434582 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f2314ba5-614c-42b7-969d-01d4844c0384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7140703f2114c0ab5a2e897ae804d1f'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:54.445016 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f2314ba5-614c-42b7-969d-01d4844c0384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7140703f2114c0ab5a2e897ae804d1f'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:54.464775 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1363/2744] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:38:54 2022] DELETE /identity/v3/users/e7140703f2114c0ab5a2e897ae804d1f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:38:54.469644 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e1c87-2020-44e7-bc20-342e3bd52c66 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:54.470179 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e1c87-2020-44e7-bc20-342e3bd52c66 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:54.470350 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e1c87-2020-44e7-bc20-342e3bd52c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:54.489380 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-318e1c87-2020-44e7-bc20-342e3bd52c66 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:38:54.490679 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-318e1c87-2020-44e7-bc20-342e3bd52c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:54.551860 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1382/2745] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:38:54.561895 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2314ba5-614c-42b7-969d-01d4844c0384 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:54.563461 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f2314ba5-614c-42b7-969d-01d4844c0384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:54.626965 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2314ba5-614c-42b7-969d-01d4844c0384 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:54.630825 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0f5f0-f0fa-4304-a9c2-71b83cb2598a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:54.631484 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0f5f0-f0fa-4304-a9c2-71b83cb2598a service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:54.631764 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0f5f0-f0fa-4304-a9c2-71b83cb2598a service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:54.632033 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0f5f0-f0fa-4304-a9c2-71b83cb2598a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:54.641918 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0f5f0-f0fa-4304-a9c2-71b83cb2598a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:54.643525 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0f5f0-f0fa-4304-a9c2-71b83cb2598a service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:54.653076 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1364/2746] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:38:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:38:55.052845 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e1c87-2020-44e7-bc20-342e3bd52c66 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:38:55.054379 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-318e1c87-2020-44e7-bc20-342e3bd52c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:38:55.074720 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e1c87-2020-44e7-bc20-342e3bd52c66 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:38:55.079885 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf6380-56b0-4265-a4ae-b4c359a69ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:38:55.080449 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf6380-56b0-4265-a4ae-b4c359a69ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:38:55.080728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf6380-56b0-4265-a4ae-b4c359a69ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:38:55.080999 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf6380-56b0-4265-a4ae-b4c359a69ca2 admin admin] PATH_INFO: `/v3/projects/ba0a2cd7baf44facae56f8967c574a4f` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:38:55.082116 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf6380-56b0-4265-a4ae-b4c359a69ca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba0a2cd7baf44facae56f8967c574a4f)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:38:55.084073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf6380-56b0-4265-a4ae-b4c359a69ca2 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:38:55.133120 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8ecf6380-56b0-4265-a4ae-b4c359a69ca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba0a2cd7baf44facae56f8967c574a4f', 'request_id': 'req-8ecf6380-56b0-4265-a4ae-b4c359a69ca2'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:55.141777 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8ecf6380-56b0-4265-a4ae-b4c359a69ca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba0a2cd7baf44facae56f8967c574a4f', 'request_id': 'req-8ecf6380-56b0-4265-a4ae-b4c359a69ca2'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:55.148607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8ecf6380-56b0-4265-a4ae-b4c359a69ca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba0a2cd7baf44facae56f8967c574a4f', 'request_id': 'req-8ecf6380-56b0-4265-a4ae-b4c359a69ca2'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:55.159533 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8ecf6380-56b0-4265-a4ae-b4c359a69ca2 admin admin] The token cache is being invalidate because project ba0a2cd7baf44facae56f8967c574a4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:38:55.159716 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8ecf6380-56b0-4265-a4ae-b4c359a69ca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:55.160379 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8ecf6380-56b0-4265-a4ae-b4c359a69ca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:38:55.162180 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1383/2747] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:38:55 2022] DELETE /identity/v3/projects/ba0a2cd7baf44facae56f8967c574a4f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:00.202588 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8c014-0109-47dc-935b-83d82363ffc1 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:00.203479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8c014-0109-47dc-935b-83d82363ffc1 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:00.203951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8c014-0109-47dc-935b-83d82363ffc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:00.225900 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-2dc8c014-0109-47dc-935b-83d82363ffc1 None None] MFA Rules not processed for user `05cfc9d62a244701a5df524d1c26f107`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:39:00.227104 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-2dc8c014-0109-47dc-935b-83d82363ffc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:00.266448 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:00.285151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1365/2748] 10.222.0.55 () {58 vars in 967 bytes} [Tue Oct 4 16:39:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:39:00.297994 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf6380-56b0-4265-a4ae-b4c359a69ca2 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:00.299622 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8ecf6380-56b0-4265-a4ae-b4c359a69ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:00.336517 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:00.372732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf6380-56b0-4265-a4ae-b4c359a69ca2 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:00.378304 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26750070-a393-4e4d-a7af-f537fc844c0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6590cb6c1c964039b9dea771a647bdac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:00.378936 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26750070-a393-4e4d-a7af-f537fc844c0a service swift] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:00.379275 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26750070-a393-4e4d-a7af-f537fc844c0a service swift] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:00.379543 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26750070-a393-4e4d-a7af-f537fc844c0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:00.389350 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26750070-a393-4e4d-a7af-f537fc844c0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:00.390958 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26750070-a393-4e4d-a7af-f537fc844c0a service swift] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:00.399291 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1384/2749] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Oct 4 16:39:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 16:39:01.582051 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42372a5d-5139-4ab8-b94c-19b0a37576a6 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:01.582051 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42372a5d-5139-4ab8-b94c-19b0a37576a6 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:01.582525 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42372a5d-5139-4ab8-b94c-19b0a37576a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:01.604000 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-42372a5d-5139-4ab8-b94c-19b0a37576a6 None None] MFA Rules not processed for user `05cfc9d62a244701a5df524d1c26f107`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:39:01.605230 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-42372a5d-5139-4ab8-b94c-19b0a37576a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:01.613296 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1366/2750] 10.222.0.55 () {58 vars in 967 bytes} [Tue Oct 4 16:39:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:39:01.626766 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26750070-a393-4e4d-a7af-f537fc844c0a service swift] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:01.637905 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26750070-a393-4e4d-a7af-f537fc844c0a service swift] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:01.643469 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800802e-8b39-401d-a0ff-42b92bad0464 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6590cb6c1c964039b9dea771a647bdac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:01.644071 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800802e-8b39-401d-a0ff-42b92bad0464 service swift] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:01.644339 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800802e-8b39-401d-a0ff-42b92bad0464 service swift] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:01.644603 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800802e-8b39-401d-a0ff-42b92bad0464 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:01.653283 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800802e-8b39-401d-a0ff-42b92bad0464 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:01.654895 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800802e-8b39-401d-a0ff-42b92bad0464 service swift] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:01.663539 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1385/2751] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Oct 4 16:39:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 16:39:05.209261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f8021-170a-445e-b292-3663a21e2c43 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:05.209781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f8021-170a-445e-b292-3663a21e2c43 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:05.209781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f8021-170a-445e-b292-3663a21e2c43 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:05.211241 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1367/2752] 10.222.0.55 () {54 vars in 961 bytes} [Tue Oct 4 16:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 16:39:05.216593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78dfbb-33bd-4e26-96b8-e6d3ecafef0a None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:05.217063 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78dfbb-33bd-4e26-96b8-e6d3ecafef0a None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:05.217182 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78dfbb-33bd-4e26-96b8-e6d3ecafef0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:05.244928 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-5d78dfbb-33bd-4e26-96b8-e6d3ecafef0a None None] MFA Rules not processed for user `8cd59eac06e347ee9432185b24fdf773`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:39:05.246313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-5d78dfbb-33bd-4e26-96b8-e6d3ecafef0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:05.322035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1386/2753] 10.222.0.55 () {58 vars in 1058 bytes} [Tue Oct 4 16:39:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:39:05.337356 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f8021-170a-445e-b292-3663a21e2c43 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:05.357902 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f8021-170a-445e-b292-3663a21e2c43 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:05.364577 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51461251-9c05-48b1-80b1-19d544399e08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd59eac06e347ee9432185b24fdf773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:05.365199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51461251-9c05-48b1-80b1-19d544399e08 service placement] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:05.365476 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51461251-9c05-48b1-80b1-19d544399e08 service placement] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:05.365748 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51461251-9c05-48b1-80b1-19d544399e08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:05.367708 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-51461251-9c05-48b1-80b1-19d544399e08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:05.380160 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51461251-9c05-48b1-80b1-19d544399e08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:05.381776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51461251-9c05-48b1-80b1-19d544399e08 service placement] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:05.392611 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1368/2754] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:39:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:39:09.245692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78dfbb-33bd-4e26-96b8-e6d3ecafef0a None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:09.247124 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-5d78dfbb-33bd-4e26-96b8-e6d3ecafef0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:09.329706 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78dfbb-33bd-4e26-96b8-e6d3ecafef0a None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:09.334455 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b5354-d1a5-4a65-acb6-613086155e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:09.335309 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b5354-d1a5-4a65-acb6-613086155e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:09.335542 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b5354-d1a5-4a65-acb6-613086155e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:09.335816 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b5354-d1a5-4a65-acb6-613086155e32 admin admin] PATH_INFO: `/v3/users/70addd8719414b8fbf716c9ddb40a3f1` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:09.337031 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b5354-d1a5-4a65-acb6-613086155e32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70addd8719414b8fbf716c9ddb40a3f1)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:09.339065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b5354-d1a5-4a65-acb6-613086155e32 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:09.396819 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5d6b5354-d1a5-4a65-acb6-613086155e32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70addd8719414b8fbf716c9ddb40a3f1'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:09.397600 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5d6b5354-d1a5-4a65-acb6-613086155e32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70addd8719414b8fbf716c9ddb40a3f1'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:09.399011 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:09.406478 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5d6b5354-d1a5-4a65-acb6-613086155e32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70addd8719414b8fbf716c9ddb40a3f1'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:09.415563 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5d6b5354-d1a5-4a65-acb6-613086155e32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70addd8719414b8fbf716c9ddb40a3f1'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:09.416439 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5d6b5354-d1a5-4a65-acb6-613086155e32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70addd8719414b8fbf716c9ddb40a3f1'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:09.439924 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1387/2755] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:39:09 2022] DELETE /identity/v3/users/70addd8719414b8fbf716c9ddb40a3f1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:09.617791 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51461251-9c05-48b1-80b1-19d544399e08 service placement] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:09.633565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51461251-9c05-48b1-80b1-19d544399e08 service placement] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:09.695731 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e64c38-32b7-410c-b523-5c4e4fdbcfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:09.696503 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e64c38-32b7-410c-b523-5c4e4fdbcfc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:09.696808 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e64c38-32b7-410c-b523-5c4e4fdbcfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:09.697084 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e64c38-32b7-410c-b523-5c4e4fdbcfc5 admin admin] PATH_INFO: `/v3/projects/fd884a22e2c94de098e1d52aafd45325` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:09.698259 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e64c38-32b7-410c-b523-5c4e4fdbcfc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd884a22e2c94de098e1d52aafd45325)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:09.700297 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e64c38-32b7-410c-b523-5c4e4fdbcfc5 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:09.752540 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-23e64c38-32b7-410c-b523-5c4e4fdbcfc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd884a22e2c94de098e1d52aafd45325', 'request_id': 'req-23e64c38-32b7-410c-b523-5c4e4fdbcfc5'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:09.761957 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-23e64c38-32b7-410c-b523-5c4e4fdbcfc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd884a22e2c94de098e1d52aafd45325', 'request_id': 'req-23e64c38-32b7-410c-b523-5c4e4fdbcfc5'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:09.768654 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-23e64c38-32b7-410c-b523-5c4e4fdbcfc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd884a22e2c94de098e1d52aafd45325', 'request_id': 'req-23e64c38-32b7-410c-b523-5c4e4fdbcfc5'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:09.779083 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-23e64c38-32b7-410c-b523-5c4e4fdbcfc5 admin admin] The token cache is being invalidate because project fd884a22e2c94de098e1d52aafd45325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:39:09.779370 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-23e64c38-32b7-410c-b523-5c4e4fdbcfc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:09.780027 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-23e64c38-32b7-410c-b523-5c4e4fdbcfc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:09.781516 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1369/2756] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:39:09 2022] DELETE /identity/v3/projects/fd884a22e2c94de098e1d52aafd45325 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:09.785525 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b5354-d1a5-4a65-acb6-613086155e32 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:09.787056 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-5d6b5354-d1a5-4a65-acb6-613086155e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:09.800636 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b5354-d1a5-4a65-acb6-613086155e32 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:09.858335 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e85d6-36a9-4700-8d6e-17c6e76dd0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:09.859010 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e85d6-36a9-4700-8d6e-17c6e76dd0c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:09.859293 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e85d6-36a9-4700-8d6e-17c6e76dd0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:09.859573 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e85d6-36a9-4700-8d6e-17c6e76dd0c4 admin admin] PATH_INFO: `/v3/users/bd740da23ba64cf98387882862570590` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:09.860745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e85d6-36a9-4700-8d6e-17c6e76dd0c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd740da23ba64cf98387882862570590)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:09.862673 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e85d6-36a9-4700-8d6e-17c6e76dd0c4 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:09.914419 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-ea1e85d6-36a9-4700-8d6e-17c6e76dd0c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd740da23ba64cf98387882862570590'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:09.914975 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-ea1e85d6-36a9-4700-8d6e-17c6e76dd0c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd740da23ba64cf98387882862570590'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:09.923402 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-ea1e85d6-36a9-4700-8d6e-17c6e76dd0c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd740da23ba64cf98387882862570590'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:09.932920 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-ea1e85d6-36a9-4700-8d6e-17c6e76dd0c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd740da23ba64cf98387882862570590'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:09.933628 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-ea1e85d6-36a9-4700-8d6e-17c6e76dd0c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd740da23ba64cf98387882862570590'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:09.951137 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1388/2757] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:39:09 2022] DELETE /identity/v3/users/bd740da23ba64cf98387882862570590 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:10.147231 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e64c38-32b7-410c-b523-5c4e4fdbcfc5 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:10.148678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-23e64c38-32b7-410c-b523-5c4e4fdbcfc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:10.163369 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e64c38-32b7-410c-b523-5c4e4fdbcfc5 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:10.238642 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:10.247135 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccf28d-7ad7-475a-a546-ac096cbd4efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:10.248057 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccf28d-7ad7-475a-a546-ac096cbd4efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:10.248421 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccf28d-7ad7-475a-a546-ac096cbd4efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:10.248755 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccf28d-7ad7-475a-a546-ac096cbd4efa admin admin] PATH_INFO: `/v3/projects/4c907df628484efb830eff997a2df727` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:10.250402 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ccf28d-7ad7-475a-a546-ac096cbd4efa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c907df628484efb830eff997a2df727)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:10.252756 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ccf28d-7ad7-475a-a546-ac096cbd4efa admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:10.305490 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b0ccf28d-7ad7-475a-a546-ac096cbd4efa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c907df628484efb830eff997a2df727', 'request_id': 'req-b0ccf28d-7ad7-475a-a546-ac096cbd4efa'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:10.314957 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b0ccf28d-7ad7-475a-a546-ac096cbd4efa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c907df628484efb830eff997a2df727', 'request_id': 'req-b0ccf28d-7ad7-475a-a546-ac096cbd4efa'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:10.322055 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b0ccf28d-7ad7-475a-a546-ac096cbd4efa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c907df628484efb830eff997a2df727', 'request_id': 'req-b0ccf28d-7ad7-475a-a546-ac096cbd4efa'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:10.333051 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b0ccf28d-7ad7-475a-a546-ac096cbd4efa admin admin] The token cache is being invalidate because project 4c907df628484efb830eff997a2df727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:39:10.333342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b0ccf28d-7ad7-475a-a546-ac096cbd4efa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:10.334037 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b0ccf28d-7ad7-475a-a546-ac096cbd4efa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:10.335612 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1370/2758] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:39:10 2022] DELETE /identity/v3/projects/4c907df628484efb830eff997a2df727 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:10.457151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e85d6-36a9-4700-8d6e-17c6e76dd0c4 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:10.458859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ea1e85d6-36a9-4700-8d6e-17c6e76dd0c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:10.509784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:10.523093 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e85d6-36a9-4700-8d6e-17c6e76dd0c4 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:10.584506 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8ed7d-1f3e-4aee-8c56-c3512bcf02b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:10.585183 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8ed7d-1f3e-4aee-8c56-c3512bcf02b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:10.585447 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8ed7d-1f3e-4aee-8c56-c3512bcf02b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:10.585711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8ed7d-1f3e-4aee-8c56-c3512bcf02b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:10.587572 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-56e8ed7d-1f3e-4aee-8c56-c3512bcf02b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:10.654134 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8ed7d-1f3e-4aee-8c56-c3512bcf02b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:10.655796 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8ed7d-1f3e-4aee-8c56-c3512bcf02b5 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:10.665949 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1389/2759] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:39:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:39:16.814063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccf28d-7ad7-475a-a546-ac096cbd4efa admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:16.815693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-b0ccf28d-7ad7-475a-a546-ac096cbd4efa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:16.831831 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccf28d-7ad7-475a-a546-ac096cbd4efa admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:16.836480 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee89eed-efef-487a-bddf-c580ecea4a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:16.837130 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee89eed-efef-487a-bddf-c580ecea4a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:16.837406 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee89eed-efef-487a-bddf-c580ecea4a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:16.837678 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee89eed-efef-487a-bddf-c580ecea4a70 admin admin] PATH_INFO: `/v3/users/a3cb278f27474c83ad2059bb3914fd5d` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:16.838807 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee89eed-efef-487a-bddf-c580ecea4a70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3cb278f27474c83ad2059bb3914fd5d)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:16.840793 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee89eed-efef-487a-bddf-c580ecea4a70 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:16.898177 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-6ee89eed-efef-487a-bddf-c580ecea4a70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3cb278f27474c83ad2059bb3914fd5d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:16.898835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-6ee89eed-efef-487a-bddf-c580ecea4a70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3cb278f27474c83ad2059bb3914fd5d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:16.905873 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-6ee89eed-efef-487a-bddf-c580ecea4a70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3cb278f27474c83ad2059bb3914fd5d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:16.906499 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-6ee89eed-efef-487a-bddf-c580ecea4a70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3cb278f27474c83ad2059bb3914fd5d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:16.915095 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-6ee89eed-efef-487a-bddf-c580ecea4a70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3cb278f27474c83ad2059bb3914fd5d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:16.932425 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1371/2760] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:39:16 2022] DELETE /identity/v3/users/a3cb278f27474c83ad2059bb3914fd5d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:17.114023 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8ed7d-1f3e-4aee-8c56-c3512bcf02b5 service neutron] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:17.126405 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8ed7d-1f3e-4aee-8c56-c3512bcf02b5 service neutron] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:17.183563 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38a1c4-a3ff-4834-8827-bd6b3a27eae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:17.184205 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38a1c4-a3ff-4834-8827-bd6b3a27eae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:17.184480 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38a1c4-a3ff-4834-8827-bd6b3a27eae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:17.184751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38a1c4-a3ff-4834-8827-bd6b3a27eae5 admin admin] PATH_INFO: `/v3/projects/413fccbc5312458393bfc82436831441` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:17.185970 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38a1c4-a3ff-4834-8827-bd6b3a27eae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=413fccbc5312458393bfc82436831441)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:17.187896 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38a1c4-a3ff-4834-8827-bd6b3a27eae5 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:17.242396 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8d38a1c4-a3ff-4834-8827-bd6b3a27eae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '413fccbc5312458393bfc82436831441', 'request_id': 'req-8d38a1c4-a3ff-4834-8827-bd6b3a27eae5'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:17.244927 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:17.251929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8d38a1c4-a3ff-4834-8827-bd6b3a27eae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '413fccbc5312458393bfc82436831441', 'request_id': 'req-8d38a1c4-a3ff-4834-8827-bd6b3a27eae5'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:17.259426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8d38a1c4-a3ff-4834-8827-bd6b3a27eae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '413fccbc5312458393bfc82436831441', 'request_id': 'req-8d38a1c4-a3ff-4834-8827-bd6b3a27eae5'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:17.270134 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8d38a1c4-a3ff-4834-8827-bd6b3a27eae5 admin admin] The token cache is being invalidate because project 413fccbc5312458393bfc82436831441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:39:17.270419 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8d38a1c4-a3ff-4834-8827-bd6b3a27eae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:17.271160 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8d38a1c4-a3ff-4834-8827-bd6b3a27eae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:17.272738 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1390/2761] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:39:17 2022] DELETE /identity/v3/projects/413fccbc5312458393bfc82436831441 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:17.276931 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee89eed-efef-487a-bddf-c580ecea4a70 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:17.278352 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-6ee89eed-efef-487a-bddf-c580ecea4a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:17.292840 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee89eed-efef-487a-bddf-c580ecea4a70 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:17.356967 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c2191-40f5-4aeb-8c96-54a49a79c204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:17.357926 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c2191-40f5-4aeb-8c96-54a49a79c204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:17.358304 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c2191-40f5-4aeb-8c96-54a49a79c204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:17.358658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c2191-40f5-4aeb-8c96-54a49a79c204 admin admin] PATH_INFO: `/v3/users/c137cc1e3813484eb996c96bffa15c9d` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:17.360666 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c2191-40f5-4aeb-8c96-54a49a79c204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c137cc1e3813484eb996c96bffa15c9d)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:17.364146 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c2191-40f5-4aeb-8c96-54a49a79c204 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:17.366665 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:17.422137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-a08c2191-40f5-4aeb-8c96-54a49a79c204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c137cc1e3813484eb996c96bffa15c9d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:17.423310 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-a08c2191-40f5-4aeb-8c96-54a49a79c204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c137cc1e3813484eb996c96bffa15c9d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:17.434925 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-a08c2191-40f5-4aeb-8c96-54a49a79c204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c137cc1e3813484eb996c96bffa15c9d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:17.436014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-a08c2191-40f5-4aeb-8c96-54a49a79c204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c137cc1e3813484eb996c96bffa15c9d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:17.445665 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-a08c2191-40f5-4aeb-8c96-54a49a79c204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c137cc1e3813484eb996c96bffa15c9d'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:17.465238 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1372/2762] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:39:17 2022] DELETE /identity/v3/users/c137cc1e3813484eb996c96bffa15c9d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:17.661977 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38a1c4-a3ff-4834-8827-bd6b3a27eae5 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:17.665762 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8d38a1c4-a3ff-4834-8827-bd6b3a27eae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:17.686341 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38a1c4-a3ff-4834-8827-bd6b3a27eae5 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:17.745509 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b7dce-19c5-4718-9ef2-ece7bcf5604a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:17.746157 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b7dce-19c5-4718-9ef2-ece7bcf5604a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:17.746450 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b7dce-19c5-4718-9ef2-ece7bcf5604a admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:17.746692 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b7dce-19c5-4718-9ef2-ece7bcf5604a admin admin] PATH_INFO: `/v3/projects/f60ff330edd54bffb342a6520a32b00d` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:17.747876 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b7dce-19c5-4718-9ef2-ece7bcf5604a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f60ff330edd54bffb342a6520a32b00d)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:17.749854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b7dce-19c5-4718-9ef2-ece7bcf5604a admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:17.800294 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-7b4b7dce-19c5-4718-9ef2-ece7bcf5604a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f60ff330edd54bffb342a6520a32b00d', 'request_id': 'req-7b4b7dce-19c5-4718-9ef2-ece7bcf5604a'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:17.808325 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-7b4b7dce-19c5-4718-9ef2-ece7bcf5604a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f60ff330edd54bffb342a6520a32b00d', 'request_id': 'req-7b4b7dce-19c5-4718-9ef2-ece7bcf5604a'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:17.815586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-7b4b7dce-19c5-4718-9ef2-ece7bcf5604a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f60ff330edd54bffb342a6520a32b00d', 'request_id': 'req-7b4b7dce-19c5-4718-9ef2-ece7bcf5604a'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:17.829431 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-7b4b7dce-19c5-4718-9ef2-ece7bcf5604a admin admin] The token cache is being invalidate because project f60ff330edd54bffb342a6520a32b00d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:39:17.829716 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-7b4b7dce-19c5-4718-9ef2-ece7bcf5604a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:17.830389 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-7b4b7dce-19c5-4718-9ef2-ece7bcf5604a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:17.831967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1391/2763] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:39:17 2022] DELETE /identity/v3/projects/f60ff330edd54bffb342a6520a32b00d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:27.461511 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=26,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:27.825853 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:DELETE=10,keystone:SELECT=57,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:37.180406 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c2191-40f5-4aeb-8c96-54a49a79c204 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:37.181990 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a08c2191-40f5-4aeb-8c96-54a49a79c204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:37.243354 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c2191-40f5-4aeb-8c96-54a49a79c204 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:37.293655 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e7ce3-0709-40b2-b2dd-d03a4598f62e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:37.294265 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e7ce3-0709-40b2-b2dd-d03a4598f62e service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:37.294605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e7ce3-0709-40b2-b2dd-d03a4598f62e service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:37.294924 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e7ce3-0709-40b2-b2dd-d03a4598f62e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:37.297134 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-799e7ce3-0709-40b2-b2dd-d03a4598f62e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:37.361993 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e7ce3-0709-40b2-b2dd-d03a4598f62e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:37.363680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e7ce3-0709-40b2-b2dd-d03a4598f62e service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:37.374223 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1373/2764] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:39:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:39:40.292328 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b7dce-19c5-4718-9ef2-ece7bcf5604a admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:40.293976 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-7b4b7dce-19c5-4718-9ef2-ece7bcf5604a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:40.307529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b7dce-19c5-4718-9ef2-ece7bcf5604a admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:40.312161 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31259f-a4f8-44f7-969c-d769224bab5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:40.312798 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31259f-a4f8-44f7-969c-d769224bab5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:40.313074 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31259f-a4f8-44f7-969c-d769224bab5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:40.313344 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31259f-a4f8-44f7-969c-d769224bab5e admin admin] PATH_INFO: `/v3/users/66d63b0fb3514e7984e698afd21f2095` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:40.314504 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31259f-a4f8-44f7-969c-d769224bab5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=66d63b0fb3514e7984e698afd21f2095)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:40.316537 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31259f-a4f8-44f7-969c-d769224bab5e admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:40.365688 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-9a31259f-a4f8-44f7-969c-d769224bab5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66d63b0fb3514e7984e698afd21f2095'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:40.366494 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-9a31259f-a4f8-44f7-969c-d769224bab5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66d63b0fb3514e7984e698afd21f2095'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:40.374415 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-9a31259f-a4f8-44f7-969c-d769224bab5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66d63b0fb3514e7984e698afd21f2095'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:40.383738 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-9a31259f-a4f8-44f7-969c-d769224bab5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66d63b0fb3514e7984e698afd21f2095'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:40.384435 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-9a31259f-a4f8-44f7-969c-d769224bab5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66d63b0fb3514e7984e698afd21f2095'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:40.403299 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1392/2765] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:39:40 2022] DELETE /identity/v3/users/66d63b0fb3514e7984e698afd21f2095 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:39:40.596237 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e7ce3-0709-40b2-b2dd-d03a4598f62e service neutron] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:40.609055 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e7ce3-0709-40b2-b2dd-d03a4598f62e service neutron] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:40.669014 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2b45d-a299-4986-9a18-9c5f79a6e2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:40.669658 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2b45d-a299-4986-9a18-9c5f79a6e2eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:40.669937 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2b45d-a299-4986-9a18-9c5f79a6e2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:40.670209 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2b45d-a299-4986-9a18-9c5f79a6e2eb admin admin] PATH_INFO: `/v3/projects/0beaa85de66441c99013ce7272184149` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:40.671402 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2b45d-a299-4986-9a18-9c5f79a6e2eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0beaa85de66441c99013ce7272184149)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:40.673324 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2b45d-a299-4986-9a18-9c5f79a6e2eb admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:40.681457 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:40.720550 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b5e2b45d-a299-4986-9a18-9c5f79a6e2eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0beaa85de66441c99013ce7272184149', 'request_id': 'req-b5e2b45d-a299-4986-9a18-9c5f79a6e2eb'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:40.728611 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b5e2b45d-a299-4986-9a18-9c5f79a6e2eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0beaa85de66441c99013ce7272184149', 'request_id': 'req-b5e2b45d-a299-4986-9a18-9c5f79a6e2eb'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:40.735253 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b5e2b45d-a299-4986-9a18-9c5f79a6e2eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0beaa85de66441c99013ce7272184149', 'request_id': 'req-b5e2b45d-a299-4986-9a18-9c5f79a6e2eb'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:40.746662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b5e2b45d-a299-4986-9a18-9c5f79a6e2eb admin admin] The token cache is being invalidate because project 0beaa85de66441c99013ce7272184149 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:39:40.747017 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b5e2b45d-a299-4986-9a18-9c5f79a6e2eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:40.747743 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-b5e2b45d-a299-4986-9a18-9c5f79a6e2eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:40.749353 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1374/2766] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:39:40 2022] DELETE /identity/v3/projects/0beaa85de66441c99013ce7272184149 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:40.754583 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124822c7-98af-4f64-b04e-19f7afa85a6f None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:40.754867 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124822c7-98af-4f64-b04e-19f7afa85a6f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:40.755183 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124822c7-98af-4f64-b04e-19f7afa85a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:40.776170 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-124822c7-98af-4f64-b04e-19f7afa85a6f None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:39:40.777411 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-124822c7-98af-4f64-b04e-19f7afa85a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:40.837501 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1393/2767] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:39:40.845894 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5965554-1cc5-479d-9b18-798c38907825 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:40.846181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5965554-1cc5-479d-9b18-798c38907825 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:40.846452 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5965554-1cc5-479d-9b18-798c38907825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:40.868886 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-c5965554-1cc5-479d-9b18-798c38907825 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:39:40.870102 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c5965554-1cc5-479d-9b18-798c38907825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:40.879871 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1375/2768] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:39:40.884751 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124822c7-98af-4f64-b04e-19f7afa85a6f None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:40.897606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124822c7-98af-4f64-b04e-19f7afa85a6f None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:40.903604 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2c456-2616-4de1-a6ef-d32cba066a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:40.904209 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2c456-2616-4de1-a6ef-d32cba066a2e admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:40.904484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2c456-2616-4de1-a6ef-d32cba066a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:40.904748 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2c456-2616-4de1-a6ef-d32cba066a2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:40.905394 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2c456-2616-4de1-a6ef-d32cba066a2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:39:40.905698 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2c456-2616-4de1-a6ef-d32cba066a2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:40.907343 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2c456-2616-4de1-a6ef-d32cba066a2e admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:40.919140 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1394/2769] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:39:40.923788 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5965554-1cc5-479d-9b18-798c38907825 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:40.933115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5965554-1cc5-479d-9b18-798c38907825 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:40.938786 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8b999-b721-4312-967c-de78b5e329a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:40.939497 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8b999-b721-4312-967c-de78b5e329a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:40.939803 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8b999-b721-4312-967c-de78b5e329a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:40.940070 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8b999-b721-4312-967c-de78b5e329a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:40.940707 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8b999-b721-4312-967c-de78b5e329a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:40.942651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8b999-b721-4312-967c-de78b5e329a1 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:40.972453 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1376/2770] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:39:40 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:39:40.978849 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2c456-2616-4de1-a6ef-d32cba066a2e admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:40.991872 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2c456-2616-4de1-a6ef-d32cba066a2e admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:41.053722 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a37577-d4d8-4d2f-8212-125dd34e0811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:41.054329 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a37577-d4d8-4d2f-8212-125dd34e0811 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:41.054608 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a37577-d4d8-4d2f-8212-125dd34e0811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:41.054879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a37577-d4d8-4d2f-8212-125dd34e0811 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:41.055537 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a37577-d4d8-4d2f-8212-125dd34e0811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:41.057457 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a37577-d4d8-4d2f-8212-125dd34e0811 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:41.065500 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:41.082018 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1395/2771] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:39:40 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:39:41.086279 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8b999-b721-4312-967c-de78b5e329a1 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:41.097012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8b999-b721-4312-967c-de78b5e329a1 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:41.102063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eae093-5779-454f-a829-aa5c9b66c809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:41.102674 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eae093-5779-454f-a829-aa5c9b66c809 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:41.102946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eae093-5779-454f-a829-aa5c9b66c809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:41.103224 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eae093-5779-454f-a829-aa5c9b66c809 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:41.103872 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eae093-5779-454f-a829-aa5c9b66c809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:41.105469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eae093-5779-454f-a829-aa5c9b66c809 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:41.116358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1377/2772] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:39:41.121391 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a37577-d4d8-4d2f-8212-125dd34e0811 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:41.138290 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a37577-d4d8-4d2f-8212-125dd34e0811 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:41.145740 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eed2a2-9710-4278-af0f-8f3fe8fb1f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:41.146338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eed2a2-9710-4278-af0f-8f3fe8fb1f10 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:41.146619 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eed2a2-9710-4278-af0f-8f3fe8fb1f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:41.146859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eed2a2-9710-4278-af0f-8f3fe8fb1f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:41.147566 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eed2a2-9710-4278-af0f-8f3fe8fb1f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:41.149176 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eed2a2-9710-4278-af0f-8f3fe8fb1f10 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:41.161638 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1396/2773] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:39:41.166364 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eae093-5779-454f-a829-aa5c9b66c809 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:41.177441 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eae093-5779-454f-a829-aa5c9b66c809 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:41.183031 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab6a8d-2ce1-45f3-8c4f-b28c703e6fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:41.183663 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab6a8d-2ce1-45f3-8c4f-b28c703e6fae admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:41.183936 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab6a8d-2ce1-45f3-8c4f-b28c703e6fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:41.184201 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab6a8d-2ce1-45f3-8c4f-b28c703e6fae admin admin] PATH_INFO: `/v3/projects/170a340bf917432db9a3f2bd762731c1/users/d140bf0298bc4712a6669142c9aa2d6f/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:41.199885 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab6a8d-2ce1-45f3-8c4f-b28c703e6fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=170a340bf917432db9a3f2bd762731c1, user_id=d140bf0298bc4712a6669142c9aa2d6f, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:41.202558 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab6a8d-2ce1-45f3-8c4f-b28c703e6fae admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:41.217216 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1378/2774] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:39:41 2022] PUT /identity/v3/projects/170a340bf917432db9a3f2bd762731c1/users/d140bf0298bc4712a6669142c9aa2d6f/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:41.229238 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb0a31-5fda-43ae-8cf1-1bc4b187c53f None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:41.229408 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb0a31-5fda-43ae-8cf1-1bc4b187c53f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:41.229709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb0a31-5fda-43ae-8cf1-1bc4b187c53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:41.258377 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-c1cb0a31-5fda-43ae-8cf1-1bc4b187c53f None None] MFA Rules not processed for user `d140bf0298bc4712a6669142c9aa2d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:39:41.259621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-c1cb0a31-5fda-43ae-8cf1-1bc4b187c53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:41.331661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1397/2775] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:39:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:39:41.347570 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab6a8d-2ce1-45f3-8c4f-b28c703e6fae admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:41.349449 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-49ab6a8d-2ce1-45f3-8c4f-b28c703e6fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:41.426455 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab6a8d-2ce1-45f3-8c4f-b28c703e6fae admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:41.433799 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad784aa-35ae-4bf1-8cc4-32a6f4b137b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdee0584fe045028a44c385d032d2c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:41.434413 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad784aa-35ae-4bf1-8cc4-32a6f4b137b9 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:41.434685 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad784aa-35ae-4bf1-8cc4-32a6f4b137b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:41.434953 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad784aa-35ae-4bf1-8cc4-32a6f4b137b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:41.443577 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad784aa-35ae-4bf1-8cc4-32a6f4b137b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:41.445213 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad784aa-35ae-4bf1-8cc4-32a6f4b137b9 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:41.454624 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1379/2776] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:39:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:39:44.177027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb0a31-5fda-43ae-8cf1-1bc4b187c53f None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:44.242860 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb0a31-5fda-43ae-8cf1-1bc4b187c53f None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:44.248240 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9016588-9044-4ead-af23-c3ad135611e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:44.248875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9016588-9044-4ead-af23-c3ad135611e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:44.249145 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9016588-9044-4ead-af23-c3ad135611e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:44.249432 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9016588-9044-4ead-af23-c3ad135611e7 admin admin] PATH_INFO: `/v3/users/d140bf0298bc4712a6669142c9aa2d6f` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:44.250659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9016588-9044-4ead-af23-c3ad135611e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d140bf0298bc4712a6669142c9aa2d6f)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:44.252718 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9016588-9044-4ead-af23-c3ad135611e7 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:44.306244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e9016588-9044-4ead-af23-c3ad135611e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd140bf0298bc4712a6669142c9aa2d6f'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:44.307485 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e9016588-9044-4ead-af23-c3ad135611e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd140bf0298bc4712a6669142c9aa2d6f'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:44.316729 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e9016588-9044-4ead-af23-c3ad135611e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd140bf0298bc4712a6669142c9aa2d6f'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:44.325136 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e9016588-9044-4ead-af23-c3ad135611e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd140bf0298bc4712a6669142c9aa2d6f'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:44.325856 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-e9016588-9044-4ead-af23-c3ad135611e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd140bf0298bc4712a6669142c9aa2d6f'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:44.331568 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:44.345985 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1398/2777] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:39:44 2022] DELETE /identity/v3/users/d140bf0298bc4712a6669142c9aa2d6f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:44.350731 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fd02a-ed93-49ab-a174-1938574ad46e None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:44.351229 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fd02a-ed93-49ab-a174-1938574ad46e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:44.351340 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fd02a-ed93-49ab-a174-1938574ad46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:44.370588 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-da2fd02a-ed93-49ab-a174-1938574ad46e None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:39:44.371832 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-da2fd02a-ed93-49ab-a174-1938574ad46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:44.383467 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:44.434185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1380/2778] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:39:44.444295 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9016588-9044-4ead-af23-c3ad135611e7 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:44.445854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-e9016588-9044-4ead-af23-c3ad135611e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:44.505910 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9016588-9044-4ead-af23-c3ad135611e7 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:44.510352 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a42af7-f7ed-41d8-9f44-a3f1bc6ff3f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:44.510945 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a42af7-f7ed-41d8-9f44-a3f1bc6ff3f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:44.511251 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a42af7-f7ed-41d8-9f44-a3f1bc6ff3f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:44.511516 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a42af7-f7ed-41d8-9f44-a3f1bc6ff3f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:44.521154 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a42af7-f7ed-41d8-9f44-a3f1bc6ff3f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:44.522561 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a42af7-f7ed-41d8-9f44-a3f1bc6ff3f4 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:44.532071 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1399/2779] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:39:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:39:44.819550 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fd02a-ed93-49ab-a174-1938574ad46e None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:44.821086 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-da2fd02a-ed93-49ab-a174-1938574ad46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:44.837012 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fd02a-ed93-49ab-a174-1938574ad46e None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:44.843756 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8d99c-94cc-412e-a9ae-7be4282225a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:44.844461 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8d99c-94cc-412e-a9ae-7be4282225a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:44.844736 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8d99c-94cc-412e-a9ae-7be4282225a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:44.844998 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8d99c-94cc-412e-a9ae-7be4282225a3 admin admin] PATH_INFO: `/v3/projects/170a340bf917432db9a3f2bd762731c1` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:44.846150 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8d99c-94cc-412e-a9ae-7be4282225a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=170a340bf917432db9a3f2bd762731c1)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:44.848179 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8d99c-94cc-412e-a9ae-7be4282225a3 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:44.897049 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f2b8d99c-94cc-412e-a9ae-7be4282225a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '170a340bf917432db9a3f2bd762731c1', 'request_id': 'req-f2b8d99c-94cc-412e-a9ae-7be4282225a3'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:44.904929 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f2b8d99c-94cc-412e-a9ae-7be4282225a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '170a340bf917432db9a3f2bd762731c1', 'request_id': 'req-f2b8d99c-94cc-412e-a9ae-7be4282225a3'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:44.911524 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f2b8d99c-94cc-412e-a9ae-7be4282225a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '170a340bf917432db9a3f2bd762731c1', 'request_id': 'req-f2b8d99c-94cc-412e-a9ae-7be4282225a3'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:44.922043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f2b8d99c-94cc-412e-a9ae-7be4282225a3 admin admin] The token cache is being invalidate because project 170a340bf917432db9a3f2bd762731c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:39:44.922326 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f2b8d99c-94cc-412e-a9ae-7be4282225a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:44.922969 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f2b8d99c-94cc-412e-a9ae-7be4282225a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:44.924548 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1381/2780] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:39:44 2022] DELETE /identity/v3/projects/170a340bf917432db9a3f2bd762731c1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:44.929593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250d984-5f05-4e32-ba40-d5ac414f82da None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:44.929878 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250d984-5f05-4e32-ba40-d5ac414f82da None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:44.930148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250d984-5f05-4e32-ba40-d5ac414f82da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:44.949912 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-4250d984-5f05-4e32-ba40-d5ac414f82da None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:39:44.951034 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-4250d984-5f05-4e32-ba40-d5ac414f82da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:45.014848 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1400/2781] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:39:45.029465 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323226cf-3f08-4597-ac19-0de6999ecb05 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:45.029940 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323226cf-3f08-4597-ac19-0de6999ecb05 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:45.030400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323226cf-3f08-4597-ac19-0de6999ecb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:45.053935 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-323226cf-3f08-4597-ac19-0de6999ecb05 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:39:45.055206 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-323226cf-3f08-4597-ac19-0de6999ecb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:45.064857 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1382/2782] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:39:45.072006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250d984-5f05-4e32-ba40-d5ac414f82da None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:45.088854 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250d984-5f05-4e32-ba40-d5ac414f82da None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:45.096850 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e64f56-9a00-4ade-9bfb-80abc254b67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:45.097459 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e64f56-9a00-4ade-9bfb-80abc254b67f admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:45.097736 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e64f56-9a00-4ade-9bfb-80abc254b67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:45.098004 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e64f56-9a00-4ade-9bfb-80abc254b67f admin admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:45.098653 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e64f56-9a00-4ade-9bfb-80abc254b67f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:39:45.098955 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e64f56-9a00-4ade-9bfb-80abc254b67f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:45.100586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e64f56-9a00-4ade-9bfb-80abc254b67f admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:45.112957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1401/2783] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:39:45.117512 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323226cf-3f08-4597-ac19-0de6999ecb05 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:45.127566 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323226cf-3f08-4597-ac19-0de6999ecb05 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:45.133973 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e640a9b-000a-4805-b8d9-0d33f30a2d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:45.134598 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e640a9b-000a-4805-b8d9-0d33f30a2d6d admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:45.135227 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e640a9b-000a-4805-b8d9-0d33f30a2d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:45.135529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e640a9b-000a-4805-b8d9-0d33f30a2d6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:45.136165 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e640a9b-000a-4805-b8d9-0d33f30a2d6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:45.138085 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e640a9b-000a-4805-b8d9-0d33f30a2d6d admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:45.167923 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1383/2784] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:39:45 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:39:45.172224 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e64f56-9a00-4ade-9bfb-80abc254b67f admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:45.182851 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e64f56-9a00-4ade-9bfb-80abc254b67f admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:45.240548 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fd0b8-1f13-4a27-9793-643f03c1f0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:45.241062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fd0b8-1f13-4a27-9793-643f03c1f0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:45.241347 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fd0b8-1f13-4a27-9793-643f03c1f0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:45.241616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fd0b8-1f13-4a27-9793-643f03c1f0a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:45.242245 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fd0b8-1f13-4a27-9793-643f03c1f0a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:45.244229 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fd0b8-1f13-4a27-9793-643f03c1f0a1 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:45.268538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1402/2785] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:39:45 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:39:45.273469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e640a9b-000a-4805-b8d9-0d33f30a2d6d admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:45.287003 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e640a9b-000a-4805-b8d9-0d33f30a2d6d admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:45.293188 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd6d99-dc79-4a40-95f4-830b5b95ad22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:45.294030 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd6d99-dc79-4a40-95f4-830b5b95ad22 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:45.294349 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd6d99-dc79-4a40-95f4-830b5b95ad22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:45.294672 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd6d99-dc79-4a40-95f4-830b5b95ad22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:45.295480 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd6d99-dc79-4a40-95f4-830b5b95ad22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:45.297145 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd6d99-dc79-4a40-95f4-830b5b95ad22 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:45.308565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1384/2786] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:39:45.312875 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fd0b8-1f13-4a27-9793-643f03c1f0a1 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:45.323189 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fd0b8-1f13-4a27-9793-643f03c1f0a1 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:45.328189 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70228ad-4065-47aa-bd0f-f835b31e2839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:45.328815 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70228ad-4065-47aa-bd0f-f835b31e2839 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:45.329094 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70228ad-4065-47aa-bd0f-f835b31e2839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:45.329366 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70228ad-4065-47aa-bd0f-f835b31e2839 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:45.330008 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70228ad-4065-47aa-bd0f-f835b31e2839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:45.331658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70228ad-4065-47aa-bd0f-f835b31e2839 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:45.333018 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:45.343735 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1403/2787] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:39:45.348300 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd6d99-dc79-4a40-95f4-830b5b95ad22 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:45.358534 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd6d99-dc79-4a40-95f4-830b5b95ad22 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:45.363955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a656d-5a14-4b8f-ab7e-ca5722164955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:45.364613 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a656d-5a14-4b8f-ab7e-ca5722164955 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:45.364920 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a656d-5a14-4b8f-ab7e-ca5722164955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:45.365192 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a656d-5a14-4b8f-ab7e-ca5722164955 admin admin] PATH_INFO: `/v3/projects/d57862fc4804451880bec27926942312/users/b5a6efa9c25a44419ddac5eded08995a/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:45.379844 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a656d-5a14-4b8f-ab7e-ca5722164955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d57862fc4804451880bec27926942312, user_id=b5a6efa9c25a44419ddac5eded08995a, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:45.382505 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a656d-5a14-4b8f-ab7e-ca5722164955 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:45.399265 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1385/2788] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:39:45 2022] PUT /identity/v3/projects/d57862fc4804451880bec27926942312/users/b5a6efa9c25a44419ddac5eded08995a/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:45.410189 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf0195-a465-49df-a44a-6c373eaf6770 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:45.410477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf0195-a465-49df-a44a-6c373eaf6770 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:45.410748 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf0195-a465-49df-a44a-6c373eaf6770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:45.441039 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-bdaf0195-a465-49df-a44a-6c373eaf6770 None None] MFA Rules not processed for user `b5a6efa9c25a44419ddac5eded08995a`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:39:45.442267 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-bdaf0195-a465-49df-a44a-6c373eaf6770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:45.511551 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1404/2789] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:39:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:39:45.516354 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a656d-5a14-4b8f-ab7e-ca5722164955 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:45.558865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:45.581101 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a656d-5a14-4b8f-ab7e-ca5722164955 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:45.586907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944b222-ad33-4ea3-9ed6-d9129c44088c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:45.587561 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944b222-ad33-4ea3-9ed6-d9129c44088c admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:45.587796 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944b222-ad33-4ea3-9ed6-d9129c44088c admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:45.588095 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944b222-ad33-4ea3-9ed6-d9129c44088c admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:45.588726 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944b222-ad33-4ea3-9ed6-d9129c44088c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:45.590657 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944b222-ad33-4ea3-9ed6-d9129c44088c admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:45.623444 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1386/2790] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:39:45 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:39:45.627844 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf0195-a465-49df-a44a-6c373eaf6770 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:45.640166 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf0195-a465-49df-a44a-6c373eaf6770 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:45.697707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac3e9b-b457-49a0-8042-68c2141a88e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:45.698310 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac3e9b-b457-49a0-8042-68c2141a88e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:45.698582 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac3e9b-b457-49a0-8042-68c2141a88e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:45.698847 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac3e9b-b457-49a0-8042-68c2141a88e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:45.699609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac3e9b-b457-49a0-8042-68c2141a88e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:45.701517 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac3e9b-b457-49a0-8042-68c2141a88e8 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:45.725152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1405/2791] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:39:45 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:39:45.729384 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944b222-ad33-4ea3-9ed6-d9129c44088c admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:45.741515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944b222-ad33-4ea3-9ed6-d9129c44088c admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:45.746358 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fcf4b-bf87-45ff-89b6-10fc70a964fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:45.746951 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fcf4b-bf87-45ff-89b6-10fc70a964fd admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:45.747255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fcf4b-bf87-45ff-89b6-10fc70a964fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:45.747522 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fcf4b-bf87-45ff-89b6-10fc70a964fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:45.748187 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fcf4b-bf87-45ff-89b6-10fc70a964fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:45.749782 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fcf4b-bf87-45ff-89b6-10fc70a964fd admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:45.760974 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1387/2792] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:39:45.765438 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac3e9b-b457-49a0-8042-68c2141a88e8 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:45.776124 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac3e9b-b457-49a0-8042-68c2141a88e8 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:45.781156 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517ab3e-88e1-4303-ac70-c6d9938a6caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:45.781810 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517ab3e-88e1-4303-ac70-c6d9938a6caf admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:45.782102 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517ab3e-88e1-4303-ac70-c6d9938a6caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:45.782372 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517ab3e-88e1-4303-ac70-c6d9938a6caf admin admin] PATH_INFO: `/v3/projects/4e97a1e9d1fb4b61a625d5c8ae78738e/users/55350a6ce695468c848a6bf7a57f915a/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:45.797858 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517ab3e-88e1-4303-ac70-c6d9938a6caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e97a1e9d1fb4b61a625d5c8ae78738e, user_id=55350a6ce695468c848a6bf7a57f915a, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:45.800921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517ab3e-88e1-4303-ac70-c6d9938a6caf admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:45.815096 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1406/2793] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:39:45 2022] PUT /identity/v3/projects/4e97a1e9d1fb4b61a625d5c8ae78738e/users/55350a6ce695468c848a6bf7a57f915a/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:45.819247 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fcf4b-bf87-45ff-89b6-10fc70a964fd admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:45.829674 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fcf4b-bf87-45ff-89b6-10fc70a964fd admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:45.888028 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bd03b-1756-4ee5-9bb4-506d7f77560f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:45.888637 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bd03b-1756-4ee5-9bb4-506d7f77560f admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:45.888913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bd03b-1756-4ee5-9bb4-506d7f77560f admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:45.889181 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bd03b-1756-4ee5-9bb4-506d7f77560f admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:45.889819 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465bd03b-1756-4ee5-9bb4-506d7f77560f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:45.891471 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465bd03b-1756-4ee5-9bb4-506d7f77560f admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:45.901524 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1388/2794] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:39:45.905773 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517ab3e-88e1-4303-ac70-c6d9938a6caf admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:45.916229 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517ab3e-88e1-4303-ac70-c6d9938a6caf admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:45.921121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ff53b-c2dc-46ab-9c92-278e97648cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:45.921752 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ff53b-c2dc-46ab-9c92-278e97648cef admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:45.922030 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ff53b-c2dc-46ab-9c92-278e97648cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:45.922302 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ff53b-c2dc-46ab-9c92-278e97648cef admin admin] PATH_INFO: `/v3/projects/4e97a1e9d1fb4b61a625d5c8ae78738e/users/55350a6ce695468c848a6bf7a57f915a/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:45.924258 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ff53b-c2dc-46ab-9c92-278e97648cef admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e97a1e9d1fb4b61a625d5c8ae78738e, user_id=55350a6ce695468c848a6bf7a57f915a, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:45.926897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ff53b-c2dc-46ab-9c92-278e97648cef admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:45.937360 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1407/2795] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:39:45 2022] PUT /identity/v3/projects/4e97a1e9d1fb4b61a625d5c8ae78738e/users/55350a6ce695468c848a6bf7a57f915a/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:45.948519 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214bafcf-01e5-4d3e-88c9-b5d9403d3ec8 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:45.948791 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214bafcf-01e5-4d3e-88c9-b5d9403d3ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:45.949156 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214bafcf-01e5-4d3e-88c9-b5d9403d3ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:45.982456 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-214bafcf-01e5-4d3e-88c9-b5d9403d3ec8 None None] MFA Rules not processed for user `55350a6ce695468c848a6bf7a57f915a`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:39:45.983709 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-214bafcf-01e5-4d3e-88c9-b5d9403d3ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:46.054370 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1389/2796] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:39:45 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:39:46.066313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ff53b-c2dc-46ab-9c92-278e97648cef admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:46.068499 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-a00ff53b-c2dc-46ab-9c92-278e97648cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:46.114056 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:46.133539 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ff53b-c2dc-46ab-9c92-278e97648cef admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:46.140077 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3f2ea-1318-438a-87bc-5b17b1ba3edc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:46.140905 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3f2ea-1318-438a-87bc-5b17b1ba3edc service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:46.141278 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3f2ea-1318-438a-87bc-5b17b1ba3edc service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:46.141640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3f2ea-1318-438a-87bc-5b17b1ba3edc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:46.151752 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3f2ea-1318-438a-87bc-5b17b1ba3edc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:46.156551 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3f2ea-1318-438a-87bc-5b17b1ba3edc service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:46.166559 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1408/2797] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:39:46 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:39:46.232510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214bafcf-01e5-4d3e-88c9-b5d9403d3ec8 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:46.268588 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:46.301268 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214bafcf-01e5-4d3e-88c9-b5d9403d3ec8 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:46.308497 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce449f79-2585-40e1-9dd9-dc7b3540e1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:46.309199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce449f79-2585-40e1-9dd9-dc7b3540e1cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:46.309473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce449f79-2585-40e1-9dd9-dc7b3540e1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:46.309742 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce449f79-2585-40e1-9dd9-dc7b3540e1cf admin admin] PATH_INFO: `/v3/users/b5a6efa9c25a44419ddac5eded08995a` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:46.310916 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce449f79-2585-40e1-9dd9-dc7b3540e1cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5a6efa9c25a44419ddac5eded08995a)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:46.312887 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce449f79-2585-40e1-9dd9-dc7b3540e1cf admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:46.362669 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ce449f79-2585-40e1-9dd9-dc7b3540e1cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5a6efa9c25a44419ddac5eded08995a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:46.363431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ce449f79-2585-40e1-9dd9-dc7b3540e1cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5a6efa9c25a44419ddac5eded08995a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:46.370378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ce449f79-2585-40e1-9dd9-dc7b3540e1cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5a6efa9c25a44419ddac5eded08995a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:46.371044 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ce449f79-2585-40e1-9dd9-dc7b3540e1cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5a6efa9c25a44419ddac5eded08995a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:46.379567 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-ce449f79-2585-40e1-9dd9-dc7b3540e1cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5a6efa9c25a44419ddac5eded08995a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:46.397925 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1390/2798] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:39:46 2022] DELETE /identity/v3/users/b5a6efa9c25a44419ddac5eded08995a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:46.402521 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e622b2-c338-4ec6-9403-e011a3806a90 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:46.403056 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e622b2-c338-4ec6-9403-e011a3806a90 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:46.403195 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e622b2-c338-4ec6-9403-e011a3806a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:46.422754 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-d7e622b2-c338-4ec6-9403-e011a3806a90 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:39:46.424087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-d7e622b2-c338-4ec6-9403-e011a3806a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:46.486650 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1409/2799] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:39:46.496636 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce449f79-2585-40e1-9dd9-dc7b3540e1cf admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:46.498143 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ce449f79-2585-40e1-9dd9-dc7b3540e1cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:46.555923 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce449f79-2585-40e1-9dd9-dc7b3540e1cf admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:46.560051 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43714075-e53d-4b23-afb6-6b78d4129306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:46.560580 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43714075-e53d-4b23-afb6-6b78d4129306 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:46.560856 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43714075-e53d-4b23-afb6-6b78d4129306 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:46.561119 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43714075-e53d-4b23-afb6-6b78d4129306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:46.570525 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43714075-e53d-4b23-afb6-6b78d4129306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:46.571975 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43714075-e53d-4b23-afb6-6b78d4129306 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:46.583461 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1391/2800] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:39:46.880681 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e622b2-c338-4ec6-9403-e011a3806a90 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:46.882134 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-d7e622b2-c338-4ec6-9403-e011a3806a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:46.894913 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e622b2-c338-4ec6-9403-e011a3806a90 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:46.900954 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bff93-68c6-4c04-9fd8-f2ccbdf5f176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:46.901601 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bff93-68c6-4c04-9fd8-f2ccbdf5f176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:46.901879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bff93-68c6-4c04-9fd8-f2ccbdf5f176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:46.902145 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bff93-68c6-4c04-9fd8-f2ccbdf5f176 admin admin] PATH_INFO: `/v3/projects/d57862fc4804451880bec27926942312` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:46.903525 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bff93-68c6-4c04-9fd8-f2ccbdf5f176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d57862fc4804451880bec27926942312)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:46.905463 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bff93-68c6-4c04-9fd8-f2ccbdf5f176 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:46.955485 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-d33bff93-68c6-4c04-9fd8-f2ccbdf5f176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd57862fc4804451880bec27926942312', 'request_id': 'req-d33bff93-68c6-4c04-9fd8-f2ccbdf5f176'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:46.963598 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-d33bff93-68c6-4c04-9fd8-f2ccbdf5f176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd57862fc4804451880bec27926942312', 'request_id': 'req-d33bff93-68c6-4c04-9fd8-f2ccbdf5f176'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:46.969981 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-d33bff93-68c6-4c04-9fd8-f2ccbdf5f176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd57862fc4804451880bec27926942312', 'request_id': 'req-d33bff93-68c6-4c04-9fd8-f2ccbdf5f176'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:46.980598 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-d33bff93-68c6-4c04-9fd8-f2ccbdf5f176 admin admin] The token cache is being invalidate because project d57862fc4804451880bec27926942312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:39:46.980888 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-d33bff93-68c6-4c04-9fd8-f2ccbdf5f176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:46.981619 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-d33bff93-68c6-4c04-9fd8-f2ccbdf5f176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:46.983284 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1410/2801] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:39:46 2022] DELETE /identity/v3/projects/d57862fc4804451880bec27926942312 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:46.987627 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43714075-e53d-4b23-afb6-6b78d4129306 service neutron] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:46.998105 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43714075-e53d-4b23-afb6-6b78d4129306 service neutron] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:47.058870 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:47.067839 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c6504-e2f8-480f-b842-267be8f12b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:47.068478 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c6504-e2f8-480f-b842-267be8f12b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:47.069052 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c6504-e2f8-480f-b842-267be8f12b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:47.069339 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c6504-e2f8-480f-b842-267be8f12b54 admin admin] PATH_INFO: `/v3/users/55350a6ce695468c848a6bf7a57f915a` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:47.070616 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c6504-e2f8-480f-b842-267be8f12b54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55350a6ce695468c848a6bf7a57f915a)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:47.073466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c6504-e2f8-480f-b842-267be8f12b54 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:47.123437 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-e74c6504-e2f8-480f-b842-267be8f12b54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55350a6ce695468c848a6bf7a57f915a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:47.124185 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-e74c6504-e2f8-480f-b842-267be8f12b54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55350a6ce695468c848a6bf7a57f915a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:47.132047 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-e74c6504-e2f8-480f-b842-267be8f12b54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55350a6ce695468c848a6bf7a57f915a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:47.132799 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-e74c6504-e2f8-480f-b842-267be8f12b54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55350a6ce695468c848a6bf7a57f915a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:47.141177 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-e74c6504-e2f8-480f-b842-267be8f12b54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55350a6ce695468c848a6bf7a57f915a'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:47.158771 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1392/2802] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:39:46 2022] DELETE /identity/v3/users/55350a6ce695468c848a6bf7a57f915a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:47.447820 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bff93-68c6-4c04-9fd8-f2ccbdf5f176 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:47.449454 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-d33bff93-68c6-4c04-9fd8-f2ccbdf5f176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:47.466326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bff93-68c6-4c04-9fd8-f2ccbdf5f176 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:47.527019 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f619a10-a7dd-4698-8011-ff1993882969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:47.527668 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f619a10-a7dd-4698-8011-ff1993882969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:47.527954 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f619a10-a7dd-4698-8011-ff1993882969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:47.528228 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f619a10-a7dd-4698-8011-ff1993882969 admin admin] PATH_INFO: `/v3/projects/4e97a1e9d1fb4b61a625d5c8ae78738e` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:47.529388 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f619a10-a7dd-4698-8011-ff1993882969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e97a1e9d1fb4b61a625d5c8ae78738e)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:47.531333 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f619a10-a7dd-4698-8011-ff1993882969 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:47.537789 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:47.579694 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5f619a10-a7dd-4698-8011-ff1993882969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e97a1e9d1fb4b61a625d5c8ae78738e', 'request_id': 'req-5f619a10-a7dd-4698-8011-ff1993882969'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:47.588702 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5f619a10-a7dd-4698-8011-ff1993882969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e97a1e9d1fb4b61a625d5c8ae78738e', 'request_id': 'req-5f619a10-a7dd-4698-8011-ff1993882969'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:47.595726 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5f619a10-a7dd-4698-8011-ff1993882969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e97a1e9d1fb4b61a625d5c8ae78738e', 'request_id': 'req-5f619a10-a7dd-4698-8011-ff1993882969'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:47.607483 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5f619a10-a7dd-4698-8011-ff1993882969 admin admin] The token cache is being invalidate because project 4e97a1e9d1fb4b61a625d5c8ae78738e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:39:47.607778 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5f619a10-a7dd-4698-8011-ff1993882969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:47.608436 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-5f619a10-a7dd-4698-8011-ff1993882969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:47.609983 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1411/2803] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:39:47 2022] DELETE /identity/v3/projects/4e97a1e9d1fb4b61a625d5c8ae78738e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:47.615322 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae899ad-82ee-4dcc-ad28-7cd146d06e2c None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:47.615807 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae899ad-82ee-4dcc-ad28-7cd146d06e2c None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:47.615925 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae899ad-82ee-4dcc-ad28-7cd146d06e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:47.636274 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-5ae899ad-82ee-4dcc-ad28-7cd146d06e2c None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:39:47.637482 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-5ae899ad-82ee-4dcc-ad28-7cd146d06e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:47.697680 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1393/2804] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:39:47.707001 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d2fb2-eef6-4f4c-ab8f-f6e5188b7814 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:47.707289 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d2fb2-eef6-4f4c-ab8f-f6e5188b7814 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:47.707562 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d2fb2-eef6-4f4c-ab8f-f6e5188b7814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:47.728106 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-e82d2fb2-eef6-4f4c-ab8f-f6e5188b7814 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:39:47.729323 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-e82d2fb2-eef6-4f4c-ab8f-f6e5188b7814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:47.738029 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1412/2805] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:39:47.742528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae899ad-82ee-4dcc-ad28-7cd146d06e2c None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:47.753795 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae899ad-82ee-4dcc-ad28-7cd146d06e2c None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:47.759075 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b3bcc-cb4e-4cd6-84ca-23222edf7c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:47.759686 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b3bcc-cb4e-4cd6-84ca-23222edf7c93 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:47.760338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b3bcc-cb4e-4cd6-84ca-23222edf7c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:47.760590 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b3bcc-cb4e-4cd6-84ca-23222edf7c93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:47.761246 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b3bcc-cb4e-4cd6-84ca-23222edf7c93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:39:47.761549 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b3bcc-cb4e-4cd6-84ca-23222edf7c93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:47.763197 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b3bcc-cb4e-4cd6-84ca-23222edf7c93 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:47.775734 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1394/2806] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:39:47.780134 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d2fb2-eef6-4f4c-ab8f-f6e5188b7814 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:47.790054 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d2fb2-eef6-4f4c-ab8f-f6e5188b7814 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:47.795686 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e9f4b-2324-4910-8b02-53e9f02f0c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:47.796415 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e9f4b-2324-4910-8b02-53e9f02f0c47 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:47.796693 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e9f4b-2324-4910-8b02-53e9f02f0c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:47.796965 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e9f4b-2324-4910-8b02-53e9f02f0c47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:47.797595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e9f4b-2324-4910-8b02-53e9f02f0c47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:47.799772 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e9f4b-2324-4910-8b02-53e9f02f0c47 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:47.830711 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1413/2807] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:39:47 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:39:47.835243 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b3bcc-cb4e-4cd6-84ca-23222edf7c93 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:47.845462 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b3bcc-cb4e-4cd6-84ca-23222edf7c93 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:47.917222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7996578-816f-431e-b3f1-cc7386635c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:47.917821 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7996578-816f-431e-b3f1-cc7386635c19 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:47.918222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7996578-816f-431e-b3f1-cc7386635c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:47.918505 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7996578-816f-431e-b3f1-cc7386635c19 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:47.919178 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7996578-816f-431e-b3f1-cc7386635c19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:47.921134 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7996578-816f-431e-b3f1-cc7386635c19 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:47.930429 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:47.944449 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1395/2808] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:39:47 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:39:47.948542 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e9f4b-2324-4910-8b02-53e9f02f0c47 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:47.959174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e9f4b-2324-4910-8b02-53e9f02f0c47 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:47.965059 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6760c-3494-4796-a219-033922b4a2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:47.965661 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6760c-3494-4796-a219-033922b4a2bb admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:47.965936 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6760c-3494-4796-a219-033922b4a2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:47.966199 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6760c-3494-4796-a219-033922b4a2bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:47.966843 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6760c-3494-4796-a219-033922b4a2bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:47.968483 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6760c-3494-4796-a219-033922b4a2bb admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:47.978779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1414/2809] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:39:47.982781 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7996578-816f-431e-b3f1-cc7386635c19 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:47.993529 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7996578-816f-431e-b3f1-cc7386635c19 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:47.999506 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0ea10-7931-4275-b84f-35bafab351c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:48.000123 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0ea10-7931-4275-b84f-35bafab351c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:48.000399 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0ea10-7931-4275-b84f-35bafab351c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:48.000669 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0ea10-7931-4275-b84f-35bafab351c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:48.001312 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0ea10-7931-4275-b84f-35bafab351c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:48.002972 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0ea10-7931-4275-b84f-35bafab351c3 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:48.013961 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1396/2810] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:39:48.020099 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6760c-3494-4796-a219-033922b4a2bb admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:48.031151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6760c-3494-4796-a219-033922b4a2bb admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:48.036365 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807a872-ac7b-480b-8c03-4bf0180fd296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:48.037011 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807a872-ac7b-480b-8c03-4bf0180fd296 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:48.037295 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807a872-ac7b-480b-8c03-4bf0180fd296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:48.037572 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807a872-ac7b-480b-8c03-4bf0180fd296 admin admin] PATH_INFO: `/v3/projects/d1e7946139d841b2a0ddafe0c74ae393/users/c34a90d142e146219e5dfd427271a3da/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:48.052816 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807a872-ac7b-480b-8c03-4bf0180fd296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e7946139d841b2a0ddafe0c74ae393, user_id=c34a90d142e146219e5dfd427271a3da, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:48.055616 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807a872-ac7b-480b-8c03-4bf0180fd296 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:48.070769 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1415/2811] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:39:48 2022] PUT /identity/v3/projects/d1e7946139d841b2a0ddafe0c74ae393/users/c34a90d142e146219e5dfd427271a3da/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:48.081395 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d28fac-8f0c-467a-a1bf-2478a73c2c7e None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:48.081621 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d28fac-8f0c-467a-a1bf-2478a73c2c7e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:48.081893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d28fac-8f0c-467a-a1bf-2478a73c2c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:48.112174 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-d8d28fac-8f0c-467a-a1bf-2478a73c2c7e None None] MFA Rules not processed for user `c34a90d142e146219e5dfd427271a3da`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:39:48.113393 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-d8d28fac-8f0c-467a-a1bf-2478a73c2c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:48.179361 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1397/2812] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:39:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:39:48.184321 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807a872-ac7b-480b-8c03-4bf0180fd296 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:48.246462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807a872-ac7b-480b-8c03-4bf0180fd296 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:48.251405 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb37bdd-b54f-4e91-94d2-642dd9df96fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:48.252047 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb37bdd-b54f-4e91-94d2-642dd9df96fe admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:48.252316 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb37bdd-b54f-4e91-94d2-642dd9df96fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:48.252588 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb37bdd-b54f-4e91-94d2-642dd9df96fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:48.253220 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb37bdd-b54f-4e91-94d2-642dd9df96fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:48.255145 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb37bdd-b54f-4e91-94d2-642dd9df96fe admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:48.283746 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1416/2813] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:39:48 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:39:48.288124 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d28fac-8f0c-467a-a1bf-2478a73c2c7e None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:48.301892 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d28fac-8f0c-467a-a1bf-2478a73c2c7e None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:48.360466 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62192d46-61af-49c7-a8d1-3dd0236a003a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:48.361120 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62192d46-61af-49c7-a8d1-3dd0236a003a admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:48.361380 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62192d46-61af-49c7-a8d1-3dd0236a003a admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:48.361650 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62192d46-61af-49c7-a8d1-3dd0236a003a admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:48.362293 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62192d46-61af-49c7-a8d1-3dd0236a003a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:48.364283 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62192d46-61af-49c7-a8d1-3dd0236a003a admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:48.386884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1398/2814] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:39:48 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:39:48.391115 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb37bdd-b54f-4e91-94d2-642dd9df96fe admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:48.403681 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb37bdd-b54f-4e91-94d2-642dd9df96fe admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:48.411395 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a072836-e490-48c3-af6e-8b9ba606d320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:48.412023 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a072836-e490-48c3-af6e-8b9ba606d320 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:48.412298 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a072836-e490-48c3-af6e-8b9ba606d320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:48.412563 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a072836-e490-48c3-af6e-8b9ba606d320 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:48.413259 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a072836-e490-48c3-af6e-8b9ba606d320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:48.414861 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a072836-e490-48c3-af6e-8b9ba606d320 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:48.429477 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1417/2815] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:39:48.435289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62192d46-61af-49c7-a8d1-3dd0236a003a admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:48.445997 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62192d46-61af-49c7-a8d1-3dd0236a003a admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:48.453839 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702c8c6-9929-4405-9ace-161b702f7aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:48.454858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702c8c6-9929-4405-9ace-161b702f7aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:48.455339 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702c8c6-9929-4405-9ace-161b702f7aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:48.455613 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702c8c6-9929-4405-9ace-161b702f7aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:48.456269 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702c8c6-9929-4405-9ace-161b702f7aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:48.457929 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702c8c6-9929-4405-9ace-161b702f7aa5 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:48.470221 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1399/2816] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:39:48.474965 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a072836-e490-48c3-af6e-8b9ba606d320 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:48.482028 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:48.487356 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a072836-e490-48c3-af6e-8b9ba606d320 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:48.493922 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d3d92-d4be-46bf-b976-4473a42f2227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:48.494587 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d3d92-d4be-46bf-b976-4473a42f2227 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:48.495120 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d3d92-d4be-46bf-b976-4473a42f2227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:48.495458 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d3d92-d4be-46bf-b976-4473a42f2227 admin admin] PATH_INFO: `/v3/projects/d36e9d1bf7f747589d39be31b3344b72/users/461e20a6b8f44b64b74984c068924f3c/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:48.511357 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d3d92-d4be-46bf-b976-4473a42f2227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d36e9d1bf7f747589d39be31b3344b72, user_id=461e20a6b8f44b64b74984c068924f3c, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:48.514027 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d3d92-d4be-46bf-b976-4473a42f2227 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:48.528926 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1418/2817] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:39:48 2022] PUT /identity/v3/projects/d36e9d1bf7f747589d39be31b3344b72/users/461e20a6b8f44b64b74984c068924f3c/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:48.540435 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127964bf-ec5c-4877-88b9-8b520c7c4cef None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:48.540746 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127964bf-ec5c-4877-88b9-8b520c7c4cef None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:48.540995 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127964bf-ec5c-4877-88b9-8b520c7c4cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:48.569946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-127964bf-ec5c-4877-88b9-8b520c7c4cef None None] MFA Rules not processed for user `461e20a6b8f44b64b74984c068924f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:39:48.571216 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-127964bf-ec5c-4877-88b9-8b520c7c4cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:48.608593 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:48.635112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1400/2818] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:39:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:39:48.639825 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d3d92-d4be-46bf-b976-4473a42f2227 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:48.706746 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d3d92-d4be-46bf-b976-4473a42f2227 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:48.712268 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1cbff-b2f9-4171-8982-8ba6564cabec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:48.712898 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1cbff-b2f9-4171-8982-8ba6564cabec admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:48.713194 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1cbff-b2f9-4171-8982-8ba6564cabec admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:48.713450 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1cbff-b2f9-4171-8982-8ba6564cabec admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:48.714090 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1cbff-b2f9-4171-8982-8ba6564cabec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:48.716036 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1cbff-b2f9-4171-8982-8ba6564cabec admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:48.752444 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1419/2819] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:39:48 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:39:48.758963 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127964bf-ec5c-4877-88b9-8b520c7c4cef None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:48.776965 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127964bf-ec5c-4877-88b9-8b520c7c4cef None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:48.836569 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52ef23-9800-4c56-8903-f57e0c7f4777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:48.837187 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52ef23-9800-4c56-8903-f57e0c7f4777 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:48.837463 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52ef23-9800-4c56-8903-f57e0c7f4777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:48.837720 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52ef23-9800-4c56-8903-f57e0c7f4777 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:48.838338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52ef23-9800-4c56-8903-f57e0c7f4777 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:48.840440 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52ef23-9800-4c56-8903-f57e0c7f4777 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:48.862408 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1401/2820] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:39:48 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:39:48.866470 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1cbff-b2f9-4171-8982-8ba6564cabec admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:48.877470 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1cbff-b2f9-4171-8982-8ba6564cabec admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:48.882730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d4823-d7ce-4d26-a3e9-d783271e62ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:48.883378 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d4823-d7ce-4d26-a3e9-d783271e62ee admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:48.883652 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d4823-d7ce-4d26-a3e9-d783271e62ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:48.883919 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d4823-d7ce-4d26-a3e9-d783271e62ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:48.884564 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d4823-d7ce-4d26-a3e9-d783271e62ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:48.886586 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d4823-d7ce-4d26-a3e9-d783271e62ee admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:48.897257 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1420/2821] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:39:48.901516 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52ef23-9800-4c56-8903-f57e0c7f4777 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:48.912339 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52ef23-9800-4c56-8903-f57e0c7f4777 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:48.917861 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011f535-0bfe-4267-b963-70627c55f371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:48.918547 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011f535-0bfe-4267-b963-70627c55f371 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:48.918821 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011f535-0bfe-4267-b963-70627c55f371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:48.919123 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011f535-0bfe-4267-b963-70627c55f371 admin admin] PATH_INFO: `/v3/projects/cfbefe7d67964500b4fd7ba36522052e/users/ae3e6d1abd5c4c3dbbea640027d810af/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:48.935715 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011f535-0bfe-4267-b963-70627c55f371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfbefe7d67964500b4fd7ba36522052e, user_id=ae3e6d1abd5c4c3dbbea640027d810af, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:48.938388 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011f535-0bfe-4267-b963-70627c55f371 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:48.957846 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1402/2822] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:39:48 2022] PUT /identity/v3/projects/cfbefe7d67964500b4fd7ba36522052e/users/ae3e6d1abd5c4c3dbbea640027d810af/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:48.962464 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d4823-d7ce-4d26-a3e9-d783271e62ee admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:48.975592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d4823-d7ce-4d26-a3e9-d783271e62ee admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:49.035171 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66cb38-0714-4ded-a2c3-b1d6a24c8561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:49.035779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66cb38-0714-4ded-a2c3-b1d6a24c8561 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:49.036060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66cb38-0714-4ded-a2c3-b1d6a24c8561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:49.036326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66cb38-0714-4ded-a2c3-b1d6a24c8561 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:49.037001 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b66cb38-0714-4ded-a2c3-b1d6a24c8561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:49.038658 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b66cb38-0714-4ded-a2c3-b1d6a24c8561 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:49.048604 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1421/2823] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:39:49.052900 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011f535-0bfe-4267-b963-70627c55f371 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:49.063675 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011f535-0bfe-4267-b963-70627c55f371 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:49.068630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f870f-a943-4f9c-b627-bd3f4250c8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:49.069283 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f870f-a943-4f9c-b627-bd3f4250c8c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:49.069571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f870f-a943-4f9c-b627-bd3f4250c8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:49.069857 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f870f-a943-4f9c-b627-bd3f4250c8c8 admin admin] PATH_INFO: `/v3/projects/cfbefe7d67964500b4fd7ba36522052e/users/ae3e6d1abd5c4c3dbbea640027d810af/roles/066f46534195417295e63a5316632eae` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:49.071837 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f870f-a943-4f9c-b627-bd3f4250c8c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfbefe7d67964500b4fd7ba36522052e, user_id=ae3e6d1abd5c4c3dbbea640027d810af, role_id=066f46534195417295e63a5316632eae)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:49.074502 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f870f-a943-4f9c-b627-bd3f4250c8c8 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:49.086113 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1403/2824] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:39:49 2022] PUT /identity/v3/projects/cfbefe7d67964500b4fd7ba36522052e/users/ae3e6d1abd5c4c3dbbea640027d810af/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:49.096824 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb470c-3a81-4eb1-b275-976201bfc113 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:49.097101 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb470c-3a81-4eb1-b275-976201bfc113 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:49.097347 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb470c-3a81-4eb1-b275-976201bfc113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:49.126590 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-a7bb470c-3a81-4eb1-b275-976201bfc113 None None] MFA Rules not processed for user `ae3e6d1abd5c4c3dbbea640027d810af`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:39:49.127943 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-a7bb470c-3a81-4eb1-b275-976201bfc113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:49.169932 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:49.199963 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1422/2825] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:39:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:39:49.211429 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f870f-a943-4f9c-b627-bd3f4250c8c8 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:49.213430 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-388f870f-a943-4f9c-b627-bd3f4250c8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:49.275062 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f870f-a943-4f9c-b627-bd3f4250c8c8 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:49.280083 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb7e14-c4fa-4288-af92-a6ec2549caa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:49.280683 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb7e14-c4fa-4288-af92-a6ec2549caa6 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:49.280991 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb7e14-c4fa-4288-af92-a6ec2549caa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:49.281251 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb7e14-c4fa-4288-af92-a6ec2549caa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:49.291676 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb7e14-c4fa-4288-af92-a6ec2549caa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:49.293329 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb7e14-c4fa-4288-af92-a6ec2549caa6 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:49.304177 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1404/2826] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:39:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:39:49.828820 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb470c-3a81-4eb1-b275-976201bfc113 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:49.831015 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-a7bb470c-3a81-4eb1-b275-976201bfc113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:49.844494 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb470c-3a81-4eb1-b275-976201bfc113 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:49.849112 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6ef6f-4375-4f21-b06b-bed8d3749b33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:49.849717 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6ef6f-4375-4f21-b06b-bed8d3749b33 service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:49.849993 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6ef6f-4375-4f21-b06b-bed8d3749b33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:49.850256 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6ef6f-4375-4f21-b06b-bed8d3749b33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:49.912655 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6ef6f-4375-4f21-b06b-bed8d3749b33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:49.914084 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6ef6f-4375-4f21-b06b-bed8d3749b33 service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:49.923156 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1423/2827] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:39:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:39:54.055826 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb7e14-c4fa-4288-af92-a6ec2549caa6 service cinder] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:54.065035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb7e14-c4fa-4288-af92-a6ec2549caa6 service cinder] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:54.069281 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6858f-ae55-4054-8b89-584e884b48a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:54.069916 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6858f-ae55-4054-8b89-584e884b48a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:54.070192 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6858f-ae55-4054-8b89-584e884b48a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:54.070499 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6858f-ae55-4054-8b89-584e884b48a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:54.102028 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:54.132241 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6858f-ae55-4054-8b89-584e884b48a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:54.133783 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6858f-ae55-4054-8b89-584e884b48a1 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:54.144272 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1405/2828] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:39:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:39:56.321694 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6ef6f-4375-4f21-b06b-bed8d3749b33 service cinder] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:56.386731 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6ef6f-4375-4f21-b06b-bed8d3749b33 service cinder] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:56.392013 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bcb8d-64d5-46cb-b376-dba2494efbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:56.392659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bcb8d-64d5-46cb-b376-dba2494efbe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:56.392942 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bcb8d-64d5-46cb-b376-dba2494efbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:56.393221 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bcb8d-64d5-46cb-b376-dba2494efbe4 admin admin] PATH_INFO: `/v3/users/c34a90d142e146219e5dfd427271a3da` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:56.394355 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bcb8d-64d5-46cb-b376-dba2494efbe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c34a90d142e146219e5dfd427271a3da)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:56.396303 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bcb8d-64d5-46cb-b376-dba2494efbe4 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:56.451555 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-eb8bcb8d-64d5-46cb-b376-dba2494efbe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c34a90d142e146219e5dfd427271a3da'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:56.452202 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-eb8bcb8d-64d5-46cb-b376-dba2494efbe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c34a90d142e146219e5dfd427271a3da'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:56.459805 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-eb8bcb8d-64d5-46cb-b376-dba2494efbe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c34a90d142e146219e5dfd427271a3da'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:56.470028 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-eb8bcb8d-64d5-46cb-b376-dba2494efbe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c34a90d142e146219e5dfd427271a3da'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:56.471071 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-eb8bcb8d-64d5-46cb-b376-dba2494efbe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c34a90d142e146219e5dfd427271a3da'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:56.482276 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:56.492280 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1424/2829] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:39:56 2022] DELETE /identity/v3/users/c34a90d142e146219e5dfd427271a3da => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:56.498237 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc26693-4a70-4559-b69b-31ef63b942a3 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:56.498736 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc26693-4a70-4559-b69b-31ef63b942a3 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:56.498841 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc26693-4a70-4559-b69b-31ef63b942a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:56.519137 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-fbc26693-4a70-4559-b69b-31ef63b942a3 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:39:56.520376 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-fbc26693-4a70-4559-b69b-31ef63b942a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:56.586815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1406/2830] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:39:56.597041 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bcb8d-64d5-46cb-b376-dba2494efbe4 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:56.598666 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-eb8bcb8d-64d5-46cb-b376-dba2494efbe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:56.658600 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bcb8d-64d5-46cb-b376-dba2494efbe4 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:56.662582 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404455f4-e338-432c-b6b8-375a649e70dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:56.663222 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404455f4-e338-432c-b6b8-375a649e70dc service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:56.663490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404455f4-e338-432c-b6b8-375a649e70dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:56.663749 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404455f4-e338-432c-b6b8-375a649e70dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:56.674262 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404455f4-e338-432c-b6b8-375a649e70dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:56.676159 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404455f4-e338-432c-b6b8-375a649e70dc service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:56.686534 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1425/2831] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:39:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:39:56.981704 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc26693-4a70-4559-b69b-31ef63b942a3 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:56.983515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-fbc26693-4a70-4559-b69b-31ef63b942a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:56.997310 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc26693-4a70-4559-b69b-31ef63b942a3 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:57.002495 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736680df-eaa3-4fdb-81eb-9d533f936b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:57.003183 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736680df-eaa3-4fdb-81eb-9d533f936b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:57.003482 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736680df-eaa3-4fdb-81eb-9d533f936b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:57.003726 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736680df-eaa3-4fdb-81eb-9d533f936b4b admin admin] PATH_INFO: `/v3/projects/d1e7946139d841b2a0ddafe0c74ae393` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:57.004930 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736680df-eaa3-4fdb-81eb-9d533f936b4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1e7946139d841b2a0ddafe0c74ae393)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:57.006940 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736680df-eaa3-4fdb-81eb-9d533f936b4b admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:57.055470 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-736680df-eaa3-4fdb-81eb-9d533f936b4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1e7946139d841b2a0ddafe0c74ae393', 'request_id': 'req-736680df-eaa3-4fdb-81eb-9d533f936b4b'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:57.064439 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-736680df-eaa3-4fdb-81eb-9d533f936b4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1e7946139d841b2a0ddafe0c74ae393', 'request_id': 'req-736680df-eaa3-4fdb-81eb-9d533f936b4b'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:57.070876 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-736680df-eaa3-4fdb-81eb-9d533f936b4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1e7946139d841b2a0ddafe0c74ae393', 'request_id': 'req-736680df-eaa3-4fdb-81eb-9d533f936b4b'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:57.081460 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-736680df-eaa3-4fdb-81eb-9d533f936b4b admin admin] The token cache is being invalidate because project d1e7946139d841b2a0ddafe0c74ae393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:39:57.081747 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-736680df-eaa3-4fdb-81eb-9d533f936b4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:57.082381 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-736680df-eaa3-4fdb-81eb-9d533f936b4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:57.083913 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1407/2832] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:39:56 2022] DELETE /identity/v3/projects/d1e7946139d841b2a0ddafe0c74ae393 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:57.088046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404455f4-e338-432c-b6b8-375a649e70dc service neutron] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:57.098575 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404455f4-e338-432c-b6b8-375a649e70dc service neutron] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:57.156965 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3fd2b-c78e-4f6c-be57-a90e71324f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:57.157592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3fd2b-c78e-4f6c-be57-a90e71324f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:57.157871 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3fd2b-c78e-4f6c-be57-a90e71324f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:57.158143 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3fd2b-c78e-4f6c-be57-a90e71324f33 admin admin] PATH_INFO: `/v3/users/461e20a6b8f44b64b74984c068924f3c` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:57.159296 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3fd2b-c78e-4f6c-be57-a90e71324f33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=461e20a6b8f44b64b74984c068924f3c)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:57.161218 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3fd2b-c78e-4f6c-be57-a90e71324f33 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:57.208304 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-21a3fd2b-c78e-4f6c-be57-a90e71324f33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '461e20a6b8f44b64b74984c068924f3c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:57.208862 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-21a3fd2b-c78e-4f6c-be57-a90e71324f33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '461e20a6b8f44b64b74984c068924f3c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:57.215626 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-21a3fd2b-c78e-4f6c-be57-a90e71324f33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '461e20a6b8f44b64b74984c068924f3c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:57.224421 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-21a3fd2b-c78e-4f6c-be57-a90e71324f33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '461e20a6b8f44b64b74984c068924f3c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:57.225028 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-21a3fd2b-c78e-4f6c-be57-a90e71324f33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '461e20a6b8f44b64b74984c068924f3c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:57.242281 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1426/2833] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:39:57 2022] DELETE /identity/v3/users/461e20a6b8f44b64b74984c068924f3c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:57.524571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736680df-eaa3-4fdb-81eb-9d533f936b4b admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:57.526243 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-736680df-eaa3-4fdb-81eb-9d533f936b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:57.545890 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736680df-eaa3-4fdb-81eb-9d533f936b4b admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:57.599665 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:57.608922 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a607b-f9e3-4d02-ac02-2ca168d21519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:57.609828 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a607b-f9e3-4d02-ac02-2ca168d21519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:57.610271 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a607b-f9e3-4d02-ac02-2ca168d21519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:57.610774 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a607b-f9e3-4d02-ac02-2ca168d21519 admin admin] PATH_INFO: `/v3/projects/d36e9d1bf7f747589d39be31b3344b72` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:57.612200 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a607b-f9e3-4d02-ac02-2ca168d21519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d36e9d1bf7f747589d39be31b3344b72)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:57.614129 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a607b-f9e3-4d02-ac02-2ca168d21519 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:57.662480 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-7d6a607b-f9e3-4d02-ac02-2ca168d21519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd36e9d1bf7f747589d39be31b3344b72', 'request_id': 'req-7d6a607b-f9e3-4d02-ac02-2ca168d21519'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:57.671278 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-7d6a607b-f9e3-4d02-ac02-2ca168d21519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd36e9d1bf7f747589d39be31b3344b72', 'request_id': 'req-7d6a607b-f9e3-4d02-ac02-2ca168d21519'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:57.678305 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-7d6a607b-f9e3-4d02-ac02-2ca168d21519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd36e9d1bf7f747589d39be31b3344b72', 'request_id': 'req-7d6a607b-f9e3-4d02-ac02-2ca168d21519'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:57.689428 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-7d6a607b-f9e3-4d02-ac02-2ca168d21519 admin admin] The token cache is being invalidate because project d36e9d1bf7f747589d39be31b3344b72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:39:57.689717 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-7d6a607b-f9e3-4d02-ac02-2ca168d21519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:57.690460 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-7d6a607b-f9e3-4d02-ac02-2ca168d21519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:57.692031 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1408/2834] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:39:57 2022] DELETE /identity/v3/projects/d36e9d1bf7f747589d39be31b3344b72 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:57.696266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3fd2b-c78e-4f6c-be57-a90e71324f33 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:57.697750 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-21a3fd2b-c78e-4f6c-be57-a90e71324f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:57.710747 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3fd2b-c78e-4f6c-be57-a90e71324f33 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:57.722444 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:57.771439 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58374278-b2b0-4e3a-9926-f78af69c817a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:57.772058 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58374278-b2b0-4e3a-9926-f78af69c817a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:57.772336 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58374278-b2b0-4e3a-9926-f78af69c817a admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:57.772605 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58374278-b2b0-4e3a-9926-f78af69c817a admin admin] PATH_INFO: `/v3/users/ae3e6d1abd5c4c3dbbea640027d810af` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:57.773791 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58374278-b2b0-4e3a-9926-f78af69c817a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae3e6d1abd5c4c3dbbea640027d810af)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:57.775776 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58374278-b2b0-4e3a-9926-f78af69c817a admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:57.825285 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-58374278-b2b0-4e3a-9926-f78af69c817a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae3e6d1abd5c4c3dbbea640027d810af'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:57.825948 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-58374278-b2b0-4e3a-9926-f78af69c817a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae3e6d1abd5c4c3dbbea640027d810af'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:57.833030 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-58374278-b2b0-4e3a-9926-f78af69c817a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae3e6d1abd5c4c3dbbea640027d810af'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:57.842375 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-58374278-b2b0-4e3a-9926-f78af69c817a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae3e6d1abd5c4c3dbbea640027d810af'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:57.843415 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-58374278-b2b0-4e3a-9926-f78af69c817a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae3e6d1abd5c4c3dbbea640027d810af'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:57.861266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1427/2835] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:39:57 2022] DELETE /identity/v3/users/ae3e6d1abd5c4c3dbbea640027d810af => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:58.387969 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a607b-f9e3-4d02-ac02-2ca168d21519 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:58.389702 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-7d6a607b-f9e3-4d02-ac02-2ca168d21519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:58.408178 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a607b-f9e3-4d02-ac02-2ca168d21519 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:58.466967 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c7faa-0797-445b-9c7b-1de0805e3817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:58.467792 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c7faa-0797-445b-9c7b-1de0805e3817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:58.468077 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c7faa-0797-445b-9c7b-1de0805e3817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:58.468340 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c7faa-0797-445b-9c7b-1de0805e3817 admin admin] PATH_INFO: `/v3/projects/cfbefe7d67964500b4fd7ba36522052e` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:58.469450 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c7faa-0797-445b-9c7b-1de0805e3817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfbefe7d67964500b4fd7ba36522052e)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:58.471454 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c7faa-0797-445b-9c7b-1de0805e3817 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:58.523527 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-bc3c7faa-0797-445b-9c7b-1de0805e3817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfbefe7d67964500b4fd7ba36522052e', 'request_id': 'req-bc3c7faa-0797-445b-9c7b-1de0805e3817'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:58.532884 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-bc3c7faa-0797-445b-9c7b-1de0805e3817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfbefe7d67964500b4fd7ba36522052e', 'request_id': 'req-bc3c7faa-0797-445b-9c7b-1de0805e3817'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:58.540115 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-bc3c7faa-0797-445b-9c7b-1de0805e3817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfbefe7d67964500b4fd7ba36522052e', 'request_id': 'req-bc3c7faa-0797-445b-9c7b-1de0805e3817'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:58.550685 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-bc3c7faa-0797-445b-9c7b-1de0805e3817 admin admin] The token cache is being invalidate because project cfbefe7d67964500b4fd7ba36522052e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:39:58.550972 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-bc3c7faa-0797-445b-9c7b-1de0805e3817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:58.551649 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-bc3c7faa-0797-445b-9c7b-1de0805e3817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:39:58.553162 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1409/2836] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:39:58 2022] DELETE /identity/v3/projects/cfbefe7d67964500b4fd7ba36522052e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:58.559435 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eead92-d2f8-4d04-bd27-55cc77220f75 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:58.559719 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eead92-d2f8-4d04-bd27-55cc77220f75 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:58.559995 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eead92-d2f8-4d04-bd27-55cc77220f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:58.579574 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-b9eead92-d2f8-4d04-bd27-55cc77220f75 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:39:58.580823 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b9eead92-d2f8-4d04-bd27-55cc77220f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:58.640759 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1428/2837] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:39:58.649651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e053571-834a-4871-881b-9ee03844cad6 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:58.649948 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e053571-834a-4871-881b-9ee03844cad6 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:58.650225 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e053571-834a-4871-881b-9ee03844cad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:58.670701 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-7e053571-834a-4871-881b-9ee03844cad6 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:39:58.671987 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-7e053571-834a-4871-881b-9ee03844cad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:58.680766 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1410/2838] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:39:58.685373 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eead92-d2f8-4d04-bd27-55cc77220f75 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:58.695359 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eead92-d2f8-4d04-bd27-55cc77220f75 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:58.700521 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e25e84-2ea4-48c6-a9a0-a020b299d59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:58.701121 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e25e84-2ea4-48c6-a9a0-a020b299d59c admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:58.701375 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e25e84-2ea4-48c6-a9a0-a020b299d59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:58.701615 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e25e84-2ea4-48c6-a9a0-a020b299d59c admin admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:58.702283 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e25e84-2ea4-48c6-a9a0-a020b299d59c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:39:58.702609 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e25e84-2ea4-48c6-a9a0-a020b299d59c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:58.704240 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e25e84-2ea4-48c6-a9a0-a020b299d59c admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:58.716103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1429/2839] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:39:58.720501 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e053571-834a-4871-881b-9ee03844cad6 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:58.729879 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e053571-834a-4871-881b-9ee03844cad6 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:58.734943 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb61360-be95-4f8f-a01d-2374cb903a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:58.735570 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb61360-be95-4f8f-a01d-2374cb903a39 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:58.735846 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb61360-be95-4f8f-a01d-2374cb903a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:58.736128 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb61360-be95-4f8f-a01d-2374cb903a39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:58.736760 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb61360-be95-4f8f-a01d-2374cb903a39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:58.738668 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb61360-be95-4f8f-a01d-2374cb903a39 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:58.744083 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:58.769979 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1411/2840] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:39:58 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:39:58.774365 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e25e84-2ea4-48c6-a9a0-a020b299d59c admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:58.785203 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e25e84-2ea4-48c6-a9a0-a020b299d59c admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:58.805710 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:58.848212 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ef2fb-d935-4161-a9a1-10c121c4556f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:58.848820 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ef2fb-d935-4161-a9a1-10c121c4556f admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:58.849092 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ef2fb-d935-4161-a9a1-10c121c4556f admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:58.849360 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ef2fb-d935-4161-a9a1-10c121c4556f admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:58.849981 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ef2fb-d935-4161-a9a1-10c121c4556f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:58.851960 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ef2fb-d935-4161-a9a1-10c121c4556f admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:58.875597 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1430/2841] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:39:58 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:39:58.880005 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb61360-be95-4f8f-a01d-2374cb903a39 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:58.891465 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb61360-be95-4f8f-a01d-2374cb903a39 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:58.896370 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2f4fc-ec87-40b9-be5f-34135d8c1ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:58.896970 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2f4fc-ec87-40b9-be5f-34135d8c1ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:58.897228 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2f4fc-ec87-40b9-be5f-34135d8c1ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:58.897491 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2f4fc-ec87-40b9-be5f-34135d8c1ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:58.898128 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2f4fc-ec87-40b9-be5f-34135d8c1ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:58.899760 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2f4fc-ec87-40b9-be5f-34135d8c1ab1 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:58.909687 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1412/2842] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:39:58.913737 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ef2fb-d935-4161-a9a1-10c121c4556f admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:58.924511 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ef2fb-d935-4161-a9a1-10c121c4556f admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:58.930209 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218fe428-7368-453d-8a7e-069caeef8664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:58.930811 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fe428-7368-453d-8a7e-069caeef8664 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:58.931124 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fe428-7368-453d-8a7e-069caeef8664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:58.931414 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fe428-7368-453d-8a7e-069caeef8664 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:58.932075 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218fe428-7368-453d-8a7e-069caeef8664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:58.933748 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218fe428-7368-453d-8a7e-069caeef8664 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:58.945024 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1431/2843] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:39:58.949603 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2f4fc-ec87-40b9-be5f-34135d8c1ab1 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:58.965219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2f4fc-ec87-40b9-be5f-34135d8c1ab1 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:58.971326 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351cfaf-c12d-4b71-926b-8bff7d0eaa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:58.971970 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351cfaf-c12d-4b71-926b-8bff7d0eaa41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:58.972234 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351cfaf-c12d-4b71-926b-8bff7d0eaa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:58.972497 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351cfaf-c12d-4b71-926b-8bff7d0eaa41 admin admin] PATH_INFO: `/v3/projects/c6030b7fba7e4721992fcdb8de5213a0/users/0d5f3e24dbd64f0f80d851e129e2afe3/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:58.988051 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351cfaf-c12d-4b71-926b-8bff7d0eaa41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6030b7fba7e4721992fcdb8de5213a0, user_id=0d5f3e24dbd64f0f80d851e129e2afe3, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:58.990728 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351cfaf-c12d-4b71-926b-8bff7d0eaa41 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:59.005208 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1413/2844] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:39:58 2022] PUT /identity/v3/projects/c6030b7fba7e4721992fcdb8de5213a0/users/0d5f3e24dbd64f0f80d851e129e2afe3/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:39:59.018320 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc9a12-a153-4912-97ef-08267cc8ab83 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:59.018608 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc9a12-a153-4912-97ef-08267cc8ab83 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:59.018881 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc9a12-a153-4912-97ef-08267cc8ab83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:59.048346 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-23dc9a12-a153-4912-97ef-08267cc8ab83 None None] MFA Rules not processed for user `0d5f3e24dbd64f0f80d851e129e2afe3`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:39:59.049567 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-23dc9a12-a153-4912-97ef-08267cc8ab83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:59.118742 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1432/2845] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:39:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:39:59.125947 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351cfaf-c12d-4b71-926b-8bff7d0eaa41 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:59.194699 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351cfaf-c12d-4b71-926b-8bff7d0eaa41 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:59.200332 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea022403-86c1-4a5b-8987-05e5a4bb61ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:59.200934 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea022403-86c1-4a5b-8987-05e5a4bb61ab admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:59.201219 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea022403-86c1-4a5b-8987-05e5a4bb61ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:59.201491 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea022403-86c1-4a5b-8987-05e5a4bb61ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:59.202114 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea022403-86c1-4a5b-8987-05e5a4bb61ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:59.204081 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea022403-86c1-4a5b-8987-05e5a4bb61ab admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:59.233095 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1414/2846] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:39:59 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:39:59.237315 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc9a12-a153-4912-97ef-08267cc8ab83 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:59.248532 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc9a12-a153-4912-97ef-08267cc8ab83 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:59.312481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f327ca7-0071-4c66-9c32-1abaa86ae814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:59.313106 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f327ca7-0071-4c66-9c32-1abaa86ae814 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:59.313383 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f327ca7-0071-4c66-9c32-1abaa86ae814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:59.313649 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f327ca7-0071-4c66-9c32-1abaa86ae814 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:59.314302 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f327ca7-0071-4c66-9c32-1abaa86ae814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:59.316279 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f327ca7-0071-4c66-9c32-1abaa86ae814 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:59.344234 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1433/2847] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:39:59 2022] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:39:59.350501 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea022403-86c1-4a5b-8987-05e5a4bb61ab admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:59.362897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea022403-86c1-4a5b-8987-05e5a4bb61ab admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:59.368685 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4bff9f-f9b2-4038-a851-3e892c8156f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:59.369307 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bff9f-f9b2-4038-a851-3e892c8156f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:59.369581 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bff9f-f9b2-4038-a851-3e892c8156f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:59.369849 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bff9f-f9b2-4038-a851-3e892c8156f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:59.370684 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4bff9f-f9b2-4038-a851-3e892c8156f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:59.372441 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4bff9f-f9b2-4038-a851-3e892c8156f8 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:59.383484 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1415/2848] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:39:59.388231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f327ca7-0071-4c66-9c32-1abaa86ae814 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:59.398564 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f327ca7-0071-4c66-9c32-1abaa86ae814 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:59.403715 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8c605-3150-4ac5-9def-b5cb89b03aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:59.404354 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8c605-3150-4ac5-9def-b5cb89b03aad admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:59.404627 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8c605-3150-4ac5-9def-b5cb89b03aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:59.404891 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8c605-3150-4ac5-9def-b5cb89b03aad admin admin] PATH_INFO: `/v3/projects/043720393a744cc398d57a5471e904e9/users/511a9167e50c438888b91dcdb387d694/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:59.420137 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8c605-3150-4ac5-9def-b5cb89b03aad admin admin] RBAC: Authorizing `identity:create_grant(project_id=043720393a744cc398d57a5471e904e9, user_id=511a9167e50c438888b91dcdb387d694, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:59.424731 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8c605-3150-4ac5-9def-b5cb89b03aad admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:59.429635 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:59.443826 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1434/2849] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:39:59 2022] PUT /identity/v3/projects/043720393a744cc398d57a5471e904e9/users/511a9167e50c438888b91dcdb387d694/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:39:59.448009 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4bff9f-f9b2-4038-a851-3e892c8156f8 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:59.458519 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4bff9f-f9b2-4038-a851-3e892c8156f8 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:59.524965 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1953d6-7a78-44f6-8c5c-07d7af9e580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:59.525578 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1953d6-7a78-44f6-8c5c-07d7af9e580d admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:59.525860 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1953d6-7a78-44f6-8c5c-07d7af9e580d admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:59.526131 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1953d6-7a78-44f6-8c5c-07d7af9e580d admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:59.526807 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1953d6-7a78-44f6-8c5c-07d7af9e580d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:59.528507 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1953d6-7a78-44f6-8c5c-07d7af9e580d admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:59.538597 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1416/2850] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:39:59.543043 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8c605-3150-4ac5-9def-b5cb89b03aad admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:59.554134 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8c605-3150-4ac5-9def-b5cb89b03aad admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:59.560017 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cd61b-6ac4-4831-b106-57d7a95c93c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:59.560665 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cd61b-6ac4-4831-b106-57d7a95c93c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:59.560941 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cd61b-6ac4-4831-b106-57d7a95c93c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:59.561203 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cd61b-6ac4-4831-b106-57d7a95c93c7 admin admin] PATH_INFO: `/v3/projects/043720393a744cc398d57a5471e904e9/users/511a9167e50c438888b91dcdb387d694/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:59.563529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cd61b-6ac4-4831-b106-57d7a95c93c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=043720393a744cc398d57a5471e904e9, user_id=511a9167e50c438888b91dcdb387d694, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:59.566176 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cd61b-6ac4-4831-b106-57d7a95c93c7 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:59.577362 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1435/2851] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:39:59 2022] PUT /identity/v3/projects/043720393a744cc398d57a5471e904e9/users/511a9167e50c438888b91dcdb387d694/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:39:59.587836 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d469c-917c-423b-afa1-ed6669651ee2 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:59.588125 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d469c-917c-423b-afa1-ed6669651ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:59.588496 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d469c-917c-423b-afa1-ed6669651ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:59.619008 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-918d469c-917c-423b-afa1-ed6669651ee2 None None] MFA Rules not processed for user `511a9167e50c438888b91dcdb387d694`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:39:59.620237 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-918d469c-917c-423b-afa1-ed6669651ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:59.630268 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:39:59.692726 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1417/2852] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:39:59 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:39:59.704033 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cd61b-6ac4-4831-b106-57d7a95c93c7 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:59.706072 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-519cd61b-6ac4-4831-b106-57d7a95c93c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:39:59.765211 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cd61b-6ac4-4831-b106-57d7a95c93c7 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:59.769202 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f11bc-ee66-4519-a1ae-dec33122dea0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:59.769806 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f11bc-ee66-4519-a1ae-dec33122dea0 service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:59.770080 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f11bc-ee66-4519-a1ae-dec33122dea0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:59.770324 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f11bc-ee66-4519-a1ae-dec33122dea0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:59.779823 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f11bc-ee66-4519-a1ae-dec33122dea0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:59.781247 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f11bc-ee66-4519-a1ae-dec33122dea0 service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:59.790780 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1436/2853] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:39:59 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:39:59.896376 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d469c-917c-423b-afa1-ed6669651ee2 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:39:59.907238 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d469c-917c-423b-afa1-ed6669651ee2 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:39:59.911797 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023f771-884f-47bc-986f-1ae712749de2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:39:59.912409 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023f771-884f-47bc-986f-1ae712749de2 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:39:59.912685 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023f771-884f-47bc-986f-1ae712749de2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:39:59.912955 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023f771-884f-47bc-986f-1ae712749de2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:39:59.978449 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023f771-884f-47bc-986f-1ae712749de2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:39:59.980586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023f771-884f-47bc-986f-1ae712749de2 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:39:59.990782 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1418/2854] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:39:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:40:02.637174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f11bc-ee66-4519-a1ae-dec33122dea0 service cinder] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:02.721917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f11bc-ee66-4519-a1ae-dec33122dea0 service cinder] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:02.729274 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4a354-dd51-458c-b955-e6e1887595a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:02.729917 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4a354-dd51-458c-b955-e6e1887595a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:02.730195 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4a354-dd51-458c-b955-e6e1887595a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:02.730508 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4a354-dd51-458c-b955-e6e1887595a9 admin admin] PATH_INFO: `/v3/users/0d5f3e24dbd64f0f80d851e129e2afe3` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:02.731893 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4a354-dd51-458c-b955-e6e1887595a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d5f3e24dbd64f0f80d851e129e2afe3)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:02.733938 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4a354-dd51-458c-b955-e6e1887595a9 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:02.788640 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-11a4a354-dd51-458c-b955-e6e1887595a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d5f3e24dbd64f0f80d851e129e2afe3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:02.789314 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-11a4a354-dd51-458c-b955-e6e1887595a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d5f3e24dbd64f0f80d851e129e2afe3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:02.796420 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-11a4a354-dd51-458c-b955-e6e1887595a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d5f3e24dbd64f0f80d851e129e2afe3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:02.804174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-11a4a354-dd51-458c-b955-e6e1887595a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d5f3e24dbd64f0f80d851e129e2afe3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:02.804834 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-11a4a354-dd51-458c-b955-e6e1887595a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d5f3e24dbd64f0f80d851e129e2afe3'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:02.822127 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1437/2855] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:40:02 2022] DELETE /identity/v3/users/0d5f3e24dbd64f0f80d851e129e2afe3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:40:02.827048 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229914a8-1832-44f4-ab76-0583c61e9b1b None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:02.827555 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229914a8-1832-44f4-ab76-0583c61e9b1b None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:02.827651 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229914a8-1832-44f4-ab76-0583c61e9b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:02.847280 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-229914a8-1832-44f4-ab76-0583c61e9b1b None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:40:02.848703 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-229914a8-1832-44f4-ab76-0583c61e9b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:02.909861 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1419/2856] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:40:02.920410 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4a354-dd51-458c-b955-e6e1887595a9 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:02.921947 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-11a4a354-dd51-458c-b955-e6e1887595a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:02.928535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:40:02.980808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4a354-dd51-458c-b955-e6e1887595a9 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:02.984709 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29856d52-6da5-4c19-bbde-40bf6228dd8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:02.985323 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29856d52-6da5-4c19-bbde-40bf6228dd8e service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:02.985621 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29856d52-6da5-4c19-bbde-40bf6228dd8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:02.985929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29856d52-6da5-4c19-bbde-40bf6228dd8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:02.995453 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29856d52-6da5-4c19-bbde-40bf6228dd8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:02.996889 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29856d52-6da5-4c19-bbde-40bf6228dd8e service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:03.006629 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1438/2857] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:40:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:40:03.293199 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229914a8-1832-44f4-ab76-0583c61e9b1b None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:03.296007 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-229914a8-1832-44f4-ab76-0583c61e9b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:03.317022 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229914a8-1832-44f4-ab76-0583c61e9b1b None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:03.323043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f13dc4-04cb-4e97-b444-0bc5b19c87bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:03.323701 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f13dc4-04cb-4e97-b444-0bc5b19c87bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:03.323979 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f13dc4-04cb-4e97-b444-0bc5b19c87bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:03.324252 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f13dc4-04cb-4e97-b444-0bc5b19c87bd admin admin] PATH_INFO: `/v3/projects/c6030b7fba7e4721992fcdb8de5213a0` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:03.325375 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f13dc4-04cb-4e97-b444-0bc5b19c87bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6030b7fba7e4721992fcdb8de5213a0)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:03.327413 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f13dc4-04cb-4e97-b444-0bc5b19c87bd admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:03.375630 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:40:03.383661 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-56f13dc4-04cb-4e97-b444-0bc5b19c87bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6030b7fba7e4721992fcdb8de5213a0', 'request_id': 'req-56f13dc4-04cb-4e97-b444-0bc5b19c87bd'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:03.392348 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-56f13dc4-04cb-4e97-b444-0bc5b19c87bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6030b7fba7e4721992fcdb8de5213a0', 'request_id': 'req-56f13dc4-04cb-4e97-b444-0bc5b19c87bd'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:03.402907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-56f13dc4-04cb-4e97-b444-0bc5b19c87bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6030b7fba7e4721992fcdb8de5213a0', 'request_id': 'req-56f13dc4-04cb-4e97-b444-0bc5b19c87bd'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:03.415213 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-56f13dc4-04cb-4e97-b444-0bc5b19c87bd admin admin] The token cache is being invalidate because project c6030b7fba7e4721992fcdb8de5213a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:40:03.415502 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-56f13dc4-04cb-4e97-b444-0bc5b19c87bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:03.416131 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-56f13dc4-04cb-4e97-b444-0bc5b19c87bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:03.417814 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1420/2858] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:40:03 2022] DELETE /identity/v3/projects/c6030b7fba7e4721992fcdb8de5213a0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:40:03.422119 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29856d52-6da5-4c19-bbde-40bf6228dd8e service neutron] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:03.432260 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29856d52-6da5-4c19-bbde-40bf6228dd8e service neutron] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:03.491483 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0ebf2-6876-4de4-b67f-d1b36132ad00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:03.492147 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0ebf2-6876-4de4-b67f-d1b36132ad00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:03.492426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0ebf2-6876-4de4-b67f-d1b36132ad00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:03.492703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0ebf2-6876-4de4-b67f-d1b36132ad00 admin admin] PATH_INFO: `/v3/users/511a9167e50c438888b91dcdb387d694` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:03.493867 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0ebf2-6876-4de4-b67f-d1b36132ad00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=511a9167e50c438888b91dcdb387d694)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:03.495843 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0ebf2-6876-4de4-b67f-d1b36132ad00 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:03.544713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-63c0ebf2-6876-4de4-b67f-d1b36132ad00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '511a9167e50c438888b91dcdb387d694'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:03.545393 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-63c0ebf2-6876-4de4-b67f-d1b36132ad00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '511a9167e50c438888b91dcdb387d694'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:03.552394 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-63c0ebf2-6876-4de4-b67f-d1b36132ad00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '511a9167e50c438888b91dcdb387d694'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:03.561217 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-63c0ebf2-6876-4de4-b67f-d1b36132ad00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '511a9167e50c438888b91dcdb387d694'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:03.561973 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-63c0ebf2-6876-4de4-b67f-d1b36132ad00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '511a9167e50c438888b91dcdb387d694'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:03.581021 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1439/2859] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:40:03 2022] DELETE /identity/v3/users/511a9167e50c438888b91dcdb387d694 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:40:03.854789 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f13dc4-04cb-4e97-b444-0bc5b19c87bd admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:03.856404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-56f13dc4-04cb-4e97-b444-0bc5b19c87bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:03.897203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f13dc4-04cb-4e97-b444-0bc5b19c87bd admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:03.985569 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ec00f-6e7f-4584-9035-daf63b8c42ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:03.986117 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ec00f-6e7f-4584-9035-daf63b8c42ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:03.986397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ec00f-6e7f-4584-9035-daf63b8c42ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:03.986670 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ec00f-6e7f-4584-9035-daf63b8c42ba admin admin] PATH_INFO: `/v3/projects/043720393a744cc398d57a5471e904e9` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:03.987907 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ec00f-6e7f-4584-9035-daf63b8c42ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=043720393a744cc398d57a5471e904e9)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:03.989833 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ec00f-6e7f-4584-9035-daf63b8c42ba admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:04.037000 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f26ec00f-6e7f-4584-9035-daf63b8c42ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '043720393a744cc398d57a5471e904e9', 'request_id': 'req-f26ec00f-6e7f-4584-9035-daf63b8c42ba'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:04.045063 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f26ec00f-6e7f-4584-9035-daf63b8c42ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '043720393a744cc398d57a5471e904e9', 'request_id': 'req-f26ec00f-6e7f-4584-9035-daf63b8c42ba'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:04.051692 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f26ec00f-6e7f-4584-9035-daf63b8c42ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '043720393a744cc398d57a5471e904e9', 'request_id': 'req-f26ec00f-6e7f-4584-9035-daf63b8c42ba'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:04.063289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f26ec00f-6e7f-4584-9035-daf63b8c42ba admin admin] The token cache is being invalidate because project 043720393a744cc398d57a5471e904e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:40:04.063571 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f26ec00f-6e7f-4584-9035-daf63b8c42ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:04.064319 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-f26ec00f-6e7f-4584-9035-daf63b8c42ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:04.065979 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1421/2860] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:40:03 2022] DELETE /identity/v3/projects/043720393a744cc398d57a5471e904e9 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:40:04.071302 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079de59-b79b-4e6d-bd8a-eefcd92c05eb None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:04.071833 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079de59-b79b-4e6d-bd8a-eefcd92c05eb None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:04.071833 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079de59-b79b-4e6d-bd8a-eefcd92c05eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:04.112000 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:40:04.137812 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-9079de59-b79b-4e6d-bd8a-eefcd92c05eb None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:40:04.139064 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-9079de59-b79b-4e6d-bd8a-eefcd92c05eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:04.236560 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1440/2861] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:40:04.244937 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e80210-0c7e-4807-adbf-0d60e3983269 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:04.245224 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e80210-0c7e-4807-adbf-0d60e3983269 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:04.245527 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e80210-0c7e-4807-adbf-0d60e3983269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:04.266953 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-12e80210-0c7e-4807-adbf-0d60e3983269 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:40:04.268205 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-12e80210-0c7e-4807-adbf-0d60e3983269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:04.277178 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1422/2862] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:40:04.281800 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079de59-b79b-4e6d-bd8a-eefcd92c05eb None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:04.292580 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079de59-b79b-4e6d-bd8a-eefcd92c05eb None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:04.298889 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac744a-5234-4ced-870b-2f22b09cbcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:04.299521 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac744a-5234-4ced-870b-2f22b09cbcbb admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:04.299795 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac744a-5234-4ced-870b-2f22b09cbcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:04.300060 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac744a-5234-4ced-870b-2f22b09cbcbb admin admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:04.300775 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac744a-5234-4ced-870b-2f22b09cbcbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:40:04.301070 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac744a-5234-4ced-870b-2f22b09cbcbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:04.302674 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac744a-5234-4ced-870b-2f22b09cbcbb admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:04.314935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1441/2863] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:40:04.320261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e80210-0c7e-4807-adbf-0d60e3983269 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:04.326314 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:40:04.332438 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e80210-0c7e-4807-adbf-0d60e3983269 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:04.341934 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f7ad0-9f58-4ec5-8ced-6a4b60279b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:04.342853 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f7ad0-9f58-4ec5-8ced-6a4b60279b54 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:04.343348 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f7ad0-9f58-4ec5-8ced-6a4b60279b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:04.343628 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f7ad0-9f58-4ec5-8ced-6a4b60279b54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:04.344286 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f7ad0-9f58-4ec5-8ced-6a4b60279b54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:04.346421 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f7ad0-9f58-4ec5-8ced-6a4b60279b54 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:04.374605 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1423/2864] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:40:04 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:40:04.378930 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac744a-5234-4ced-870b-2f22b09cbcbb admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:04.389958 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac744a-5234-4ced-870b-2f22b09cbcbb admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:04.447461 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1bfb1-1a1c-4be4-85f9-330b6a7c9d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:04.448068 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1bfb1-1a1c-4be4-85f9-330b6a7c9d51 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:04.448335 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1bfb1-1a1c-4be4-85f9-330b6a7c9d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:04.448602 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1bfb1-1a1c-4be4-85f9-330b6a7c9d51 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:04.449243 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1bfb1-1a1c-4be4-85f9-330b6a7c9d51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:04.451247 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1bfb1-1a1c-4be4-85f9-330b6a7c9d51 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:04.475347 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1442/2865] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:40:04 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 16:40:04.479557 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f7ad0-9f58-4ec5-8ced-6a4b60279b54 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:04.490629 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f7ad0-9f58-4ec5-8ced-6a4b60279b54 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:04.495572 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d72eb6-ecb2-4251-a791-3ed8bc32650e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:04.496203 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d72eb6-ecb2-4251-a791-3ed8bc32650e admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:04.496485 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d72eb6-ecb2-4251-a791-3ed8bc32650e admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:04.496766 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d72eb6-ecb2-4251-a791-3ed8bc32650e admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:04.497410 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d72eb6-ecb2-4251-a791-3ed8bc32650e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:04.499064 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d72eb6-ecb2-4251-a791-3ed8bc32650e admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:04.509002 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1424/2866] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:40:04.513307 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1bfb1-1a1c-4be4-85f9-330b6a7c9d51 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:04.523406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1bfb1-1a1c-4be4-85f9-330b6a7c9d51 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:04.528314 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46099a62-72f4-4523-b415-a07f4c9777e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:04.528910 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46099a62-72f4-4523-b415-a07f4c9777e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:04.529191 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46099a62-72f4-4523-b415-a07f4c9777e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:04.529462 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46099a62-72f4-4523-b415-a07f4c9777e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:04.530106 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46099a62-72f4-4523-b415-a07f4c9777e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:04.531745 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46099a62-72f4-4523-b415-a07f4c9777e7 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:04.542316 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1443/2867] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:40:04.546444 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d72eb6-ecb2-4251-a791-3ed8bc32650e admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:04.556469 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d72eb6-ecb2-4251-a791-3ed8bc32650e admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:04.561400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c939bc-5c3c-45bf-94ed-bdbc77ba3e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:04.562040 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c939bc-5c3c-45bf-94ed-bdbc77ba3e7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:04.562323 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c939bc-5c3c-45bf-94ed-bdbc77ba3e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:04.562606 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c939bc-5c3c-45bf-94ed-bdbc77ba3e7c admin admin] PATH_INFO: `/v3/projects/ab2cd73250b145dc8a748b1ff0ca5476/users/a597b11eb8744613a3b31c74c8f578aa/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:04.579176 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c939bc-5c3c-45bf-94ed-bdbc77ba3e7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab2cd73250b145dc8a748b1ff0ca5476, user_id=a597b11eb8744613a3b31c74c8f578aa, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:04.582354 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c939bc-5c3c-45bf-94ed-bdbc77ba3e7c admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:04.599317 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1425/2868] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:40:04 2022] PUT /identity/v3/projects/ab2cd73250b145dc8a748b1ff0ca5476/users/a597b11eb8744613a3b31c74c8f578aa/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:40:04.668732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e35556-0ab1-41fb-9f63-7b93aec3c0e3 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:04.669288 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e35556-0ab1-41fb-9f63-7b93aec3c0e3 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:04.669808 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e35556-0ab1-41fb-9f63-7b93aec3c0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:04.704037 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-24e35556-0ab1-41fb-9f63-7b93aec3c0e3 None None] MFA Rules not processed for user `a597b11eb8744613a3b31c74c8f578aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:40:04.705266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-24e35556-0ab1-41fb-9f63-7b93aec3c0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:04.743882 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:40:04.772255 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1444/2869] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:40:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:40:04.784515 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c939bc-5c3c-45bf-94ed-bdbc77ba3e7c admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:04.786533 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-34c939bc-5c3c-45bf-94ed-bdbc77ba3e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:04.859087 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c939bc-5c3c-45bf-94ed-bdbc77ba3e7c admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:04.863391 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05adfe1f-5b1d-4588-a8f8-80109b53c6d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:04.863997 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05adfe1f-5b1d-4588-a8f8-80109b53c6d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:04.864270 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05adfe1f-5b1d-4588-a8f8-80109b53c6d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:04.864538 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05adfe1f-5b1d-4588-a8f8-80109b53c6d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:04.873138 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05adfe1f-5b1d-4588-a8f8-80109b53c6d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:04.874579 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05adfe1f-5b1d-4588-a8f8-80109b53c6d2 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:04.883365 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1426/2870] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:40:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:40:04.903813 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e35556-0ab1-41fb-9f63-7b93aec3c0e3 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:04.970920 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e35556-0ab1-41fb-9f63-7b93aec3c0e3 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:04.976148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317a41e-8cb0-4248-9eda-09ee58f41871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:04.976782 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317a41e-8cb0-4248-9eda-09ee58f41871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:04.977059 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317a41e-8cb0-4248-9eda-09ee58f41871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:04.977337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317a41e-8cb0-4248-9eda-09ee58f41871 admin admin] PATH_INFO: `/v3/users/a597b11eb8744613a3b31c74c8f578aa` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:04.978536 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317a41e-8cb0-4248-9eda-09ee58f41871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a597b11eb8744613a3b31c74c8f578aa)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:04.980510 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317a41e-8cb0-4248-9eda-09ee58f41871 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:05.031270 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-4317a41e-8cb0-4248-9eda-09ee58f41871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a597b11eb8744613a3b31c74c8f578aa'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:05.031872 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-4317a41e-8cb0-4248-9eda-09ee58f41871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a597b11eb8744613a3b31c74c8f578aa'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:05.039125 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-4317a41e-8cb0-4248-9eda-09ee58f41871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a597b11eb8744613a3b31c74c8f578aa'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:05.046828 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-4317a41e-8cb0-4248-9eda-09ee58f41871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a597b11eb8744613a3b31c74c8f578aa'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:05.047528 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-4317a41e-8cb0-4248-9eda-09ee58f41871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a597b11eb8744613a3b31c74c8f578aa'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:05.064523 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1445/2871] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:40:04 2022] DELETE /identity/v3/users/a597b11eb8744613a3b31c74c8f578aa => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:40:05.069208 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd40a2-2a73-4ebb-8e9a-a61c6c76e6cf None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:05.069497 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd40a2-2a73-4ebb-8e9a-a61c6c76e6cf None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:05.069769 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd40a2-2a73-4ebb-8e9a-a61c6c76e6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:05.090707 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-c1fd40a2-2a73-4ebb-8e9a-a61c6c76e6cf None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:40:05.092364 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c1fd40a2-2a73-4ebb-8e9a-a61c6c76e6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:05.151460 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1427/2872] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:40:05.166176 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317a41e-8cb0-4248-9eda-09ee58f41871 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:05.167813 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-4317a41e-8cb0-4248-9eda-09ee58f41871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:05.227557 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317a41e-8cb0-4248-9eda-09ee58f41871 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:05.232048 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2976d4-cffd-405e-ab7d-17d76305a864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:05.232776 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2976d4-cffd-405e-ab7d-17d76305a864 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:05.233050 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2976d4-cffd-405e-ab7d-17d76305a864 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:05.233305 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2976d4-cffd-405e-ab7d-17d76305a864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:05.242504 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2976d4-cffd-405e-ab7d-17d76305a864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:05.243951 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2976d4-cffd-405e-ab7d-17d76305a864 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:05.248897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:40:05.254088 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1446/2873] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:40:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:40:05.528778 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd40a2-2a73-4ebb-8e9a-a61c6c76e6cf None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:05.530288 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c1fd40a2-2a73-4ebb-8e9a-a61c6c76e6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:05.543218 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd40a2-2a73-4ebb-8e9a-a61c6c76e6cf None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:05.549088 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5481801-547b-4ac4-806f-7d16196c5cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:05.550213 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5481801-547b-4ac4-806f-7d16196c5cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:05.550213 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5481801-547b-4ac4-806f-7d16196c5cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:05.550444 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5481801-547b-4ac4-806f-7d16196c5cc6 admin admin] PATH_INFO: `/v3/projects/ab2cd73250b145dc8a748b1ff0ca5476` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:05.551545 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5481801-547b-4ac4-806f-7d16196c5cc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab2cd73250b145dc8a748b1ff0ca5476)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:05.553489 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5481801-547b-4ac4-806f-7d16196c5cc6 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:05.593306 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:40:05.608997 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-e5481801-547b-4ac4-806f-7d16196c5cc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab2cd73250b145dc8a748b1ff0ca5476', 'request_id': 'req-e5481801-547b-4ac4-806f-7d16196c5cc6'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:05.616528 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-e5481801-547b-4ac4-806f-7d16196c5cc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab2cd73250b145dc8a748b1ff0ca5476', 'request_id': 'req-e5481801-547b-4ac4-806f-7d16196c5cc6'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:05.623710 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-e5481801-547b-4ac4-806f-7d16196c5cc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab2cd73250b145dc8a748b1ff0ca5476', 'request_id': 'req-e5481801-547b-4ac4-806f-7d16196c5cc6'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:05.633990 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-e5481801-547b-4ac4-806f-7d16196c5cc6 admin admin] The token cache is being invalidate because project ab2cd73250b145dc8a748b1ff0ca5476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:40:05.634306 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-e5481801-547b-4ac4-806f-7d16196c5cc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:05.635331 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-e5481801-547b-4ac4-806f-7d16196c5cc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:05.636843 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1428/2874] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:40:05 2022] DELETE /identity/v3/projects/ab2cd73250b145dc8a748b1ff0ca5476 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:40:05.641868 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d226d9-a7cc-4e8b-b34b-f9dad7c8f687 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:05.642152 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d226d9-a7cc-4e8b-b34b-f9dad7c8f687 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:05.642424 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d226d9-a7cc-4e8b-b34b-f9dad7c8f687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:05.664962 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-e6d226d9-a7cc-4e8b-b34b-f9dad7c8f687 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:40:05.666172 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-e6d226d9-a7cc-4e8b-b34b-f9dad7c8f687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:05.730292 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1447/2875] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:40:05.738283 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14019c7-6b5f-48d3-98e5-73d73be0d9df None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:05.738569 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14019c7-6b5f-48d3-98e5-73d73be0d9df None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:05.738841 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14019c7-6b5f-48d3-98e5-73d73be0d9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:05.761309 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-c14019c7-6b5f-48d3-98e5-73d73be0d9df None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:40:05.762536 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c14019c7-6b5f-48d3-98e5-73d73be0d9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:05.772228 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1429/2876] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:40:05.776525 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d226d9-a7cc-4e8b-b34b-f9dad7c8f687 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:05.786921 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d226d9-a7cc-4e8b-b34b-f9dad7c8f687 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:05.792713 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803b1e9-0f05-4de7-9016-f39b09306b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:05.793326 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803b1e9-0f05-4de7-9016-f39b09306b81 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:05.793610 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803b1e9-0f05-4de7-9016-f39b09306b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:05.793879 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803b1e9-0f05-4de7-9016-f39b09306b81 admin admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:05.794538 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803b1e9-0f05-4de7-9016-f39b09306b81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:40:05.794823 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803b1e9-0f05-4de7-9016-f39b09306b81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:05.796584 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803b1e9-0f05-4de7-9016-f39b09306b81 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:05.808839 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1448/2877] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:40:05.813173 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14019c7-6b5f-48d3-98e5-73d73be0d9df None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:05.823602 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14019c7-6b5f-48d3-98e5-73d73be0d9df None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:05.829657 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558b8ae-4834-43c0-a4cc-66abf9aee451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:05.830255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558b8ae-4834-43c0-a4cc-66abf9aee451 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:05.830524 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558b8ae-4834-43c0-a4cc-66abf9aee451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:05.830817 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558b8ae-4834-43c0-a4cc-66abf9aee451 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:05.831479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558b8ae-4834-43c0-a4cc-66abf9aee451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:05.833374 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558b8ae-4834-43c0-a4cc-66abf9aee451 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:05.863559 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1430/2878] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:40:05 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:40:05.867660 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803b1e9-0f05-4de7-9016-f39b09306b81 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:05.877897 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803b1e9-0f05-4de7-9016-f39b09306b81 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:05.934339 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb842727-eb7c-4208-9d24-c564a75a8965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:05.934935 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb842727-eb7c-4208-9d24-c564a75a8965 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:05.935242 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb842727-eb7c-4208-9d24-c564a75a8965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:05.935575 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb842727-eb7c-4208-9d24-c564a75a8965 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:05.936288 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb842727-eb7c-4208-9d24-c564a75a8965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:05.938195 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb842727-eb7c-4208-9d24-c564a75a8965 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:05.963204 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1449/2879] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:40:05 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:40:05.967620 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558b8ae-4834-43c0-a4cc-66abf9aee451 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:05.977910 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558b8ae-4834-43c0-a4cc-66abf9aee451 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:05.983400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042a922-9857-4322-813c-7734f9cbf9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:05.984029 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042a922-9857-4322-813c-7734f9cbf9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:05.984317 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042a922-9857-4322-813c-7734f9cbf9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:05.984589 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042a922-9857-4322-813c-7734f9cbf9b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:05.985231 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042a922-9857-4322-813c-7734f9cbf9b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:05.986973 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042a922-9857-4322-813c-7734f9cbf9b4 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:05.997251 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1431/2880] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 16:40:06.001194 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb842727-eb7c-4208-9d24-c564a75a8965 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:06.012099 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb842727-eb7c-4208-9d24-c564a75a8965 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:06.017471 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07767703-d082-4b6c-a116-8f9b17b340ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:06.018070 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07767703-d082-4b6c-a116-8f9b17b340ca admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:06.018351 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07767703-d082-4b6c-a116-8f9b17b340ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:06.018625 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07767703-d082-4b6c-a116-8f9b17b340ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:06.019312 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07767703-d082-4b6c-a116-8f9b17b340ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:06.020940 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07767703-d082-4b6c-a116-8f9b17b340ca admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:06.031521 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1450/2881] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:40:06.035662 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042a922-9857-4322-813c-7734f9cbf9b4 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:06.046279 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042a922-9857-4322-813c-7734f9cbf9b4 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:06.052097 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d49fb7-2f90-4203-8315-a3a9a38f9adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:06.052756 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d49fb7-2f90-4203-8315-a3a9a38f9adf admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:06.053035 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d49fb7-2f90-4203-8315-a3a9a38f9adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:06.053306 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d49fb7-2f90-4203-8315-a3a9a38f9adf admin admin] PATH_INFO: `/v3/projects/900889d138f44191bea954ee2cf704ce/users/659f675bb7ec41078e2ab1507c8d94fb/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:06.068754 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d49fb7-2f90-4203-8315-a3a9a38f9adf admin admin] RBAC: Authorizing `identity:create_grant(project_id=900889d138f44191bea954ee2cf704ce, user_id=659f675bb7ec41078e2ab1507c8d94fb, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:06.071488 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d49fb7-2f90-4203-8315-a3a9a38f9adf admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:06.087400 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1432/2882] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:40:06 2022] PUT /identity/v3/projects/900889d138f44191bea954ee2cf704ce/users/659f675bb7ec41078e2ab1507c8d94fb/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:40:06.100353 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67442d38-b98e-4062-93df-e8be4be62f99 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:06.100699 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67442d38-b98e-4062-93df-e8be4be62f99 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:06.101092 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67442d38-b98e-4062-93df-e8be4be62f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:06.131236 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-67442d38-b98e-4062-93df-e8be4be62f99 None None] MFA Rules not processed for user `659f675bb7ec41078e2ab1507c8d94fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:40:06.132366 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-67442d38-b98e-4062-93df-e8be4be62f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:06.198468 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:40:06.208934 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1451/2883] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:40:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 16:40:06.213570 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d49fb7-2f90-4203-8315-a3a9a38f9adf admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:06.277635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d49fb7-2f90-4203-8315-a3a9a38f9adf admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:06.283609 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ac322-b66a-4e67-8ea1-4cef1033ce20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:06.284224 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ac322-b66a-4e67-8ea1-4cef1033ce20 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:06.284501 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ac322-b66a-4e67-8ea1-4cef1033ce20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:06.284758 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ac322-b66a-4e67-8ea1-4cef1033ce20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:06.285378 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ac322-b66a-4e67-8ea1-4cef1033ce20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:06.287342 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ac322-b66a-4e67-8ea1-4cef1033ce20 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:06.316828 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1433/2884] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:40:06 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:40:06.321188 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67442d38-b98e-4062-93df-e8be4be62f99 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:06.332603 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67442d38-b98e-4062-93df-e8be4be62f99 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:06.394035 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8cff3-6d4f-4719-99af-3461683ceffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:06.394568 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8cff3-6d4f-4719-99af-3461683ceffc admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:06.394833 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8cff3-6d4f-4719-99af-3461683ceffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:06.395134 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8cff3-6d4f-4719-99af-3461683ceffc admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:06.395762 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8cff3-6d4f-4719-99af-3461683ceffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:06.397673 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8cff3-6d4f-4719-99af-3461683ceffc admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:06.422884 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1452/2885] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:40:06 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:40:06.427018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ac322-b66a-4e67-8ea1-4cef1033ce20 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:06.437922 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ac322-b66a-4e67-8ea1-4cef1033ce20 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:06.443972 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6e142-8531-4f69-91c5-06dc86426dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:06.444565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6e142-8531-4f69-91c5-06dc86426dcb admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:06.444842 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6e142-8531-4f69-91c5-06dc86426dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:06.445112 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6e142-8531-4f69-91c5-06dc86426dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:06.445757 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6e142-8531-4f69-91c5-06dc86426dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:06.447444 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6e142-8531-4f69-91c5-06dc86426dcb admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:06.458776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1434/2886] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:40:06.463700 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8cff3-6d4f-4719-99af-3461683ceffc admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:06.477694 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8cff3-6d4f-4719-99af-3461683ceffc admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:06.483544 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1148db5-0faf-458c-84e9-c29c6272d4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:06.484148 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1148db5-0faf-458c-84e9-c29c6272d4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:06.484430 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1148db5-0faf-458c-84e9-c29c6272d4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:06.484700 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1148db5-0faf-458c-84e9-c29c6272d4a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:06.485343 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1148db5-0faf-458c-84e9-c29c6272d4a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:06.487010 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1148db5-0faf-458c-84e9-c29c6272d4a0 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:06.497818 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1453/2887] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:40:06.503471 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6e142-8531-4f69-91c5-06dc86426dcb admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:06.514624 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6e142-8531-4f69-91c5-06dc86426dcb admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:06.519484 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c32197-7d1a-40c1-946a-9a1cb0bc9ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:06.520147 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c32197-7d1a-40c1-946a-9a1cb0bc9ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:06.520422 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c32197-7d1a-40c1-946a-9a1cb0bc9ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:06.520693 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c32197-7d1a-40c1-946a-9a1cb0bc9ae1 admin admin] PATH_INFO: `/v3/projects/13bce317819b4162af5bcc3b75ffed50/users/5e97128a45ae4cc3bb13927d5887c62f/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:06.535130 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c32197-7d1a-40c1-946a-9a1cb0bc9ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13bce317819b4162af5bcc3b75ffed50, user_id=5e97128a45ae4cc3bb13927d5887c62f, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:06.537814 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c32197-7d1a-40c1-946a-9a1cb0bc9ae1 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:06.552338 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1435/2888] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:40:06 2022] PUT /identity/v3/projects/13bce317819b4162af5bcc3b75ffed50/users/5e97128a45ae4cc3bb13927d5887c62f/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:40:06.562707 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a03a4a-8549-48fc-8de0-a7ffc0d1a3bd None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:06.562958 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a03a4a-8549-48fc-8de0-a7ffc0d1a3bd None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:06.563284 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a03a4a-8549-48fc-8de0-a7ffc0d1a3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:06.593309 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-07a03a4a-8549-48fc-8de0-a7ffc0d1a3bd None None] MFA Rules not processed for user `5e97128a45ae4cc3bb13927d5887c62f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:40:06.594521 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-07a03a4a-8549-48fc-8de0-a7ffc0d1a3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:06.663128 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1454/2889] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:40:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:40:06.667765 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c32197-7d1a-40c1-946a-9a1cb0bc9ae1 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:06.674078 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:40:06.737494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c32197-7d1a-40c1-946a-9a1cb0bc9ae1 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:06.743189 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6eed50-ab6e-46d0-a767-d7f2477c08b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:06.743791 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6eed50-ab6e-46d0-a767-d7f2477c08b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:06.744067 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6eed50-ab6e-46d0-a767-d7f2477c08b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:06.744333 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6eed50-ab6e-46d0-a767-d7f2477c08b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:06.744954 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6eed50-ab6e-46d0-a767-d7f2477c08b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:06.746869 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6eed50-ab6e-46d0-a767-d7f2477c08b1 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:06.785000 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1436/2890] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:40:06 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:40:06.791202 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a03a4a-8549-48fc-8de0-a7ffc0d1a3bd None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:06.804572 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a03a4a-8549-48fc-8de0-a7ffc0d1a3bd None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:06.866960 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd102c1-7b9d-44a5-8c4b-ff17b87da210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:06.867607 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd102c1-7b9d-44a5-8c4b-ff17b87da210 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:06.867887 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd102c1-7b9d-44a5-8c4b-ff17b87da210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:06.868160 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd102c1-7b9d-44a5-8c4b-ff17b87da210 admin admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:06.868791 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd102c1-7b9d-44a5-8c4b-ff17b87da210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:06.870732 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd102c1-7b9d-44a5-8c4b-ff17b87da210 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:06.880957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:40:06.894593 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1455/2891] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:40:06 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:40:06.898776 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6eed50-ab6e-46d0-a767-d7f2477c08b1 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:06.909644 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6eed50-ab6e-46d0-a767-d7f2477c08b1 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:06.915479 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce28652-1d86-4085-9208-618aaf66632e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:06.916017 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce28652-1d86-4085-9208-618aaf66632e admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:06.916266 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce28652-1d86-4085-9208-618aaf66632e admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:06.916544 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce28652-1d86-4085-9208-618aaf66632e admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:06.917180 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce28652-1d86-4085-9208-618aaf66632e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:06.918787 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce28652-1d86-4085-9208-618aaf66632e admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:06.929858 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1437/2892] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:40:06.934062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd102c1-7b9d-44a5-8c4b-ff17b87da210 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:06.944971 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd102c1-7b9d-44a5-8c4b-ff17b87da210 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:06.950490 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ddf89-1bf5-407c-b145-b45a564615c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:06.951195 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ddf89-1bf5-407c-b145-b45a564615c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:06.951484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ddf89-1bf5-407c-b145-b45a564615c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:06.951753 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ddf89-1bf5-407c-b145-b45a564615c9 admin admin] PATH_INFO: `/v3/projects/055bda9c62054d45833ae79ce4b85702/users/db06a34b9da54addbdd33494eafbbe08/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:06.969220 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ddf89-1bf5-407c-b145-b45a564615c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=055bda9c62054d45833ae79ce4b85702, user_id=db06a34b9da54addbdd33494eafbbe08, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:06.971914 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ddf89-1bf5-407c-b145-b45a564615c9 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:06.986965 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1456/2893] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:40:06 2022] PUT /identity/v3/projects/055bda9c62054d45833ae79ce4b85702/users/db06a34b9da54addbdd33494eafbbe08/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 16:40:06.992575 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce28652-1d86-4085-9208-618aaf66632e admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:07.005091 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce28652-1d86-4085-9208-618aaf66632e admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:07.062060 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b86e4b-1f3e-4e02-8e76-33c347b2fbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:07.062668 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b86e4b-1f3e-4e02-8e76-33c347b2fbdf admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:07.062933 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b86e4b-1f3e-4e02-8e76-33c347b2fbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:07.063228 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b86e4b-1f3e-4e02-8e76-33c347b2fbdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:07.063861 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b86e4b-1f3e-4e02-8e76-33c347b2fbdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:07.065473 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b86e4b-1f3e-4e02-8e76-33c347b2fbdf admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:07.075216 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1438/2894] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:40:07.079649 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ddf89-1bf5-407c-b145-b45a564615c9 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:07.090848 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ddf89-1bf5-407c-b145-b45a564615c9 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:07.096327 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000452e-01a6-4da0-9fcc-de15ab5deea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:07.096990 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000452e-01a6-4da0-9fcc-de15ab5deea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:07.097270 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000452e-01a6-4da0-9fcc-de15ab5deea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:07.097550 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000452e-01a6-4da0-9fcc-de15ab5deea7 admin admin] PATH_INFO: `/v3/projects/055bda9c62054d45833ae79ce4b85702/users/db06a34b9da54addbdd33494eafbbe08/roles/066f46534195417295e63a5316632eae` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:07.100061 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000452e-01a6-4da0-9fcc-de15ab5deea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=055bda9c62054d45833ae79ce4b85702, user_id=db06a34b9da54addbdd33494eafbbe08, role_id=066f46534195417295e63a5316632eae)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:07.102789 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000452e-01a6-4da0-9fcc-de15ab5deea7 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:07.114437 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1457/2895] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:40:07 2022] PUT /identity/v3/projects/055bda9c62054d45833ae79ce4b85702/users/db06a34b9da54addbdd33494eafbbe08/roles/066f46534195417295e63a5316632eae => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:40:07.130382 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fed58-75cc-463a-9154-ad0a9ce17a9b None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:07.130725 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fed58-75cc-463a-9154-ad0a9ce17a9b None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:07.131018 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fed58-75cc-463a-9154-ad0a9ce17a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:07.164462 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-c17fed58-75cc-463a-9154-ad0a9ce17a9b None None] MFA Rules not processed for user `db06a34b9da54addbdd33494eafbbe08`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:40:07.165846 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c17fed58-75cc-463a-9154-ad0a9ce17a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:07.234059 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:40:07.239431 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1439/2896] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:40:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:40:07.251091 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000452e-01a6-4da0-9fcc-de15ab5deea7 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:07.252859 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-1000452e-01a6-4da0-9fcc-de15ab5deea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:07.317997 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000452e-01a6-4da0-9fcc-de15ab5deea7 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:07.322319 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47737572-b2de-4813-a65e-4f35ad2aa24a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:07.322929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47737572-b2de-4813-a65e-4f35ad2aa24a service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:07.323231 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47737572-b2de-4813-a65e-4f35ad2aa24a service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:07.323494 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47737572-b2de-4813-a65e-4f35ad2aa24a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:07.382337 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47737572-b2de-4813-a65e-4f35ad2aa24a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:07.383803 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47737572-b2de-4813-a65e-4f35ad2aa24a service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:07.393789 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1458/2897] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:40:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:40:09.019397 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fed58-75cc-463a-9154-ad0a9ce17a9b None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:09.021110 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c17fed58-75cc-463a-9154-ad0a9ce17a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:09.033847 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fed58-75cc-463a-9154-ad0a9ce17a9b None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:09.038006 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f97cd-14df-4cb0-be6f-9a727f161ee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:09.038663 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f97cd-14df-4cb0-be6f-9a727f161ee2 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:09.038940 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f97cd-14df-4cb0-be6f-9a727f161ee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:09.039257 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f97cd-14df-4cb0-be6f-9a727f161ee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:09.095768 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f97cd-14df-4cb0-be6f-9a727f161ee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:09.097133 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f97cd-14df-4cb0-be6f-9a727f161ee2 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:09.106367 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1440/2898] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:40:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:40:09.681862 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47737572-b2de-4813-a65e-4f35ad2aa24a service cinder] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:09.691034 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47737572-b2de-4813-a65e-4f35ad2aa24a service cinder] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:09.695192 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276da95-7838-4e91-9a54-ccc50208e3c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:09.695790 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276da95-7838-4e91-9a54-ccc50208e3c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:09.696084 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276da95-7838-4e91-9a54-ccc50208e3c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:09.696331 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276da95-7838-4e91-9a54-ccc50208e3c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:09.705614 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276da95-7838-4e91-9a54-ccc50208e3c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:09.707037 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276da95-7838-4e91-9a54-ccc50208e3c6 service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:09.716641 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1459/2899] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:40:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:40:13.663617 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f97cd-14df-4cb0-be6f-9a727f161ee2 service cinder] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:13.728578 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f97cd-14df-4cb0-be6f-9a727f161ee2 service cinder] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:13.736778 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1b417-3a23-49ac-900e-99b6387fb57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:13.737735 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1b417-3a23-49ac-900e-99b6387fb57a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:13.738139 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1b417-3a23-49ac-900e-99b6387fb57a admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:13.738556 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1b417-3a23-49ac-900e-99b6387fb57a admin admin] PATH_INFO: `/v3/users/659f675bb7ec41078e2ab1507c8d94fb` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:13.740404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1b417-3a23-49ac-900e-99b6387fb57a admin admin] RBAC: Authorizing `identity:delete_user(user_id=659f675bb7ec41078e2ab1507c8d94fb)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:13.743562 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1b417-3a23-49ac-900e-99b6387fb57a admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:13.796825 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-1dd1b417-3a23-49ac-900e-99b6387fb57a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '659f675bb7ec41078e2ab1507c8d94fb'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:13.797477 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-1dd1b417-3a23-49ac-900e-99b6387fb57a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '659f675bb7ec41078e2ab1507c8d94fb'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:13.804982 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-1dd1b417-3a23-49ac-900e-99b6387fb57a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '659f675bb7ec41078e2ab1507c8d94fb'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:13.805641 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-1dd1b417-3a23-49ac-900e-99b6387fb57a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '659f675bb7ec41078e2ab1507c8d94fb'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:13.814032 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-1dd1b417-3a23-49ac-900e-99b6387fb57a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '659f675bb7ec41078e2ab1507c8d94fb'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:13.831615 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1441/2900] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:40:13 2022] DELETE /identity/v3/users/659f675bb7ec41078e2ab1507c8d94fb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:40:13.836338 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d521db5-9f79-43e8-9f22-d64f756dbf9f None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:13.836837 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d521db5-9f79-43e8-9f22-d64f756dbf9f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:13.836936 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d521db5-9f79-43e8-9f22-d64f756dbf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:13.856174 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-3d521db5-9f79-43e8-9f22-d64f756dbf9f None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:40:13.857379 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-3d521db5-9f79-43e8-9f22-d64f756dbf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:13.909073 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:40:13.919610 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1460/2901] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:40:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:40:13.929660 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1b417-3a23-49ac-900e-99b6387fb57a admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:13.931103 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-1dd1b417-3a23-49ac-900e-99b6387fb57a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:13.951335 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:40:13.991391 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1b417-3a23-49ac-900e-99b6387fb57a admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:13.995862 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041a4f2-8174-42cb-a5cd-083bf805ab71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:13.996398 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041a4f2-8174-42cb-a5cd-083bf805ab71 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:13.996695 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041a4f2-8174-42cb-a5cd-083bf805ab71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:13.996964 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041a4f2-8174-42cb-a5cd-083bf805ab71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:14.007620 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041a4f2-8174-42cb-a5cd-083bf805ab71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:14.009076 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041a4f2-8174-42cb-a5cd-083bf805ab71 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:14.019638 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1442/2902] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:40:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 16:40:14.295637 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d521db5-9f79-43e8-9f22-d64f756dbf9f None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:14.297381 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-3d521db5-9f79-43e8-9f22-d64f756dbf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:14.311434 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d521db5-9f79-43e8-9f22-d64f756dbf9f None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:14.317012 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c15ff5-a3ab-4104-a569-1b2398c0adc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:14.317652 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c15ff5-a3ab-4104-a569-1b2398c0adc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:14.317977 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c15ff5-a3ab-4104-a569-1b2398c0adc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:14.318249 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c15ff5-a3ab-4104-a569-1b2398c0adc4 admin admin] PATH_INFO: `/v3/projects/900889d138f44191bea954ee2cf704ce` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:14.319484 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c15ff5-a3ab-4104-a569-1b2398c0adc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=900889d138f44191bea954ee2cf704ce)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:14.321449 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c15ff5-a3ab-4104-a569-1b2398c0adc4 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:14.370445 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-29c15ff5-a3ab-4104-a569-1b2398c0adc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '900889d138f44191bea954ee2cf704ce', 'request_id': 'req-29c15ff5-a3ab-4104-a569-1b2398c0adc4'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:14.378119 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-29c15ff5-a3ab-4104-a569-1b2398c0adc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '900889d138f44191bea954ee2cf704ce', 'request_id': 'req-29c15ff5-a3ab-4104-a569-1b2398c0adc4'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:14.385571 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-29c15ff5-a3ab-4104-a569-1b2398c0adc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '900889d138f44191bea954ee2cf704ce', 'request_id': 'req-29c15ff5-a3ab-4104-a569-1b2398c0adc4'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:14.396455 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-29c15ff5-a3ab-4104-a569-1b2398c0adc4 admin admin] The token cache is being invalidate because project 900889d138f44191bea954ee2cf704ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:40:14.396734 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-29c15ff5-a3ab-4104-a569-1b2398c0adc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:14.397361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-29c15ff5-a3ab-4104-a569-1b2398c0adc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:14.398852 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1461/2903] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:40:14 2022] DELETE /identity/v3/projects/900889d138f44191bea954ee2cf704ce => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:40:14.403369 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041a4f2-8174-42cb-a5cd-083bf805ab71 service neutron] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:14.413587 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041a4f2-8174-42cb-a5cd-083bf805ab71 service neutron] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:14.471932 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b21847-568a-4ee6-b869-ade14c696958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:14.472606 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b21847-568a-4ee6-b869-ade14c696958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:14.472879 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b21847-568a-4ee6-b869-ade14c696958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:14.473147 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b21847-568a-4ee6-b869-ade14c696958 admin admin] PATH_INFO: `/v3/users/5e97128a45ae4cc3bb13927d5887c62f` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:14.474297 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b21847-568a-4ee6-b869-ade14c696958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e97128a45ae4cc3bb13927d5887c62f)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:14.476255 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b21847-568a-4ee6-b869-ade14c696958 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:14.523848 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-18b21847-568a-4ee6-b869-ade14c696958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e97128a45ae4cc3bb13927d5887c62f'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:14.524419 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-18b21847-568a-4ee6-b869-ade14c696958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e97128a45ae4cc3bb13927d5887c62f'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:14.531264 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-18b21847-568a-4ee6-b869-ade14c696958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e97128a45ae4cc3bb13927d5887c62f'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:14.531893 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-18b21847-568a-4ee6-b869-ade14c696958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e97128a45ae4cc3bb13927d5887c62f'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:14.541025 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-18b21847-568a-4ee6-b869-ade14c696958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e97128a45ae4cc3bb13927d5887c62f'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:14.559191 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1443/2904] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:40:14 2022] DELETE /identity/v3/users/5e97128a45ae4cc3bb13927d5887c62f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:40:14.847589 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c15ff5-a3ab-4104-a569-1b2398c0adc4 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:14.849099 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-29c15ff5-a3ab-4104-a569-1b2398c0adc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:14.864243 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c15ff5-a3ab-4104-a569-1b2398c0adc4 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:14.922929 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a449a3-7380-4b92-927d-0d138012ab04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:14.923582 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a449a3-7380-4b92-927d-0d138012ab04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:14.923856 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a449a3-7380-4b92-927d-0d138012ab04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:14.924117 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a449a3-7380-4b92-927d-0d138012ab04 admin admin] PATH_INFO: `/v3/projects/13bce317819b4162af5bcc3b75ffed50` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:14.925244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a449a3-7380-4b92-927d-0d138012ab04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13bce317819b4162af5bcc3b75ffed50)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:14.929494 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a449a3-7380-4b92-927d-0d138012ab04 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:14.977849 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-26a449a3-7380-4b92-927d-0d138012ab04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13bce317819b4162af5bcc3b75ffed50', 'request_id': 'req-26a449a3-7380-4b92-927d-0d138012ab04'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:14.985270 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-26a449a3-7380-4b92-927d-0d138012ab04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13bce317819b4162af5bcc3b75ffed50', 'request_id': 'req-26a449a3-7380-4b92-927d-0d138012ab04'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:14.991729 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-26a449a3-7380-4b92-927d-0d138012ab04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13bce317819b4162af5bcc3b75ffed50', 'request_id': 'req-26a449a3-7380-4b92-927d-0d138012ab04'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:15.003636 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-26a449a3-7380-4b92-927d-0d138012ab04 admin admin] The token cache is being invalidate because project 13bce317819b4162af5bcc3b75ffed50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:40:15.004046 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-26a449a3-7380-4b92-927d-0d138012ab04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:15.004881 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-26a449a3-7380-4b92-927d-0d138012ab04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:15.006551 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1462/2905] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:40:14 2022] DELETE /identity/v3/projects/13bce317819b4162af5bcc3b75ffed50 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:40:15.011538 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b21847-568a-4ee6-b869-ade14c696958 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:15.013163 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-18b21847-568a-4ee6-b869-ade14c696958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:15.026289 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b21847-568a-4ee6-b869-ade14c696958 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:15.066665 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:40:15.089502 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f037a-1cfb-4b3e-9873-9db8d9fd3da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:15.090140 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f037a-1cfb-4b3e-9873-9db8d9fd3da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:15.090417 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f037a-1cfb-4b3e-9873-9db8d9fd3da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:15.090688 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f037a-1cfb-4b3e-9873-9db8d9fd3da6 admin admin] PATH_INFO: `/v3/users/db06a34b9da54addbdd33494eafbbe08` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:15.091932 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f037a-1cfb-4b3e-9873-9db8d9fd3da6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db06a34b9da54addbdd33494eafbbe08)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:15.093882 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f037a-1cfb-4b3e-9873-9db8d9fd3da6 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:15.146151 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-0a5f037a-1cfb-4b3e-9873-9db8d9fd3da6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db06a34b9da54addbdd33494eafbbe08'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:15.146821 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-0a5f037a-1cfb-4b3e-9873-9db8d9fd3da6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db06a34b9da54addbdd33494eafbbe08'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:15.153865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-0a5f037a-1cfb-4b3e-9873-9db8d9fd3da6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db06a34b9da54addbdd33494eafbbe08'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:15.154510 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-0a5f037a-1cfb-4b3e-9873-9db8d9fd3da6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db06a34b9da54addbdd33494eafbbe08'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:15.162731 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-0a5f037a-1cfb-4b3e-9873-9db8d9fd3da6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db06a34b9da54addbdd33494eafbbe08'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:15.180946 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1444/2906] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:40:15 2022] DELETE /identity/v3/users/db06a34b9da54addbdd33494eafbbe08 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:40:15.463079 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a449a3-7380-4b92-927d-0d138012ab04 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:15.464581 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-26a449a3-7380-4b92-927d-0d138012ab04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:15.479427 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a449a3-7380-4b92-927d-0d138012ab04 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:15.488087 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:40:15.539568 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4233f2d-cd49-48c0-be44-7ead6ae3ce05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:15.540204 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4233f2d-cd49-48c0-be44-7ead6ae3ce05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:15.540481 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4233f2d-cd49-48c0-be44-7ead6ae3ce05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:15.540749 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4233f2d-cd49-48c0-be44-7ead6ae3ce05 admin admin] PATH_INFO: `/v3/projects/055bda9c62054d45833ae79ce4b85702` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:15.541861 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4233f2d-cd49-48c0-be44-7ead6ae3ce05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=055bda9c62054d45833ae79ce4b85702)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:15.543886 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4233f2d-cd49-48c0-be44-7ead6ae3ce05 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:15.591874 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c4233f2d-cd49-48c0-be44-7ead6ae3ce05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '055bda9c62054d45833ae79ce4b85702', 'request_id': 'req-c4233f2d-cd49-48c0-be44-7ead6ae3ce05'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:15.600473 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c4233f2d-cd49-48c0-be44-7ead6ae3ce05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '055bda9c62054d45833ae79ce4b85702', 'request_id': 'req-c4233f2d-cd49-48c0-be44-7ead6ae3ce05'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:15.607377 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c4233f2d-cd49-48c0-be44-7ead6ae3ce05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '055bda9c62054d45833ae79ce4b85702', 'request_id': 'req-c4233f2d-cd49-48c0-be44-7ead6ae3ce05'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:15.617813 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c4233f2d-cd49-48c0-be44-7ead6ae3ce05 admin admin] The token cache is being invalidate because project 055bda9c62054d45833ae79ce4b85702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:40:15.618098 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c4233f2d-cd49-48c0-be44-7ead6ae3ce05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:15.618728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-c4233f2d-cd49-48c0-be44-7ead6ae3ce05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:40:15.620250 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1463/2907] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:40:15 2022] DELETE /identity/v3/projects/055bda9c62054d45833ae79ce4b85702 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:40:15.625279 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb539a8-1b55-4df4-8455-3d8ada621145 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:15.625562 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb539a8-1b55-4df4-8455-3d8ada621145 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:15.625835 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb539a8-1b55-4df4-8455-3d8ada621145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:15.646815 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-1bb539a8-1b55-4df4-8455-3d8ada621145 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:40:15.648062 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-1bb539a8-1b55-4df4-8455-3d8ada621145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:15.712058 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1445/2908] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:40:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:40:15.725100 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbdd82-da5c-429c-8233-c0bd416b46d6 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:15.725385 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbdd82-da5c-429c-8233-c0bd416b46d6 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:15.725659 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbdd82-da5c-429c-8233-c0bd416b46d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:15.746363 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-a8fbdd82-da5c-429c-8233-c0bd416b46d6 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:40:15.747628 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-a8fbdd82-da5c-429c-8233-c0bd416b46d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:15.756392 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1464/2909] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:40:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:40:15.761348 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb539a8-1b55-4df4-8455-3d8ada621145 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:15.771494 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb539a8-1b55-4df4-8455-3d8ada621145 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:15.776997 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63dbb31-8a10-4be6-ac4d-49017a67d66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:15.777601 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63dbb31-8a10-4be6-ac4d-49017a67d66b admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:15.777879 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63dbb31-8a10-4be6-ac4d-49017a67d66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:15.778174 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63dbb31-8a10-4be6-ac4d-49017a67d66b admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:15.778831 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63dbb31-8a10-4be6-ac4d-49017a67d66b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 16:40:15.779241 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63dbb31-8a10-4be6-ac4d-49017a67d66b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:15.780855 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63dbb31-8a10-4be6-ac4d-49017a67d66b admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:15.792635 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1446/2910] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Oct 4 16:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 16:40:15.796959 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbdd82-da5c-429c-8233-c0bd416b46d6 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:15.806548 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbdd82-da5c-429c-8233-c0bd416b46d6 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:15.811513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fc6b5-694b-48be-a5d8-44d39c851056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:15.812109 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fc6b5-694b-48be-a5d8-44d39c851056 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:15.812384 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fc6b5-694b-48be-a5d8-44d39c851056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:15.812654 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fc6b5-694b-48be-a5d8-44d39c851056 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:15.813293 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04fc6b5-694b-48be-a5d8-44d39c851056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:15.815306 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04fc6b5-694b-48be-a5d8-44d39c851056 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:15.848809 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1465/2911] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Oct 4 16:40:15 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:40:15.852950 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63dbb31-8a10-4be6-ac4d-49017a67d66b admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:15.863111 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63dbb31-8a10-4be6-ac4d-49017a67d66b admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:15.908372 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:40:15.923953 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2069a45-8c5f-4e68-880a-b67a2d484505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:15.924569 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2069a45-8c5f-4e68-880a-b67a2d484505 admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:15.924847 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2069a45-8c5f-4e68-880a-b67a2d484505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:15.925123 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2069a45-8c5f-4e68-880a-b67a2d484505 admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:15.925752 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2069a45-8c5f-4e68-880a-b67a2d484505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:15.927719 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2069a45-8c5f-4e68-880a-b67a2d484505 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:15.954486 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1447/2912] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Oct 4 16:40:15 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 16:40:15.957786 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fc6b5-694b-48be-a5d8-44d39c851056 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:15.973603 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fc6b5-694b-48be-a5d8-44d39c851056 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:15.980184 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd40dfc-ac31-494b-9e3f-a1ba7e9397ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:15.980792 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd40dfc-ac31-494b-9e3f-a1ba7e9397ce admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:15.981070 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd40dfc-ac31-494b-9e3f-a1ba7e9397ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:15.981476 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd40dfc-ac31-494b-9e3f-a1ba7e9397ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:15.982124 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd40dfc-ac31-494b-9e3f-a1ba7e9397ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:15.983770 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd40dfc-ac31-494b-9e3f-a1ba7e9397ce admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:15.994244 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1466/2913] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:40:15.998563 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2069a45-8c5f-4e68-880a-b67a2d484505 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:16.009357 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2069a45-8c5f-4e68-880a-b67a2d484505 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:16.015735 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfbefe-a4ba-429d-9398-4ac5ea39466d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:16.016343 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfbefe-a4ba-429d-9398-4ac5ea39466d admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:16.016629 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfbefe-a4ba-429d-9398-4ac5ea39466d admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:16.016904 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfbefe-a4ba-429d-9398-4ac5ea39466d admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:16.017568 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfbefe-a4ba-429d-9398-4ac5ea39466d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:16.019222 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfbefe-a4ba-429d-9398-4ac5ea39466d admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:16.030388 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1448/2914] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Oct 4 16:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 16:40:16.034606 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd40dfc-ac31-494b-9e3f-a1ba7e9397ce admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:16.044900 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd40dfc-ac31-494b-9e3f-a1ba7e9397ce admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:16.050103 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cad658-1aee-469d-8bb9-372ca6fbabb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:16.050842 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cad658-1aee-469d-8bb9-372ca6fbabb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:16.051151 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cad658-1aee-469d-8bb9-372ca6fbabb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:16.051426 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cad658-1aee-469d-8bb9-372ca6fbabb5 admin admin] PATH_INFO: `/v3/projects/a66c04f0c98e4cdeb356769a8d480480/users/43597941419e4cf5901916edc9252e4e/roles/5cf61f379b4d49cb9e19605796d13f62` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:16.066784 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cad658-1aee-469d-8bb9-372ca6fbabb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a66c04f0c98e4cdeb356769a8d480480, user_id=43597941419e4cf5901916edc9252e4e, role_id=5cf61f379b4d49cb9e19605796d13f62)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:16.069719 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cad658-1aee-469d-8bb9-372ca6fbabb5 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:16.084513 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1467/2915] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Oct 4 16:40:16 2022] PUT /identity/v3/projects/a66c04f0c98e4cdeb356769a8d480480/users/43597941419e4cf5901916edc9252e4e/roles/5cf61f379b4d49cb9e19605796d13f62 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:40:16.090740 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73308604-442d-48c0-8b30-13f72f006588 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:16.091093 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73308604-442d-48c0-8b30-13f72f006588 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:16.091387 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73308604-442d-48c0-8b30-13f72f006588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:16.116767 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-73308604-442d-48c0-8b30-13f72f006588 None None] MFA Rules not processed for user `f4a141c4b1594c35992b7b147f7c2904`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:40:16.117897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-73308604-442d-48c0-8b30-13f72f006588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:16.178799 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1449/2916] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:40:16.188776 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cad658-1aee-469d-8bb9-372ca6fbabb5 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:16.190667 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-61cad658-1aee-469d-8bb9-372ca6fbabb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:16.232967 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:40:16.254592 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cad658-1aee-469d-8bb9-372ca6fbabb5 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:16.260858 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc1840-b3e8-4c17-a61f-51422e036807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:16.261704 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc1840-b3e8-4c17-a61f-51422e036807 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:16.262080 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc1840-b3e8-4c17-a61f-51422e036807 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:16.262431 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc1840-b3e8-4c17-a61f-51422e036807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:16.275312 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc1840-b3e8-4c17-a61f-51422e036807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:16.276752 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc1840-b3e8-4c17-a61f-51422e036807 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:16.286293 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1468/2917] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:40:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:40:16.926838 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90950d51-12b9-4312-bbb7-e9ad065735b1 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:16.927040 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90950d51-12b9-4312-bbb7-e9ad065735b1 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:16.927314 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90950d51-12b9-4312-bbb7-e9ad065735b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:16.959742 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-90950d51-12b9-4312-bbb7-e9ad065735b1 None None] MFA Rules not processed for user `43597941419e4cf5901916edc9252e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:40:16.960969 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-90950d51-12b9-4312-bbb7-e9ad065735b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:17.026829 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1450/2918] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:40:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:40:17.037703 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc1840-b3e8-4c17-a61f-51422e036807 service neutron] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:17.039292 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-e0dc1840-b3e8-4c17-a61f-51422e036807 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:17.099065 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc1840-b3e8-4c17-a61f-51422e036807 service neutron] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:17.103118 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d4863-b1c0-4c70-acc1-737055a97779 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d717575c1d8415fbd09d61d1cbef2d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:17.103730 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d4863-b1c0-4c70-acc1-737055a97779 service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:17.104002 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d4863-b1c0-4c70-acc1-737055a97779 service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:17.104266 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d4863-b1c0-4c70-acc1-737055a97779 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:17.113345 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d4863-b1c0-4c70-acc1-737055a97779 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:17.114832 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d4863-b1c0-4c70-acc1-737055a97779 service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:17.123742 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1469/2919] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:40:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:40:18.532238 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c15d7-fb58-4544-af97-b6dab9509bdf None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:18.532762 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c15d7-fb58-4544-af97-b6dab9509bdf None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:18.532762 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c15d7-fb58-4544-af97-b6dab9509bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:18.553363 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-ee0c15d7-fb58-4544-af97-b6dab9509bdf None None] MFA Rules not processed for user `43597941419e4cf5901916edc9252e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:40:18.554577 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ee0c15d7-fb58-4544-af97-b6dab9509bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:18.562647 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1451/2920] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:40:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:40:18.815229 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d4863-b1c0-4c70-acc1-737055a97779 service cinder] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:18.817617 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-209d4863-b1c0-4c70-acc1-737055a97779 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:18.837715 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d4863-b1c0-4c70-acc1-737055a97779 service cinder] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:18.844466 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b617442-fce1-4d0e-bd79-ab49cb440339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ae980afbfd49dea9bbb0adc02b9031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:18.845384 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b617442-fce1-4d0e-bd79-ab49cb440339 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:18.845776 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b617442-fce1-4d0e-bd79-ab49cb440339 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:18.846138 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b617442-fce1-4d0e-bd79-ab49cb440339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:18.848635 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-6b617442-fce1-4d0e-bd79-ab49cb440339 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:18.860130 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b617442-fce1-4d0e-bd79-ab49cb440339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:18.861693 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b617442-fce1-4d0e-bd79-ab49cb440339 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:18.870728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1470/2921] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:40:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:40:28.547845 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=75,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:40:28.866860 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=41 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:40:31.345565 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c15d7-fb58-4544-af97-b6dab9509bdf None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:31.347232 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ee0c15d7-fb58-4544-af97-b6dab9509bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:31.446827 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c15d7-fb58-4544-af97-b6dab9509bdf None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:31.452261 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059fcb8-03ba-4f40-9466-38168b3ea45e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd59eac06e347ee9432185b24fdf773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:31.452871 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059fcb8-03ba-4f40-9466-38168b3ea45e service placement] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:31.453146 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059fcb8-03ba-4f40-9466-38168b3ea45e service placement] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:31.453411 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059fcb8-03ba-4f40-9466-38168b3ea45e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:31.455404 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-7059fcb8-03ba-4f40-9466-38168b3ea45e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:31.467542 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059fcb8-03ba-4f40-9466-38168b3ea45e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:31.468928 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059fcb8-03ba-4f40-9466-38168b3ea45e service placement] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:31.479297 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1452/2922] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Oct 4 16:40:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 16:40:32.809055 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a857d-a8c1-4b25-9933-12d1bf296cc5 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:32.809575 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a857d-a8c1-4b25-9933-12d1bf296cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:32.809575 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a857d-a8c1-4b25-9933-12d1bf296cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:32.829934 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-385a857d-a8c1-4b25-9933-12d1bf296cc5 None None] MFA Rules not processed for user `43597941419e4cf5901916edc9252e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:40:32.831237 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-385a857d-a8c1-4b25-9933-12d1bf296cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:32.839535 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1471/2923] 10.222.0.55 () {58 vars in 958 bytes} [Tue Oct 4 16:40:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:40:41.475363 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=41 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:40:42.824122 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:40:48.696409 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b74ca8-73e0-4194-ada2-0b8c717f2eaa None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:48.696897 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b74ca8-73e0-4194-ada2-0b8c717f2eaa None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:48.696993 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b74ca8-73e0-4194-ada2-0b8c717f2eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:48.729071 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-85b74ca8-73e0-4194-ada2-0b8c717f2eaa None None] MFA Rules not processed for user `05cfc9d62a244701a5df524d1c26f107`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:40:48.730391 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-85b74ca8-73e0-4194-ada2-0b8c717f2eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:48.813380 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1453/2924] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Oct 4 16:40:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:40:48.867764 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a857d-a8c1-4b25-9933-12d1bf296cc5 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:40:48.869325 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-385a857d-a8c1-4b25-9933-12d1bf296cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:40:48.944642 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a857d-a8c1-4b25-9933-12d1bf296cc5 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:40:48.951331 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be33c20-bf2e-4578-9a3f-1acfd46f36d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6590cb6c1c964039b9dea771a647bdac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:40:48.952006 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be33c20-bf2e-4578-9a3f-1acfd46f36d5 service swift] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:40:48.952277 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be33c20-bf2e-4578-9a3f-1acfd46f36d5 service swift] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:40:48.952440 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be33c20-bf2e-4578-9a3f-1acfd46f36d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:40:48.961701 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be33c20-bf2e-4578-9a3f-1acfd46f36d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:40:48.963406 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be33c20-bf2e-4578-9a3f-1acfd46f36d5 service swift] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:40:48.972220 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1472/2925] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Oct 4 16:40:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 16:40:58.802421 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=32 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:40:58.972663 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=32 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:41:03.432923 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686a3a4-7e97-4f8f-ae56-23b747b59c65 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:41:03.433474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686a3a4-7e97-4f8f-ae56-23b747b59c65 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:41:03.433474 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686a3a4-7e97-4f8f-ae56-23b747b59c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:41:03.456297 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-0686a3a4-7e97-4f8f-ae56-23b747b59c65 None None] MFA Rules not processed for user `05cfc9d62a244701a5df524d1c26f107`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 16:41:03.457581 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-0686a3a4-7e97-4f8f-ae56-23b747b59c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 16:41:03.466886 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1454/2926] 10.222.0.55 () {58 vars in 967 bytes} [Tue Oct 4 16:41:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 16:41:03.479798 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be33c20-bf2e-4578-9a3f-1acfd46f36d5 service swift] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:41:03.491102 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be33c20-bf2e-4578-9a3f-1acfd46f36d5 service swift] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:41:03.496888 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a524e7-deee-4987-93df-41a15bbc1729 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6590cb6c1c964039b9dea771a647bdac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e480e782c4fa403a913ca7179db0843b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:41:03.497498 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a524e7-deee-4987-93df-41a15bbc1729 service swift] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:41:03.497779 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a524e7-deee-4987-93df-41a15bbc1729 service swift] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:41:03.498062 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a524e7-deee-4987-93df-41a15bbc1729 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:41:03.506957 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a524e7-deee-4987-93df-41a15bbc1729 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:41:03.508595 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a524e7-deee-4987-93df-41a15bbc1729 service swift] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:41:03.517361 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1473/2927] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Oct 4 16:41:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 16:41:05.545865 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686a3a4-7e97-4f8f-ae56-23b747b59c65 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:41:05.558774 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686a3a4-7e97-4f8f-ae56-23b747b59c65 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:41:05.565366 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d743241-6ad1-4299-bcf2-f2b6752fffa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:41:05.566043 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d743241-6ad1-4299-bcf2-f2b6752fffa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:41:05.566319 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d743241-6ad1-4299-bcf2-f2b6752fffa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:41:05.566586 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d743241-6ad1-4299-bcf2-f2b6752fffa1 admin admin] PATH_INFO: `/v3/users/43597941419e4cf5901916edc9252e4e` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:41:05.567896 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d743241-6ad1-4299-bcf2-f2b6752fffa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43597941419e4cf5901916edc9252e4e)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:41:05.569941 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d743241-6ad1-4299-bcf2-f2b6752fffa1 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:41:05.621706 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-8d743241-6ad1-4299-bcf2-f2b6752fffa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43597941419e4cf5901916edc9252e4e'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:41:05.622369 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-8d743241-6ad1-4299-bcf2-f2b6752fffa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43597941419e4cf5901916edc9252e4e'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:41:05.629465 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-8d743241-6ad1-4299-bcf2-f2b6752fffa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43597941419e4cf5901916edc9252e4e'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:41:05.630124 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-8d743241-6ad1-4299-bcf2-f2b6752fffa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43597941419e4cf5901916edc9252e4e'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:41:05.639176 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-8d743241-6ad1-4299-bcf2-f2b6752fffa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43597941419e4cf5901916edc9252e4e'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:41:05.658716 dv-cinder-749155-14-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1455/2928] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Oct 4 16:41:05 2022] DELETE /identity/v3/users/43597941419e4cf5901916edc9252e4e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:41:05.844803 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a524e7-deee-4987-93df-41a15bbc1729 service swift] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 16:41:05.856851 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a524e7-deee-4987-93df-41a15bbc1729 service swift] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 16:41:05.933031 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e64af-d97f-4462-9aac-2027b758bd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a141c4b1594c35992b7b147f7c2904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8da776c843c485a9ba105a4675b7ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 16:41:05.934026 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e64af-d97f-4462-9aac-2027b758bd26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 16:41:05.934451 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e64af-d97f-4462-9aac-2027b758bd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 16:41:05.934851 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e64af-d97f-4462-9aac-2027b758bd26 admin admin] PATH_INFO: `/v3/projects/a66c04f0c98e4cdeb356769a8d480480` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 16:41:05.936367 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e64af-d97f-4462-9aac-2027b758bd26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a66c04f0c98e4cdeb356769a8d480480)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 16:41:05.938292 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e64af-d97f-4462-9aac-2027b758bd26 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 16:41:05.989773 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-6b7e64af-d97f-4462-9aac-2027b758bd26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a66c04f0c98e4cdeb356769a8d480480', 'request_id': 'req-6b7e64af-d97f-4462-9aac-2027b758bd26'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:41:05.998656 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-6b7e64af-d97f-4462-9aac-2027b758bd26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a66c04f0c98e4cdeb356769a8d480480', 'request_id': 'req-6b7e64af-d97f-4462-9aac-2027b758bd26'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:41:06.005728 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-6b7e64af-d97f-4462-9aac-2027b758bd26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a66c04f0c98e4cdeb356769a8d480480', 'request_id': 'req-6b7e64af-d97f-4462-9aac-2027b758bd26'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:41:06.017313 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-6b7e64af-d97f-4462-9aac-2027b758bd26 admin admin] The token cache is being invalidate because project a66c04f0c98e4cdeb356769a8d480480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81562) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 16:41:06.017529 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-6b7e64af-d97f-4462-9aac-2027b758bd26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:41:06.018219 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-6b7e64af-d97f-4462-9aac-2027b758bd26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 16:41:06.019807 dv-cinder-749155-14-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1474/2929] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Oct 4 16:41:05 2022] DELETE /identity/v3/projects/a66c04f0c98e4cdeb356769a8d480480 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 16:41:15.655108 dv-cinder-749155-14-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 16:41:16.014066 dv-cinder-749155-14-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}